INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /node/691103f8699dbc4cda8e789e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET /node/69934d09523507f3806a5bc5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET /node/6985de0271989fb14149b2b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /node/691054938b15debe9dd4bfc8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49338 - "GET /node/6984d4bb3ff18e47df612645%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:27:54,600 - lava_callback - INFO - Received callback for node 69e6c48760f5826562c151a0 2026-04-23 00:27:54,606 - lava_callback - INFO - Starting async job submit for node 69e6c48760f5826562c151a0 INFO: 172.21.0.1:58356 - "POST /node/69e6c48760f5826562c151a0 HTTP/1.0" 202 Accepted 2026-04-23 00:27:54,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,627 - lava_callback - DEBUG - Processing node 69e6c48760f5826562c151a0: baseline-arm-clabbe 2026-04-23 00:27:54,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c48760f5826562c151a0 2026-04-23 00:27:54,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:27:54,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,703 - lava_callback - ERROR - Error processing callback for node 69e6c48760f5826562c151a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:28:34,569 - lava_callback - INFO - Received callback for node 69e6c4ac60f5826562c15761 INFO: 172.21.0.1:57470 - "POST /node/69e6c4ac60f5826562c15761 HTTP/1.0" 202 Accepted 2026-04-23 00:28:34,580 - lava_callback - INFO - Starting async job submit for node 69e6c4ac60f5826562c15761 2026-04-23 00:28:34,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,688 - lava_callback - DEBUG - Processing node 69e6c4ac60f5826562c15761: baseline-arm-clabbe 2026-04-23 00:28:34,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4ac60f5826562c15761 2026-04-23 00:28:34,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:28:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,790 - lava_callback - ERROR - Error processing callback for node 69e6c4ac60f5826562c15761: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:29:14,643 - lava_callback - INFO - Received callback for node 69e6c4d460f5826562c15772 INFO: 172.21.0.1:33274 - "POST /node/69e6c4d460f5826562c15772 HTTP/1.0" 202 Accepted 2026-04-23 00:29:14,649 - lava_callback - INFO - Starting async job submit for node 69e6c4d460f5826562c15772 2026-04-23 00:29:14,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,668 - lava_callback - DEBUG - Processing node 69e6c4d460f5826562c15772: baseline-arm-clabbe 2026-04-23 00:29:14,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4d460f5826562c15772 2026-04-23 00:29:14,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:29:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,736 - lava_callback - ERROR - Error processing callback for node 69e6c4d460f5826562c15772: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:29:54,660 - lava_callback - INFO - Received callback for node 69e6c4f960f5826562c15786 INFO: 172.21.0.1:41716 - "POST /node/69e6c4f960f5826562c15786 HTTP/1.0" 202 Accepted 2026-04-23 00:29:54,668 - lava_callback - INFO - Starting async job submit for node 69e6c4f960f5826562c15786 2026-04-23 00:29:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,688 - lava_callback - DEBUG - Processing node 69e6c4f960f5826562c15786: baseline-arm-clabbe 2026-04-23 00:29:54,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4f960f5826562c15786 2026-04-23 00:29:54,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:29:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,739 - lava_callback - ERROR - Error processing callback for node 69e6c4f960f5826562c15786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:30:33,246 - lava_callback - INFO - Received callback for node 69e967b58137cb226ce1cb1d INFO: 172.21.0.1:34050 - "POST /node/69e967b58137cb226ce1cb1d HTTP/1.0" 202 Accepted 2026-04-23 00:30:33,254 - lava_callback - INFO - Starting async job submit for node 69e967b58137cb226ce1cb1d 2026-04-23 00:30:33,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:33,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:33,293 - lava_callback - DEBUG - Processing node 69e967b58137cb226ce1cb1d: baseline-arm 2026-04-23 00:30:33,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:33,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:33,895 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/log.txt.gz 2026-04-23 00:30:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:34,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:34,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/lava-logs.yaml 2026-04-23 00:30:34,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:34,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:34,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/lava_callback.json.gz 2026-04-23 00:30:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:34,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 00:30:34,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:34,541 - lava_callback - INFO - Completed processing callback for node 69e967b58137cb226ce1cb1d 2026-04-23 00:30:34,710 - lava_callback - INFO - Received callback for node 69e6c51f60f5826562c15792 INFO: 172.21.0.1:34058 - "POST /node/69e6c51f60f5826562c15792 HTTP/1.0" 202 Accepted 2026-04-23 00:30:34,719 - lava_callback - INFO - Starting async job submit for node 69e6c51f60f5826562c15792 2026-04-23 00:30:34,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,740 - lava_callback - DEBUG - Processing node 69e6c51f60f5826562c15792: baseline-arm-clabbe 2026-04-23 00:30:34,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c51f60f5826562c15792 2026-04-23 00:30:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:30:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,844 - lava_callback - ERROR - Error processing callback for node 69e6c51f60f5826562c15792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:30:54,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:54,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:31:14,722 - lava_callback - INFO - Received callback for node 69e6c54660f5826562c157a3 INFO: 172.21.0.1:33150 - "POST /node/69e6c54660f5826562c157a3 HTTP/1.0" 202 Accepted 2026-04-23 00:31:14,730 - lava_callback - INFO - Starting async job submit for node 69e6c54660f5826562c157a3 2026-04-23 00:31:14,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,744 - lava_callback - DEBUG - Processing node 69e6c54660f5826562c157a3: baseline-arm-clabbe 2026-04-23 00:31:14,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c54660f5826562c157a3 2026-04-23 00:31:14,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:31:14,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,806 - lava_callback - ERROR - Error processing callback for node 69e6c54660f5826562c157a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:31:54,777 - lava_callback - INFO - Received callback for node 69e6c56e60f5826562c157ba INFO: 172.21.0.1:44470 - "POST /node/69e6c56e60f5826562c157ba HTTP/1.0" 202 Accepted 2026-04-23 00:31:54,784 - lava_callback - INFO - Starting async job submit for node 69e6c56e60f5826562c157ba 2026-04-23 00:31:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,801 - lava_callback - DEBUG - Processing node 69e6c56e60f5826562c157ba: baseline-arm-clabbe 2026-04-23 00:31:54,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c56e60f5826562c157ba 2026-04-23 00:31:54,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:31:54,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,862 - lava_callback - ERROR - Error processing callback for node 69e6c56e60f5826562c157ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:34,789 - lava_callback - INFO - Received callback for node 69e6c59860f5826562c157e8 INFO: 172.21.0.1:52414 - "POST /node/69e6c59860f5826562c157e8 HTTP/1.0" 202 Accepted 2026-04-23 00:32:34,798 - lava_callback - INFO - Starting async job submit for node 69e6c59860f5826562c157e8 2026-04-23 00:32:34,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,816 - lava_callback - DEBUG - Processing node 69e6c59860f5826562c157e8: baseline-arm-clabbe 2026-04-23 00:32:34,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59860f5826562c157e8 2026-04-23 00:32:34,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:32:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,892 - lava_callback - ERROR - Error processing callback for node 69e6c59860f5826562c157e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:40,947 - lava_callback - INFO - Received callback for node 69e6c59460f5826562c157df INFO: 172.21.0.1:56418 - "POST /node/69e6c59460f5826562c157df HTTP/1.0" 202 Accepted 2026-04-23 00:32:40,954 - lava_callback - INFO - Starting async job submit for node 69e6c59460f5826562c157df 2026-04-23 00:32:40,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:40,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:40,971 - lava_callback - DEBUG - Processing node 69e6c59460f5826562c157df: baseline-arm-baylibre 2026-04-23 00:32:40,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59460f5826562c157df 2026-04-23 00:32:40,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:41,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:41,062 - lava_callback - ERROR - Error processing callback for node 69e6c59460f5826562c157df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:41,661 - lava_callback - INFO - Received callback for node 69e6c59560f5826562c157e2 INFO: 172.21.0.1:56428 - "POST /node/69e6c59560f5826562c157e2 HTTP/1.0" 202 Accepted 2026-04-23 00:32:41,668 - lava_callback - INFO - Starting async job submit for node 69e6c59560f5826562c157e2 2026-04-23 00:32:41,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,689 - lava_callback - DEBUG - Processing node 69e6c59560f5826562c157e2: baseline-arm-baylibre 2026-04-23 00:32:41,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59560f5826562c157e2 2026-04-23 00:32:41,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:41,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,756 - lava_callback - ERROR - Error processing callback for node 69e6c59560f5826562c157e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:42,363 - lava_callback - INFO - Received callback for node 69e6c59760f5826562c157e5 INFO: 172.21.0.1:56436 - "POST /node/69e6c59760f5826562c157e5 HTTP/1.0" 202 Accepted 2026-04-23 00:32:42,370 - lava_callback - INFO - Starting async job submit for node 69e6c59760f5826562c157e5 2026-04-23 00:32:42,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,389 - lava_callback - DEBUG - Processing node 69e6c59760f5826562c157e5: baseline-arm-baylibre 2026-04-23 00:32:42,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59760f5826562c157e5 2026-04-23 00:32:42,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,458 - lava_callback - ERROR - Error processing callback for node 69e6c59760f5826562c157e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:43,038 - lava_callback - INFO - Received callback for node 69e6c59860f5826562c157ea INFO: 172.21.0.1:56446 - "POST /node/69e6c59860f5826562c157ea HTTP/1.0" 202 Accepted 2026-04-23 00:32:43,044 - lava_callback - INFO - Starting async job submit for node 69e6c59860f5826562c157ea 2026-04-23 00:32:43,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,063 - lava_callback - DEBUG - Processing node 69e6c59860f5826562c157ea: baseline-arm-baylibre 2026-04-23 00:32:43,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59860f5826562c157ea 2026-04-23 00:32:43,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:43,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,115 - lava_callback - ERROR - Error processing callback for node 69e6c59860f5826562c157ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:43,685 - lava_callback - INFO - Received callback for node 69e6c59b60f5826562c157f6 INFO: 172.21.0.1:56448 - "POST /node/69e6c59b60f5826562c157f6 HTTP/1.0" 202 Accepted 2026-04-23 00:32:43,700 - lava_callback - INFO - Starting async job submit for node 69e6c59b60f5826562c157f6 2026-04-23 00:32:43,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,737 - lava_callback - DEBUG - Processing node 69e6c59b60f5826562c157f6: baseline-arm-baylibre 2026-04-23 00:32:43,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59b60f5826562c157f6 2026-04-23 00:32:43,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:43,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,801 - lava_callback - ERROR - Error processing callback for node 69e6c59b60f5826562c157f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:44,384 - lava_callback - INFO - Received callback for node 69e6c59c60f5826562c157fb INFO: 172.21.0.1:56464 - "POST /node/69e6c59c60f5826562c157fb HTTP/1.0" 202 Accepted 2026-04-23 00:32:44,390 - lava_callback - INFO - Starting async job submit for node 69e6c59c60f5826562c157fb 2026-04-23 00:32:44,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,408 - lava_callback - DEBUG - Processing node 69e6c59c60f5826562c157fb: baseline-arm-baylibre 2026-04-23 00:32:44,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59c60f5826562c157fb 2026-04-23 00:32:44,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:44,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,482 - lava_callback - ERROR - Error processing callback for node 69e6c59c60f5826562c157fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:54,824 - lava_callback - INFO - Received callback for node 69e6c5a460f5826562c15810 INFO: 172.21.0.1:52684 - "POST /node/69e6c5a460f5826562c15810 HTTP/1.0" 202 Accepted 2026-04-23 00:32:54,831 - lava_callback - INFO - Starting async job submit for node 69e6c5a460f5826562c15810 2026-04-23 00:32:54,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,849 - lava_callback - DEBUG - Processing node 69e6c5a460f5826562c15810: baseline-arm-clabbe 2026-04-23 00:32:54,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a460f5826562c15810 2026-04-23 00:32:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,942 - lava_callback - ERROR - Error processing callback for node 69e6c5a460f5826562c15810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:55,502 - lava_callback - INFO - Received callback for node 69e6c5a560f5826562c15816 INFO: 172.21.0.1:52694 - "POST /node/69e6c5a560f5826562c15816 HTTP/1.0" 202 Accepted 2026-04-23 00:32:55,512 - lava_callback - INFO - Starting async job submit for node 69e6c5a560f5826562c15816 2026-04-23 00:32:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,532 - lava_callback - DEBUG - Processing node 69e6c5a560f5826562c15816: baseline-arm-clabbe 2026-04-23 00:32:55,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a560f5826562c15816 2026-04-23 00:32:55,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:55,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,592 - lava_callback - ERROR - Error processing callback for node 69e6c5a560f5826562c15816: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:56,194 - lava_callback - INFO - Received callback for node 69e6c5a660f5826562c1581a INFO: 172.21.0.1:52698 - "POST /node/69e6c5a660f5826562c1581a HTTP/1.0" 202 Accepted 2026-04-23 00:32:56,201 - lava_callback - INFO - Starting async job submit for node 69e6c5a660f5826562c1581a 2026-04-23 00:32:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,218 - lava_callback - DEBUG - Processing node 69e6c5a660f5826562c1581a: baseline-arm-clabbe 2026-04-23 00:32:56,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a660f5826562c1581a 2026-04-23 00:32:56,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,278 - lava_callback - ERROR - Error processing callback for node 69e6c5a660f5826562c1581a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:56,875 - lava_callback - INFO - Received callback for node 69e6c5a660f5826562c1581d INFO: 172.21.0.1:52722 - "POST /node/69e6c5a660f5826562c1581d HTTP/1.0" 202 Accepted 2026-04-23 00:32:56,882 - lava_callback - INFO - Starting async job submit for node 69e6c5a660f5826562c1581d 2026-04-23 00:32:56,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,906 - lava_callback - DEBUG - Processing node 69e6c5a660f5826562c1581d: baseline-arm-clabbe 2026-04-23 00:32:56,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a660f5826562c1581d 2026-04-23 00:32:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:56,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,962 - lava_callback - ERROR - Error processing callback for node 69e6c5a660f5826562c1581d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:57,585 - lava_callback - INFO - Received callback for node 69e6c5a760f5826562c15820 INFO: 172.21.0.1:52732 - "POST /node/69e6c5a760f5826562c15820 HTTP/1.0" 202 Accepted 2026-04-23 00:32:57,592 - lava_callback - INFO - Starting async job submit for node 69e6c5a760f5826562c15820 2026-04-23 00:32:57,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,609 - lava_callback - DEBUG - Processing node 69e6c5a760f5826562c15820: baseline-arm-clabbe 2026-04-23 00:32:57,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a760f5826562c15820 2026-04-23 00:32:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:57,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,669 - lava_callback - ERROR - Error processing callback for node 69e6c5a760f5826562c15820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:58,284 - lava_callback - INFO - Received callback for node 69e6c5a860f5826562c15823 INFO: 172.21.0.1:52742 - "POST /node/69e6c5a860f5826562c15823 HTTP/1.0" 202 Accepted 2026-04-23 00:32:58,293 - lava_callback - INFO - Starting async job submit for node 69e6c5a860f5826562c15823 2026-04-23 00:32:58,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,325 - lava_callback - DEBUG - Processing node 69e6c5a860f5826562c15823: baseline-arm-clabbe 2026-04-23 00:32:58,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a860f5826562c15823 2026-04-23 00:32:58,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:58,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,379 - lava_callback - ERROR - Error processing callback for node 69e6c5a860f5826562c15823: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:59,001 - lava_callback - INFO - Received callback for node 69e6c5a960f5826562c15826 INFO: 172.21.0.1:52748 - "POST /node/69e6c5a960f5826562c15826 HTTP/1.0" 202 Accepted 2026-04-23 00:32:59,007 - lava_callback - INFO - Starting async job submit for node 69e6c5a960f5826562c15826 2026-04-23 00:32:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,023 - lava_callback - DEBUG - Processing node 69e6c5a960f5826562c15826: baseline-arm-clabbe 2026-04-23 00:32:59,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a960f5826562c15826 2026-04-23 00:32:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,096 - lava_callback - ERROR - Error processing callback for node 69e6c5a960f5826562c15826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:59,684 - lava_callback - INFO - Received callback for node 69e6c5aa60f5826562c15829 INFO: 172.21.0.1:52764 - "POST /node/69e6c5aa60f5826562c15829 HTTP/1.0" 202 Accepted 2026-04-23 00:32:59,691 - lava_callback - INFO - Starting async job submit for node 69e6c5aa60f5826562c15829 2026-04-23 00:32:59,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,722 - lava_callback - DEBUG - Processing node 69e6c5aa60f5826562c15829: baseline-arm-clabbe 2026-04-23 00:32:59,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5aa60f5826562c15829 2026-04-23 00:32:59,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:59,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,789 - lava_callback - ERROR - Error processing callback for node 69e6c5aa60f5826562c15829: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:33:00,401 - lava_callback - INFO - Received callback for node 69e6c5aa60f5826562c15856 INFO: 172.21.0.1:46660 - "POST /node/69e6c5aa60f5826562c15856 HTTP/1.0" 202 Accepted 2026-04-23 00:33:00,408 - lava_callback - INFO - Starting async job submit for node 69e6c5aa60f5826562c15856 2026-04-23 00:33:00,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,437 - lava_callback - DEBUG - Processing node 69e6c5aa60f5826562c15856: baseline-arm-clabbe 2026-04-23 00:33:00,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5aa60f5826562c15856 2026-04-23 00:33:00,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:33:00,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,494 - lava_callback - ERROR - Error processing callback for node 69e6c5aa60f5826562c15856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:14,838 - lava_callback - INFO - Received callback for node 69e6c5bf60f5826562c1587c INFO: 172.21.0.1:46972 - "POST /node/69e6c5bf60f5826562c1587c HTTP/1.0" 202 Accepted 2026-04-23 00:33:14,845 - lava_callback - INFO - Starting async job submit for node 69e6c5bf60f5826562c1587c 2026-04-23 00:33:14,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,861 - lava_callback - DEBUG - Processing node 69e6c5bf60f5826562c1587c: baseline-arm-clabbe 2026-04-23 00:33:14,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5bf60f5826562c1587c 2026-04-23 00:33:14,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:33:14,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,914 - lava_callback - ERROR - Error processing callback for node 69e6c5bf60f5826562c1587c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:40,953 - lava_callback - INFO - Received callback for node 69e6c5e160f5826562c158dc INFO: 172.21.0.1:38752 - "POST /node/69e6c5e160f5826562c158dc HTTP/1.0" 202 Accepted 2026-04-23 00:33:40,958 - lava_callback - INFO - Starting async job submit for node 69e6c5e160f5826562c158dc 2026-04-23 00:33:40,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:40,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:40,974 - lava_callback - DEBUG - Processing node 69e6c5e160f5826562c158dc: baseline-arm-baylibre 2026-04-23 00:33:40,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5e160f5826562c158dc 2026-04-23 00:33:40,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:40,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:41,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:33:41,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:41,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:41,028 - lava_callback - ERROR - Error processing callback for node 69e6c5e160f5826562c158dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:54,488 - lava_callback - INFO - Received callback for node 69e968de8137cb226ce1f297 INFO: 172.21.0.1:39718 - "POST /node/69e968de8137cb226ce1f297 HTTP/1.0" 202 Accepted 2026-04-23 00:33:54,498 - lava_callback - INFO - Starting async job submit for node 69e968de8137cb226ce1f297 2026-04-23 00:33:54,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,534 - lava_callback - DEBUG - Processing node 69e968de8137cb226ce1f297: baseline-arm 2026-04-23 00:33:54,542 - lava_callback - WARNING - Failed to upload log 2026-04-23 00:33:54,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:33:54,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:33:54,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f297/lava-logs.yaml 2026-04-23 00:33:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:33:54,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:33:54,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f297/lava_callback.json.gz 2026-04-23 00:33:54,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:33:54,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,856 - lava_callback - INFO - Completed processing callback for node 69e968de8137cb226ce1f297 INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:10,615 - lava_callback - INFO - Received callback for node 69e968de8137cb226ce1f29a INFO: 172.21.0.1:52740 - "POST /node/69e968de8137cb226ce1f29a HTTP/1.0" 202 Accepted 2026-04-23 00:34:10,662 - lava_callback - INFO - Starting async job submit for node 69e968de8137cb226ce1f29a 2026-04-23 00:34:10,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:10,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:10,694 - lava_callback - DEBUG - Processing node 69e968de8137cb226ce1f29a: baseline-arm 2026-04-23 00:34:10,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:10,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:10,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/log.txt.gz 2026-04-23 00:34:10,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:11,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:11,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/lava-logs.yaml 2026-04-23 00:34:11,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:11,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:11,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/lava_callback.json.gz 2026-04-23 00:34:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:11,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:11,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:11,272 - lava_callback - INFO - Completed processing callback for node 69e968de8137cb226ce1f29a 2026-04-23 00:34:14,951 - lava_callback - INFO - Received callback for node 69e968e18137cb226ce1f2a3 INFO: 172.21.0.1:52744 - "POST /node/69e968e18137cb226ce1f2a3 HTTP/1.0" 202 Accepted 2026-04-23 00:34:14,997 - lava_callback - INFO - Starting async job submit for node 69e968e18137cb226ce1f2a3 2026-04-23 00:34:15,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,031 - lava_callback - DEBUG - Processing node 69e968e18137cb226ce1f2a3: baseline-arm 2026-04-23 00:34:15,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52750 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:34:15,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/log.txt.gz 2026-04-23 00:34:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:15,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/lava-logs.yaml 2026-04-23 00:34:15,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:15,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/lava_callback.json.gz 2026-04-23 00:34:15,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:15,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,629 - lava_callback - INFO - Completed processing callback for node 69e968e18137cb226ce1f2a3 INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:21,030 - lava_callback - INFO - Received callback for node 69e6c60a60f5826562c1591c INFO: 172.21.0.1:52034 - "POST /node/69e6c60a60f5826562c1591c HTTP/1.0" 202 Accepted 2026-04-23 00:34:21,035 - lava_callback - INFO - Starting async job submit for node 69e6c60a60f5826562c1591c 2026-04-23 00:34:21,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,050 - lava_callback - DEBUG - Processing node 69e6c60a60f5826562c1591c: baseline-arm-baylibre 2026-04-23 00:34:21,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c60a60f5826562c1591c 2026-04-23 00:34:21,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:34:21,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,094 - lava_callback - ERROR - Error processing callback for node 69e6c60a60f5826562c1591c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:34:24,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:24,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:50,104 - lava_callback - INFO - Received callback for node 69e968e08137cb226ce1f2a0 INFO: 172.21.0.1:47796 - "POST /node/69e968e08137cb226ce1f2a0 HTTP/1.0" 202 Accepted 2026-04-23 00:34:50,110 - lava_callback - INFO - Starting async job submit for node 69e968e08137cb226ce1f2a0 2026-04-23 00:34:50,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:50,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:50,151 - lava_callback - DEBUG - Processing node 69e968e08137cb226ce1f2a0: baseline-arm 2026-04-23 00:34:50,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/log.txt.gz 2026-04-23 00:34:50,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/lava-logs.yaml 2026-04-23 00:34:50,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/lava_callback.json.gz 2026-04-23 00:34:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:51,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:51,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:51,062 - lava_callback - INFO - Completed processing callback for node 69e968e08137cb226ce1f2a0 2026-04-23 00:34:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:54,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:57,815 - lava_callback - INFO - Received callback for node 69e968dd8137cb226ce1f294 INFO: 172.21.0.1:47812 - "POST /node/69e968dd8137cb226ce1f294 HTTP/1.0" 202 Accepted 2026-04-23 00:34:57,821 - lava_callback - INFO - Starting async job submit for node 69e968dd8137cb226ce1f294 2026-04-23 00:34:57,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:57,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:57,857 - lava_callback - DEBUG - Processing node 69e968dd8137cb226ce1f294: baseline-arm 2026-04-23 00:34:58,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/log.txt.gz 2026-04-23 00:34:58,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/lava-logs.yaml 2026-04-23 00:34:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/lava_callback.json.gz 2026-04-23 00:34:58,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:58,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:58,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:58,591 - lava_callback - INFO - Completed processing callback for node 69e968dd8137cb226ce1f294 INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:08,467 - lava_callback - INFO - Received callback for node 69e969038137cb226ce1f337 INFO: 172.21.0.1:59508 - "POST /node/69e969038137cb226ce1f337 HTTP/1.0" 202 Accepted 2026-04-23 00:35:08,513 - lava_callback - INFO - Starting async job submit for node 69e969038137cb226ce1f337 2026-04-23 00:35:08,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:08,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:08,551 - lava_callback - DEBUG - Processing node 69e969038137cb226ce1f337: baseline-arm-pengutronix 2026-04-23 00:35:08,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:08,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:08,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/log.txt.gz 2026-04-23 00:35:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:08,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:08,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/lava-logs.yaml 2026-04-23 00:35:08,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:09,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:09,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/lava_callback.json.gz 2026-04-23 00:35:09,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:09,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:09,327 - lava_callback - INFO - Completed processing callback for node 69e969038137cb226ce1f337 2026-04-23 00:35:15,154 - lava_callback - INFO - Received callback for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48966 - "POST /node/69e969018137cb226ce1f32d HTTP/1.0" 202 Accepted 2026-04-23 00:35:15,159 - lava_callback - INFO - Starting async job submit for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:35:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,192 - lava_callback - DEBUG - Processing node 69e969018137cb226ce1f32d: baseline-arm-pengutronix 2026-04-23 00:35:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/log.txt.gz 2026-04-23 00:35:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/lava-logs.yaml 2026-04-23 00:35:15,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/lava_callback.json.gz 2026-04-23 00:35:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:15,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,833 - lava_callback - INFO - Completed processing callback for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:24,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:42,340 - lava_callback - INFO - Received callback for node 69e968fb8137cb226ce1f31c INFO: 172.21.0.1:44564 - "POST /node/69e968fb8137cb226ce1f31c HTTP/1.0" 202 Accepted 2026-04-23 00:35:42,345 - lava_callback - INFO - Starting async job submit for node 69e968fb8137cb226ce1f31c 2026-04-23 00:35:42,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:42,382 - lava_callback - DEBUG - Processing node 69e968fb8137cb226ce1f31c: baseline-arm-kontron 2026-04-23 00:35:42,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:42,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:42,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/log.txt.gz 2026-04-23 00:35:42,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:42,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:42,889 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/lava-logs.yaml 2026-04-23 00:35:42,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:43,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:43,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/lava_callback.json.gz 2026-04-23 00:35:43,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:43,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:43,093 - lava_callback - INFO - Completed processing callback for node 69e968fb8137cb226ce1f31c INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:54,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:35:55,680 - lava_callback - INFO - Received callback for node 69e968ff8137cb226ce1f32a INFO: 172.21.0.1:58050 - "POST /node/69e968ff8137cb226ce1f32a HTTP/1.0" 202 Accepted 2026-04-23 00:35:55,685 - lava_callback - INFO - Starting async job submit for node 69e968ff8137cb226ce1f32a 2026-04-23 00:35:55,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:55,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None 2026-04-23 00:35:55,735 - lava_callback - DEBUG - Processing node 69e968ff8137cb226ce1f32a: baseline-arm-pengutronix 2026-04-23 00:35:55,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/log.txt.gz 2026-04-23 00:35:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/lava-logs.yaml 2026-04-23 00:35:56,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/lava_callback.json.gz 2026-04-23 00:35:56,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None 2026-04-23 00:35:56,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:56,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:56,553 - lava_callback - INFO - Completed processing callback for node 69e968ff8137cb226ce1f32a 2026-04-23 00:36:02,363 - lava_callback - INFO - Received callback for node 69e968fc8137cb226ce1f31f INFO: 172.21.0.1:59708 - "POST /node/69e968fc8137cb226ce1f31f HTTP/1.0" 202 Accepted 2026-04-23 00:36:02,369 - lava_callback - INFO - Starting async job submit for node 69e968fc8137cb226ce1f31f 2026-04-23 00:36:02,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:02,405 - lava_callback - DEBUG - Processing node 69e968fc8137cb226ce1f31f: baseline-arm-kontron 2026-04-23 00:36:02,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:02,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:02,710 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/log.txt.gz 2026-04-23 00:36:02,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:02,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:02,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/lava-logs.yaml 2026-04-23 00:36:02,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:03,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:03,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/lava_callback.json.gz 2026-04-23 00:36:03,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:03,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:36:03,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:03,220 - lava_callback - INFO - Completed processing callback for node 69e968fc8137cb226ce1f31f INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:24,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:24,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:27,182 - lava_callback - INFO - Received callback for node 69e9691b8137cb226ce1f36b INFO: 172.21.0.1:37746 - "POST /node/69e9691b8137cb226ce1f36b HTTP/1.0" 202 Accepted 2026-04-23 00:36:27,188 - lava_callback - INFO - Starting async job submit for node 69e9691b8137cb226ce1f36b 2026-04-23 00:36:27,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:27,225 - lava_callback - DEBUG - Processing node 69e9691b8137cb226ce1f36b: ltp-dio 2026-04-23 00:36:27,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:27,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:27,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/log.txt.gz 2026-04-23 00:36:27,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:28,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:28,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/lava-logs.yaml 2026-04-23 00:36:28,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:28,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:28,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/lava_callback.json.gz 2026-04-23 00:36:28,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:28,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:36:28,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:28,328 - lava_callback - INFO - Completed processing callback for node 69e9691b8137cb226ce1f36b INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:54,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:54,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:37:55,053 - lava_callback - INFO - Received callback for node 69e6c6ce60f5826562c15988 INFO: 172.21.0.1:60074 - "POST /node/69e6c6ce60f5826562c15988 HTTP/1.0" 202 Accepted 2026-04-23 00:37:55,058 - lava_callback - INFO - Starting async job submit for node 69e6c6ce60f5826562c15988 2026-04-23 00:37:55,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,074 - lava_callback - DEBUG - Processing node 69e6c6ce60f5826562c15988: baseline-arm-clabbe 2026-04-23 00:37:55,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c6ce60f5826562c15988 2026-04-23 00:37:55,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:37:55,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,132 - lava_callback - ERROR - Error processing callback for node 69e6c6ce60f5826562c15988: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:38:35,081 - lava_callback - INFO - Received callback for node 69e6c6f760f5826562c159a3 INFO: 172.21.0.1:47820 - "POST /node/69e6c6f760f5826562c159a3 HTTP/1.0" 202 Accepted 2026-04-23 00:38:35,090 - lava_callback - INFO - Starting async job submit for node 69e6c6f760f5826562c159a3 2026-04-23 00:38:35,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,128 - lava_callback - DEBUG - Processing node 69e6c6f760f5826562c159a3: baseline-arm-clabbe 2026-04-23 00:38:35,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c6f760f5826562c159a3 2026-04-23 00:38:35,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:38:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,221 - lava_callback - ERROR - Error processing callback for node 69e6c6f760f5826562c159a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:39:01,301 - lava_callback - INFO - Received callback for node 69e6c71960f5826562c159b5 INFO: 172.21.0.1:42806 - "POST /node/69e6c71960f5826562c159b5 HTTP/1.0" 202 Accepted 2026-04-23 00:39:01,306 - lava_callback - INFO - Starting async job submit for node 69e6c71960f5826562c159b5 2026-04-23 00:39:01,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,321 - lava_callback - DEBUG - Processing node 69e6c71960f5826562c159b5: baseline-arm-baylibre 2026-04-23 00:39:01,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c71960f5826562c159b5 2026-04-23 00:39:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:39:01,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,366 - lava_callback - ERROR - Error processing callback for node 69e6c71960f5826562c159b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:39:35,162 - lava_callback - INFO - Received callback for node 69e6c74460f5826562c159c3 INFO: 172.21.0.1:35886 - "POST /node/69e6c74460f5826562c159c3 HTTP/1.0" 202 Accepted 2026-04-23 00:39:35,171 - lava_callback - INFO - Starting async job submit for node 69e6c74460f5826562c159c3 2026-04-23 00:39:35,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,200 - lava_callback - DEBUG - Processing node 69e6c74460f5826562c159c3: baseline-arm-clabbe 2026-04-23 00:39:35,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c74460f5826562c159c3 2026-04-23 00:39:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:39:35,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,270 - lava_callback - ERROR - Error processing callback for node 69e6c74460f5826562c159c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:40:15,127 - lava_callback - INFO - Received callback for node 69e6c76a60f5826562c159d4 INFO: 172.21.0.1:35856 - "POST /node/69e6c76a60f5826562c159d4 HTTP/1.0" 202 Accepted 2026-04-23 00:40:15,132 - lava_callback - INFO - Starting async job submit for node 69e6c76a60f5826562c159d4 2026-04-23 00:40:15,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,147 - lava_callback - DEBUG - Processing node 69e6c76a60f5826562c159d4: baseline-arm-clabbe 2026-04-23 00:40:15,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c76a60f5826562c159d4 2026-04-23 00:40:15,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:40:15,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:40:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,194 - lava_callback - ERROR - Error processing callback for node 69e6c76a60f5826562c159d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:41:35,240 - lava_callback - INFO - Received callback for node 69e6c7b760f5826562c159ef INFO: 172.21.0.1:36938 - "POST /node/69e6c7b760f5826562c159ef HTTP/1.0" 202 Accepted 2026-04-23 00:41:35,245 - lava_callback - INFO - Starting async job submit for node 69e6c7b760f5826562c159ef 2026-04-23 00:41:35,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,261 - lava_callback - DEBUG - Processing node 69e6c7b760f5826562c159ef: baseline-arm-clabbe 2026-04-23 00:41:35,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c7b760f5826562c159ef 2026-04-23 00:41:35,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:41:35,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,318 - lava_callback - ERROR - Error processing callback for node 69e6c7b760f5826562c159ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:42:15,202 - lava_callback - INFO - Received callback for node 69e6c7df60f5826562c15a05 INFO: 172.21.0.1:44988 - "POST /node/69e6c7df60f5826562c15a05 HTTP/1.0" 202 Accepted 2026-04-23 00:42:15,207 - lava_callback - INFO - Starting async job submit for node 69e6c7df60f5826562c15a05 2026-04-23 00:42:15,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,222 - lava_callback - DEBUG - Processing node 69e6c7df60f5826562c15a05: baseline-arm-clabbe 2026-04-23 00:42:15,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c7df60f5826562c15a05 2026-04-23 00:42:15,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:42:15,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,266 - lava_callback - ERROR - Error processing callback for node 69e6c7df60f5826562c15a05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:42:55,252 - lava_callback - INFO - Received callback for node 69e6c80660f5826562c15a1e INFO: 172.21.0.1:38612 - "POST /node/69e6c80660f5826562c15a1e HTTP/1.0" 202 Accepted 2026-04-23 00:42:55,257 - lava_callback - INFO - Starting async job submit for node 69e6c80660f5826562c15a1e 2026-04-23 00:42:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,272 - lava_callback - DEBUG - Processing node 69e6c80660f5826562c15a1e: baseline-arm-clabbe 2026-04-23 00:42:55,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c80660f5826562c15a1e 2026-04-23 00:42:55,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:42:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,348 - lava_callback - ERROR - Error processing callback for node 69e6c80660f5826562c15a1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:10,937 - lava_callback - INFO - Received callback for node 69e968ef8137cb226ce1f2c4 INFO: 172.21.0.1:39494 - "POST /node/69e968ef8137cb226ce1f2c4 HTTP/1.0" 202 Accepted 2026-04-23 00:44:10,943 - lava_callback - INFO - Starting async job submit for node 69e968ef8137cb226ce1f2c4 2026-04-23 00:44:10,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:10,980 - lava_callback - DEBUG - Processing node 69e968ef8137cb226ce1f2c4: baseline-arm-broonie 2026-04-23 00:44:11,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/log.txt.gz 2026-04-23 00:44:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/lava-logs.yaml 2026-04-23 00:44:11,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/lava_callback.json.gz 2026-04-23 00:44:11,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:11,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:44:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:11,836 - lava_callback - INFO - Completed processing callback for node 69e968ef8137cb226ce1f2c4 INFO: 172.21.0.1:39500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:24,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:24,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:33,674 - lava_callback - INFO - Received callback for node 69e968ee8137cb226ce1f2c1 INFO: 172.21.0.1:47942 - "POST /node/69e968ee8137cb226ce1f2c1 HTTP/1.0" 202 Accepted 2026-04-23 00:44:33,680 - lava_callback - INFO - Starting async job submit for node 69e968ee8137cb226ce1f2c1 2026-04-23 00:44:33,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:33,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:33,716 - lava_callback - DEBUG - Processing node 69e968ee8137cb226ce1f2c1: baseline-arm-broonie 2026-04-23 00:44:33,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:33,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/log.txt.gz 2026-04-23 00:44:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:34,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/lava-logs.yaml 2026-04-23 00:44:34,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:34,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/lava_callback.json.gz 2026-04-23 00:44:34,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:44:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:34,467 - lava_callback - INFO - Completed processing callback for node 69e968ee8137cb226ce1f2c1 INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:54,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:54,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:07,664 - lava_callback - INFO - Received callback for node 69e96b8c8137cb226ce1f4fa INFO: 172.21.0.1:51166 - "POST /node/69e96b8c8137cb226ce1f4fa HTTP/1.0" 202 Accepted 2026-04-23 00:45:07,670 - lava_callback - INFO - Starting async job submit for node 69e96b8c8137cb226ce1f4fa 2026-04-23 00:45:07,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,691 - lava_callback - DEBUG - Processing node 69e96b8c8137cb226ce1f4fa: baseline-arm 2026-04-23 00:45:07,696 - lava_callback - WARNING - Failed to upload log 2026-04-23 00:45:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:07,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:07,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96b8c8137cb226ce1f4fa/lava-logs.yaml 2026-04-23 00:45:07,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:07,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:07,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96b8c8137cb226ce1f4fa/lava_callback.json.gz 2026-04-23 00:45:07,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:45:07,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,952 - lava_callback - INFO - Completed processing callback for node 69e96b8c8137cb226ce1f4fa INFO: 172.21.0.1:37436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:24,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:24,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:49,287 - lava_callback - INFO - Received callback for node 69e968ec8137cb226ce1f2be INFO: 172.21.0.1:50562 - "POST /node/69e968ec8137cb226ce1f2be HTTP/1.0" 202 Accepted 2026-04-23 00:45:49,293 - lava_callback - INFO - Starting async job submit for node 69e968ec8137cb226ce1f2be 2026-04-23 00:45:49,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:49,329 - lava_callback - DEBUG - Processing node 69e968ec8137cb226ce1f2be: baseline-arm-broonie 2026-04-23 00:45:49,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:49,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:49,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/log.txt.gz 2026-04-23 00:45:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:49,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:49,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/lava-logs.yaml 2026-04-23 00:45:49,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:50,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:50,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/lava_callback.json.gz 2026-04-23 00:45:50,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:50,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:45:50,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:50,321 - lava_callback - INFO - Completed processing callback for node 69e968ec8137cb226ce1f2be 2026-04-23 00:45:54,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:54,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:46:01,760 - lava_callback - INFO - Received callback for node 69e6c8c160f5826562c15a78 INFO: 172.21.0.1:44712 - "POST /node/69e6c8c160f5826562c15a78 HTTP/1.0" 202 Accepted 2026-04-23 00:46:01,765 - lava_callback - INFO - Starting async job submit for node 69e6c8c160f5826562c15a78 2026-04-23 00:46:01,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,780 - lava_callback - DEBUG - Processing node 69e6c8c160f5826562c15a78: baseline-arm-baylibre 2026-04-23 00:46:01,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c8c160f5826562c15a78 2026-04-23 00:46:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:46:01,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,830 - lava_callback - ERROR - Error processing callback for node 69e6c8c160f5826562c15a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:46:49,873 - lava_callback - INFO - Received callback for node 69e968f08137cb226ce1f2c7 INFO: 172.21.0.1:33772 - "POST /node/69e968f08137cb226ce1f2c7 HTTP/1.0" 202 Accepted 2026-04-23 00:46:49,878 - lava_callback - INFO - Starting async job submit for node 69e968f08137cb226ce1f2c7 2026-04-23 00:46:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:49,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:49,915 - lava_callback - DEBUG - Processing node 69e968f08137cb226ce1f2c7: baseline-arm-broonie 2026-04-23 00:46:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/log.txt.gz 2026-04-23 00:46:50,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/lava-logs.yaml 2026-04-23 00:46:50,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/lava_callback.json.gz 2026-04-23 00:46:50,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:50,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:46:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:50,796 - lava_callback - INFO - Completed processing callback for node 69e968f08137cb226ce1f2c7 2026-04-23 00:46:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:54,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:11,238 - lava_callback - INFO - Received callback for node 69e967b78137cb226ce1cb20 INFO: 172.21.0.1:52820 - "POST /node/69e967b78137cb226ce1cb20 HTTP/1.0" 202 Accepted 2026-04-23 00:48:11,244 - lava_callback - INFO - Starting async job submit for node 69e967b78137cb226ce1cb20 2026-04-23 00:48:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:11,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:11,319 - lava_callback - DEBUG - Processing node 69e967b78137cb226ce1cb20: ltp-smoke 2026-04-23 00:48:11,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:11,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:11,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/log.txt.gz 2026-04-23 00:48:12,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:12,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:12,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/lava-logs.yaml 2026-04-23 00:48:12,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:12,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:12,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/lava_callback.json.gz 2026-04-23 00:48:12,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:12,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 00:48:12,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:12,958 - lava_callback - INFO - Completed processing callback for node 69e967b78137cb226ce1cb20 INFO: 172.21.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:24,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:24,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:41,895 - lava_callback - INFO - Received callback for node 69e6c95a60f5826562c15ab7 INFO: 172.21.0.1:35610 - "POST /node/69e6c95a60f5826562c15ab7 HTTP/1.0" 202 Accepted 2026-04-23 00:48:41,900 - lava_callback - INFO - Starting async job submit for node 69e6c95a60f5826562c15ab7 2026-04-23 00:48:41,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,917 - lava_callback - DEBUG - Processing node 69e6c95a60f5826562c15ab7: baseline-arm-baylibre 2026-04-23 00:48:41,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c95a60f5826562c15ab7 2026-04-23 00:48:41,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:48:41,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,973 - lava_callback - ERROR - Error processing callback for node 69e6c95a60f5826562c15ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:49:15,505 - lava_callback - INFO - Received callback for node 69e6c98460f5826562c15ad5 INFO: 172.21.0.1:49360 - "POST /node/69e6c98460f5826562c15ad5 HTTP/1.0" 202 Accepted 2026-04-23 00:49:15,511 - lava_callback - INFO - Starting async job submit for node 69e6c98460f5826562c15ad5 2026-04-23 00:49:15,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,533 - lava_callback - DEBUG - Processing node 69e6c98460f5826562c15ad5: baseline-arm-clabbe 2026-04-23 00:49:15,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c98460f5826562c15ad5 2026-04-23 00:49:15,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:49:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,583 - lava_callback - ERROR - Error processing callback for node 69e6c98460f5826562c15ad5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:49:49,223 - lava_callback - INFO - Received callback for node 69e969148137cb226ce1f34a INFO: 172.21.0.1:46564 - "POST /node/69e969148137cb226ce1f34a HTTP/1.0" 202 Accepted 2026-04-23 00:49:49,234 - lava_callback - INFO - Starting async job submit for node 69e969148137cb226ce1f34a 2026-04-23 00:49:49,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:49,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:49,320 - lava_callback - DEBUG - Processing node 69e969148137cb226ce1f34a: ltp-cap_bounds 2026-04-23 00:49:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:49,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:49,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/log.txt.gz 2026-04-23 00:49:50,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:50,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:50,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/lava-logs.yaml 2026-04-23 00:49:50,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:50,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:50,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/lava_callback.json.gz 2026-04-23 00:49:50,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:50,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:49:50,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:50,480 - lava_callback - INFO - Completed processing callback for node 69e969148137cb226ce1f34a 2026-04-23 00:49:53,035 - lava_callback - INFO - Received callback for node 69e96c7d8137cb226ce1f572 INFO: 172.21.0.1:36870 - "POST /node/69e96c7d8137cb226ce1f572 HTTP/1.0" 202 Accepted 2026-04-23 00:49:53,041 - lava_callback - INFO - Starting async job submit for node 69e96c7d8137cb226ce1f572 2026-04-23 00:49:53,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,073 - lava_callback - DEBUG - Processing node 69e96c7d8137cb226ce1f572: baseline-arm-pengutronix 2026-04-23 00:49:53,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/log.txt.gz 2026-04-23 00:49:53,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/lava-logs.yaml 2026-04-23 00:49:53,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/lava_callback.json.gz 2026-04-23 00:49:53,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:49:53,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,762 - lava_callback - INFO - Completed processing callback for node 69e96c7d8137cb226ce1f572 2026-04-23 00:49:54,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:54,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:49:55,503 - lava_callback - INFO - Received callback for node 69e6c9ab60f5826562c15ae9 INFO: 172.21.0.1:36874 - "POST /node/69e6c9ab60f5826562c15ae9 HTTP/1.0" 202 Accepted 2026-04-23 00:49:55,508 - lava_callback - INFO - Starting async job submit for node 69e6c9ab60f5826562c15ae9 2026-04-23 00:49:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,525 - lava_callback - DEBUG - Processing node 69e6c9ab60f5826562c15ae9: baseline-arm-clabbe 2026-04-23 00:49:55,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9ab60f5826562c15ae9 2026-04-23 00:49:55,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:49:55,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,588 - lava_callback - ERROR - Error processing callback for node 69e6c9ab60f5826562c15ae9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:10,496 - lava_callback - INFO - Received callback for node 69e969278137cb226ce1f383 INFO: 172.21.0.1:51790 - "POST /node/69e969278137cb226ce1f383 HTTP/1.0" 202 Accepted 2026-04-23 00:50:10,503 - lava_callback - INFO - Starting async job submit for node 69e969278137cb226ce1f383 2026-04-23 00:50:10,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:10,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:10,542 - lava_callback - DEBUG - Processing node 69e969278137cb226ce1f383: ltp-syscalls 2026-04-23 00:50:11,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:11,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:11,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/log.txt.gz 2026-04-23 00:50:11,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:11,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:11,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/lava-logs.yaml 2026-04-23 00:50:12,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:12,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:12,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/lava_callback.json.gz 2026-04-23 00:50:12,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:12,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:50:12,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:12,220 - lava_callback - INFO - Completed processing callback for node 69e969278137cb226ce1f383 INFO: 172.21.0.1:51804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:24,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:24,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:41,914 - lava_callback - INFO - Received callback for node 69e6c9cf60f5826562c15af5 INFO: 172.21.0.1:44902 - "POST /node/69e6c9cf60f5826562c15af5 HTTP/1.0" 202 Accepted 2026-04-23 00:50:41,919 - lava_callback - INFO - Starting async job submit for node 69e6c9cf60f5826562c15af5 2026-04-23 00:50:41,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:41,952 - lava_callback - DEBUG - Processing node 69e6c9cf60f5826562c15af5: baseline-arm-baylibre 2026-04-23 00:50:41,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9cf60f5826562c15af5 2026-04-23 00:50:41,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:50:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:42,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:42,006 - lava_callback - ERROR - Error processing callback for node 69e6c9cf60f5826562c15af5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:51:20,398 - lava_callback - INFO - Received callback for node 69e968df8137cb226ce1f29d INFO: 172.21.0.1:60068 - "POST /node/69e968df8137cb226ce1f29d HTTP/1.0" 202 Accepted 2026-04-23 00:51:20,405 - lava_callback - INFO - Starting async job submit for node 69e968df8137cb226ce1f29d 2026-04-23 00:51:20,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:20,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:20,500 - lava_callback - DEBUG - Processing node 69e968df8137cb226ce1f29d: baseline-arm 2026-04-23 00:51:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/log.txt.gz 2026-04-23 00:51:21,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/lava-logs.yaml 2026-04-23 00:51:21,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/lava_callback.json.gz 2026-04-23 00:51:21,991 - lava_callback - INFO - Received callback for node 69e6c9f860f5826562c15b02 2026-04-23 00:51:22,007 - lava_callback - INFO - Starting async job submit for node 69e6c9f860f5826562c15b02 INFO: 172.21.0.1:60070 - "POST /node/69e6c9f860f5826562c15b02 HTTP/1.0" 202 Accepted 2026-04-23 00:51:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 69e968df8137cb226ce1f29d. Transitting job node result: incomplete -> fail 2026-04-23 00:51:22,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:22,055 - lava_callback - DEBUG - Processing node 69e6c9f860f5826562c15b02: baseline-arm-baylibre 2026-04-23 00:51:22,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9f860f5826562c15b02 2026-04-23 00:51:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:51:22,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:51:22,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,168 - lava_callback - ERROR - Error processing callback for node 69e6c9f860f5826562c15b02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:51:22,243 - lava_callback - INFO - Completed processing callback for node 69e968df8137cb226ce1f29d 2026-04-23 00:51:24,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:24,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:51:55,644 - lava_callback - INFO - Received callback for node 69e6ca2160f5826562c15b20 INFO: 172.21.0.1:53708 - "POST /node/69e6ca2160f5826562c15b20 HTTP/1.0" 202 Accepted 2026-04-23 00:51:55,650 - lava_callback - INFO - Starting async job submit for node 69e6ca2160f5826562c15b20 2026-04-23 00:51:55,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,690 - lava_callback - DEBUG - Processing node 69e6ca2160f5826562c15b20: baseline-arm-clabbe 2026-04-23 00:51:55,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca2160f5826562c15b20 2026-04-23 00:51:55,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:51:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,742 - lava_callback - ERROR - Error processing callback for node 69e6ca2160f5826562c15b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:52:35,661 - lava_callback - INFO - Received callback for node 69e6ca4760f5826562c15b36 INFO: 172.21.0.1:43864 - "POST /node/69e6ca4760f5826562c15b36 HTTP/1.0" 202 Accepted 2026-04-23 00:52:35,666 - lava_callback - INFO - Starting async job submit for node 69e6ca4760f5826562c15b36 2026-04-23 00:52:35,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,681 - lava_callback - DEBUG - Processing node 69e6ca4760f5826562c15b36: baseline-arm-clabbe 2026-04-23 00:52:35,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca4760f5826562c15b36 2026-04-23 00:52:35,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:52:35,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,728 - lava_callback - ERROR - Error processing callback for node 69e6ca4760f5826562c15b36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:53:15,731 - lava_callback - INFO - Received callback for node 69e6ca6e60f5826562c15b4d INFO: 172.21.0.1:55470 - "POST /node/69e6ca6e60f5826562c15b4d HTTP/1.0" 202 Accepted 2026-04-23 00:53:15,736 - lava_callback - INFO - Starting async job submit for node 69e6ca6e60f5826562c15b4d 2026-04-23 00:53:15,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,751 - lava_callback - DEBUG - Processing node 69e6ca6e60f5826562c15b4d: baseline-arm-clabbe 2026-04-23 00:53:15,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca6e60f5826562c15b4d 2026-04-23 00:53:15,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:53:15,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,804 - lava_callback - ERROR - Error processing callback for node 69e6ca6e60f5826562c15b4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:36,290 - lava_callback - INFO - Received callback for node 69e969028137cb226ce1f330 INFO: 172.21.0.1:55554 - "POST /node/69e969028137cb226ce1f330 HTTP/1.0" 202 Accepted 2026-04-23 00:53:36,337 - lava_callback - INFO - Starting async job submit for node 69e969028137cb226ce1f330 2026-04-23 00:53:36,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:36,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:36,375 - lava_callback - DEBUG - Processing node 69e969028137cb226ce1f330: baseline-arm-pengutronix 2026-04-23 00:53:36,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:36,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:36,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/log.txt.gz 2026-04-23 00:53:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:36,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:36,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/lava-logs.yaml 2026-04-23 00:53:36,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:37,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:37,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/lava_callback.json.gz DEBUG: Setup failed for 69e969028137cb226ce1f330. Transitting job node result: incomplete -> fail 2026-04-23 00:53:37,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:37,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:53:37,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:37,398 - lava_callback - INFO - Completed processing callback for node 69e969028137cb226ce1f330 INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:49,301 - lava_callback - INFO - Received callback for node 69e969168137cb226ce1f34d INFO: 172.21.0.1:48254 - "POST /node/69e969168137cb226ce1f34d HTTP/1.0" 202 Accepted 2026-04-23 00:53:49,307 - lava_callback - INFO - Starting async job submit for node 69e969168137cb226ce1f34d 2026-04-23 00:53:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:49,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:49,369 - lava_callback - DEBUG - Processing node 69e969168137cb226ce1f34d: ltp-containers 2026-04-23 00:53:49,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/log.txt.gz 2026-04-23 00:53:50,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/lava-logs.yaml 2026-04-23 00:53:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/lava_callback.json.gz 2026-04-23 00:53:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:50,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:53:50,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:50,683 - lava_callback - INFO - Completed processing callback for node 69e969168137cb226ce1f34d 2026-04-23 00:53:55,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:53:55,692 - lava_callback - INFO - Received callback for node 69e6ca9460f5826562c15b58 INFO: 172.21.0.1:44138 - "POST /node/69e6ca9460f5826562c15b58 HTTP/1.0" 202 Accepted 2026-04-23 00:53:55,698 - lava_callback - INFO - Starting async job submit for node 69e6ca9460f5826562c15b58 2026-04-23 00:53:55,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,714 - lava_callback - DEBUG - Processing node 69e6ca9460f5826562c15b58: baseline-arm-clabbe 2026-04-23 00:53:55,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca9460f5826562c15b58 2026-04-23 00:53:55,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:53:55,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,760 - lava_callback - ERROR - Error processing callback for node 69e6ca9460f5826562c15b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:08,918 - lava_callback - INFO - Received callback for node 69e969178137cb226ce1f350 INFO: 172.21.0.1:46438 - "POST /node/69e969178137cb226ce1f350 HTTP/1.0" 202 Accepted 2026-04-23 00:54:08,925 - lava_callback - INFO - Starting async job submit for node 69e969178137cb226ce1f350 2026-04-23 00:54:08,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:08,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:08,969 - lava_callback - DEBUG - Processing node 69e969178137cb226ce1f350: ltp-controllers 2026-04-23 00:54:09,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:09,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:09,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/log.txt.gz 2026-04-23 00:54:09,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:09,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:09,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/lava-logs.yaml 2026-04-23 00:54:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:10,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:10,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/lava_callback.json.gz 2026-04-23 00:54:10,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:10,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:54:10,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:10,197 - lava_callback - INFO - Completed processing callback for node 69e969178137cb226ce1f350 INFO: 172.21.0.1:48240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:25,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:25,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:35,778 - lava_callback - INFO - Received callback for node 69e6cabb60f5826562c15b65 INFO: 172.21.0.1:35726 - "POST /node/69e6cabb60f5826562c15b65 HTTP/1.0" 202 Accepted 2026-04-23 00:54:35,784 - lava_callback - INFO - Starting async job submit for node 69e6cabb60f5826562c15b65 2026-04-23 00:54:35,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,799 - lava_callback - DEBUG - Processing node 69e6cabb60f5826562c15b65: baseline-arm-clabbe 2026-04-23 00:54:35,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cabb60f5826562c15b65 2026-04-23 00:54:35,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:54:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,844 - lava_callback - ERROR - Error processing callback for node 69e6cabb60f5826562c15b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:55:15,747 - lava_callback - INFO - Received callback for node 69e6cae260f5826562c15b6f INFO: 172.21.0.1:57730 - "POST /node/69e6cae260f5826562c15b6f HTTP/1.0" 202 Accepted 2026-04-23 00:55:15,753 - lava_callback - INFO - Starting async job submit for node 69e6cae260f5826562c15b6f 2026-04-23 00:55:15,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,768 - lava_callback - DEBUG - Processing node 69e6cae260f5826562c15b6f: baseline-arm-clabbe 2026-04-23 00:55:15,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cae260f5826562c15b6f 2026-04-23 00:55:15,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:55:15,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,815 - lava_callback - ERROR - Error processing callback for node 69e6cae260f5826562c15b6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:56:31,298 - lava_callback - INFO - Received callback for node 69e969198137cb226ce1f365 INFO: 172.21.0.1:54234 - "POST /node/69e969198137cb226ce1f365 HTTP/1.0" 202 Accepted 2026-04-23 00:56:31,305 - lava_callback - INFO - Starting async job submit for node 69e969198137cb226ce1f365 2026-04-23 00:56:31,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:31,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:31,343 - lava_callback - DEBUG - Processing node 69e969198137cb226ce1f365: ltp-cve 2026-04-23 00:56:31,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/log.txt.gz 2026-04-23 00:56:32,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/lava-logs.yaml 2026-04-23 00:56:32,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/lava_callback.json.gz 2026-04-23 00:56:32,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:32,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:32,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:32,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:56:32,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:33,010 - lava_callback - INFO - Completed processing callback for node 69e969198137cb226ce1f365 2026-04-23 00:56:35,851 - lava_callback - INFO - Received callback for node 69e6cb2f60f5826562c15b98 INFO: 172.21.0.1:54244 - "POST /node/69e6cb2f60f5826562c15b98 HTTP/1.0" 202 Accepted 2026-04-23 00:56:35,856 - lava_callback - INFO - Starting async job submit for node 69e6cb2f60f5826562c15b98 2026-04-23 00:56:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,871 - lava_callback - DEBUG - Processing node 69e6cb2f60f5826562c15b98: baseline-arm-clabbe 2026-04-23 00:56:35,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb2f60f5826562c15b98 2026-04-23 00:56:35,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:56:35,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,932 - lava_callback - ERROR - Error processing callback for node 69e6cb2f60f5826562c15b98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:56:55,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:55,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:57:42,278 - lava_callback - INFO - Received callback for node 69e6cb7560f5826562c15be1 INFO: 172.21.0.1:43794 - "POST /node/69e6cb7560f5826562c15be1 HTTP/1.0" 202 Accepted 2026-04-23 00:57:42,283 - lava_callback - INFO - Starting async job submit for node 69e6cb7560f5826562c15be1 2026-04-23 00:57:42,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,332 - lava_callback - DEBUG - Processing node 69e6cb7560f5826562c15be1: baseline-arm-baylibre 2026-04-23 00:57:42,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb7560f5826562c15be1 2026-04-23 00:57:42,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 00:57:42,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,433 - lava_callback - ERROR - Error processing callback for node 69e6cb7560f5826562c15be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:57:48,727 - lava_callback - INFO - Received callback for node 69e9691c8137cb226ce1f36e INFO: 172.21.0.1:43808 - "POST /node/69e9691c8137cb226ce1f36e HTTP/1.0" 202 Accepted 2026-04-23 00:57:48,733 - lava_callback - INFO - Starting async job submit for node 69e9691c8137cb226ce1f36e 2026-04-23 00:57:48,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:48,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:48,801 - lava_callback - DEBUG - Processing node 69e9691c8137cb226ce1f36e: ltp-fs_bind 2026-04-23 00:57:49,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/log.txt.gz 2026-04-23 00:57:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/lava-logs.yaml 2026-04-23 00:57:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/lava_callback.json.gz 2026-04-23 00:57:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:49,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:57:49,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:49,924 - lava_callback - INFO - Completed processing callback for node 69e9691c8137cb226ce1f36e 2026-04-23 00:57:55,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:55,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:02,303 - lava_callback - INFO - Received callback for node 69e6cb8e60f5826562c15c4c INFO: 172.21.0.1:47764 - "POST /node/69e6cb8e60f5826562c15c4c HTTP/1.0" 202 Accepted 2026-04-23 00:58:02,309 - lava_callback - INFO - Starting async job submit for node 69e6cb8e60f5826562c15c4c 2026-04-23 00:58:02,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,325 - lava_callback - DEBUG - Processing node 69e6cb8e60f5826562c15c4c: baseline-arm64-baylibre 2026-04-23 00:58:02,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb8e60f5826562c15c4c 2026-04-23 00:58:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:02,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,371 - lava_callback - ERROR - Error processing callback for node 69e6cb8e60f5826562c15c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:03,010 - lava_callback - INFO - Received callback for node 69e6cb8f60f5826562c15c4f INFO: 172.21.0.1:47768 - "POST /node/69e6cb8f60f5826562c15c4f HTTP/1.0" 202 Accepted 2026-04-23 00:58:03,016 - lava_callback - INFO - Starting async job submit for node 69e6cb8f60f5826562c15c4f 2026-04-23 00:58:03,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,033 - lava_callback - DEBUG - Processing node 69e6cb8f60f5826562c15c4f: baseline-arm64-baylibre 2026-04-23 00:58:03,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb8f60f5826562c15c4f 2026-04-23 00:58:03,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:03,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,085 - lava_callback - ERROR - Error processing callback for node 69e6cb8f60f5826562c15c4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:03,701 - lava_callback - INFO - Received callback for node 69e6cb9060f5826562c15c52 INFO: 172.21.0.1:47776 - "POST /node/69e6cb9060f5826562c15c52 HTTP/1.0" 202 Accepted 2026-04-23 00:58:03,707 - lava_callback - INFO - Starting async job submit for node 69e6cb9060f5826562c15c52 2026-04-23 00:58:03,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,725 - lava_callback - DEBUG - Processing node 69e6cb9060f5826562c15c52: baseline-arm64-baylibre 2026-04-23 00:58:03,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9060f5826562c15c52 2026-04-23 00:58:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:03,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,771 - lava_callback - ERROR - Error processing callback for node 69e6cb9060f5826562c15c52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:04,365 - lava_callback - INFO - Received callback for node 69e6cb9260f5826562c15c59 INFO: 172.21.0.1:47784 - "POST /node/69e6cb9260f5826562c15c59 HTTP/1.0" 202 Accepted 2026-04-23 00:58:04,371 - lava_callback - INFO - Starting async job submit for node 69e6cb9260f5826562c15c59 2026-04-23 00:58:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:04,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,385 - lava_callback - DEBUG - Processing node 69e6cb9260f5826562c15c59: baseline-arm64-baylibre 2026-04-23 00:58:04,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9260f5826562c15c59 2026-04-23 00:58:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:04,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,430 - lava_callback - ERROR - Error processing callback for node 69e6cb9260f5826562c15c59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:05,012 - lava_callback - INFO - Received callback for node 69e6cb9460f5826562c15c5c INFO: 172.21.0.1:47798 - "POST /node/69e6cb9460f5826562c15c5c HTTP/1.0" 202 Accepted 2026-04-23 00:58:05,018 - lava_callback - INFO - Starting async job submit for node 69e6cb9460f5826562c15c5c 2026-04-23 00:58:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,041 - lava_callback - DEBUG - Processing node 69e6cb9460f5826562c15c5c: baseline-arm64-baylibre 2026-04-23 00:58:05,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9460f5826562c15c5c 2026-04-23 00:58:05,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:05,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,089 - lava_callback - ERROR - Error processing callback for node 69e6cb9460f5826562c15c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:05,693 - lava_callback - INFO - Received callback for node 69e6cb9560f5826562c15c5f INFO: 172.21.0.1:47812 - "POST /node/69e6cb9560f5826562c15c5f HTTP/1.0" 202 Accepted 2026-04-23 00:58:05,699 - lava_callback - INFO - Starting async job submit for node 69e6cb9560f5826562c15c5f 2026-04-23 00:58:05,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,715 - lava_callback - DEBUG - Processing node 69e6cb9560f5826562c15c5f: baseline-arm64-baylibre 2026-04-23 00:58:05,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9560f5826562c15c5f 2026-04-23 00:58:05,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:05,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,793 - lava_callback - ERROR - Error processing callback for node 69e6cb9560f5826562c15c5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:09,164 - lava_callback - INFO - Received callback for node 69e9691e8137cb226ce1f371 INFO: 172.21.0.1:47820 - "POST /node/69e9691e8137cb226ce1f371 HTTP/1.0" 202 Accepted 2026-04-23 00:58:09,171 - lava_callback - INFO - Starting async job submit for node 69e9691e8137cb226ce1f371 2026-04-23 00:58:09,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:09,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:09,211 - lava_callback - DEBUG - Processing node 69e9691e8137cb226ce1f371: ltp-fsx 2026-04-23 00:58:09,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:09,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:09,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/log.txt.gz 2026-04-23 00:58:10,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:10,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:10,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/lava-logs.yaml 2026-04-23 00:58:10,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:10,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:10,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/lava_callback.json.gz 2026-04-23 00:58:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:10,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:58:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:10,515 - lava_callback - INFO - Completed processing callback for node 69e9691e8137cb226ce1f371 INFO: 172.21.0.1:60928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:25,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:35,968 - lava_callback - INFO - Received callback for node 69e6cba560f5826562c15c85 INFO: 172.21.0.1:33444 - "POST /node/69e6cba560f5826562c15c85 HTTP/1.0" 202 Accepted 2026-04-23 00:58:35,974 - lava_callback - INFO - Starting async job submit for node 69e6cba560f5826562c15c85 2026-04-23 00:58:35,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:35,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:35,990 - lava_callback - DEBUG - Processing node 69e6cba560f5826562c15c85: baseline-arm64-clabbe 2026-04-23 00:58:35,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba560f5826562c15c85 2026-04-23 00:58:35,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:36,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:36,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:36,040 - lava_callback - ERROR - Error processing callback for node 69e6cba560f5826562c15c85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:36,655 - lava_callback - INFO - Received callback for node 69e6cba760f5826562c15cad INFO: 172.21.0.1:33472 - "POST /node/69e6cba760f5826562c15cad HTTP/1.0" 202 Accepted 2026-04-23 00:58:36,661 - lava_callback - INFO - Starting async job submit for node 69e6cba760f5826562c15cad 2026-04-23 00:58:36,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,678 - lava_callback - DEBUG - Processing node 69e6cba760f5826562c15cad: baseline-arm64-clabbe 2026-04-23 00:58:36,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba760f5826562c15cad 2026-04-23 00:58:36,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:36,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,729 - lava_callback - ERROR - Error processing callback for node 69e6cba760f5826562c15cad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:37,325 - lava_callback - INFO - Received callback for node 69e6cba860f5826562c15cb0 INFO: 172.21.0.1:33484 - "POST /node/69e6cba860f5826562c15cb0 HTTP/1.0" 202 Accepted 2026-04-23 00:58:37,331 - lava_callback - INFO - Starting async job submit for node 69e6cba860f5826562c15cb0 2026-04-23 00:58:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,356 - lava_callback - DEBUG - Processing node 69e6cba860f5826562c15cb0: baseline-arm64-clabbe 2026-04-23 00:58:37,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba860f5826562c15cb0 2026-04-23 00:58:37,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:37,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,402 - lava_callback - ERROR - Error processing callback for node 69e6cba860f5826562c15cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:38,010 - lava_callback - INFO - Received callback for node 69e6cba960f5826562c15cb3 INFO: 172.21.0.1:33494 - "POST /node/69e6cba960f5826562c15cb3 HTTP/1.0" 202 Accepted 2026-04-23 00:58:38,020 - lava_callback - INFO - Starting async job submit for node 69e6cba960f5826562c15cb3 2026-04-23 00:58:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,039 - lava_callback - DEBUG - Processing node 69e6cba960f5826562c15cb3: baseline-arm64-clabbe 2026-04-23 00:58:38,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba960f5826562c15cb3 2026-04-23 00:58:38,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:38,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,092 - lava_callback - ERROR - Error processing callback for node 69e6cba960f5826562c15cb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:38,693 - lava_callback - INFO - Received callback for node 69e6cba960f5826562c15cb6 INFO: 172.21.0.1:33510 - "POST /node/69e6cba960f5826562c15cb6 HTTP/1.0" 202 Accepted 2026-04-23 00:58:38,699 - lava_callback - INFO - Starting async job submit for node 69e6cba960f5826562c15cb6 2026-04-23 00:58:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,716 - lava_callback - DEBUG - Processing node 69e6cba960f5826562c15cb6: baseline-arm64-clabbe 2026-04-23 00:58:38,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba960f5826562c15cb6 2026-04-23 00:58:38,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:38,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,770 - lava_callback - ERROR - Error processing callback for node 69e6cba960f5826562c15cb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:39,371 - lava_callback - INFO - Received callback for node 69e6cbab60f5826562c15cbc INFO: 172.21.0.1:33522 - "POST /node/69e6cbab60f5826562c15cbc HTTP/1.0" 202 Accepted 2026-04-23 00:58:39,377 - lava_callback - INFO - Starting async job submit for node 69e6cbab60f5826562c15cbc 2026-04-23 00:58:39,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,392 - lava_callback - DEBUG - Processing node 69e6cbab60f5826562c15cbc: baseline-arm64-clabbe 2026-04-23 00:58:39,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbab60f5826562c15cbc 2026-04-23 00:58:39,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,462 - lava_callback - ERROR - Error processing callback for node 69e6cbab60f5826562c15cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:40,062 - lava_callback - INFO - Received callback for node 69e6cbaa60f5826562c15cb9 INFO: 172.21.0.1:49808 - "POST /node/69e6cbaa60f5826562c15cb9 HTTP/1.0" 202 Accepted 2026-04-23 00:58:40,069 - lava_callback - INFO - Starting async job submit for node 69e6cbaa60f5826562c15cb9 2026-04-23 00:58:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,086 - lava_callback - DEBUG - Processing node 69e6cbaa60f5826562c15cb9: baseline-arm64-clabbe 2026-04-23 00:58:40,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbaa60f5826562c15cb9 2026-04-23 00:58:40,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:40,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,135 - lava_callback - ERROR - Error processing callback for node 69e6cbaa60f5826562c15cb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:42,306 - lava_callback - INFO - Received callback for node 69e6cbc060f5826562c15ceb INFO: 172.21.0.1:49824 - "POST /node/69e6cbc060f5826562c15ceb HTTP/1.0" 202 Accepted 2026-04-23 00:58:42,313 - lava_callback - INFO - Starting async job submit for node 69e6cbc060f5826562c15ceb 2026-04-23 00:58:42,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,331 - lava_callback - DEBUG - Processing node 69e6cbc060f5826562c15ceb: baseline-arm-baylibre 2026-04-23 00:58:42,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbc060f5826562c15ceb 2026-04-23 00:58:42,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 00:58:42,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,383 - lava_callback - ERROR - Error processing callback for node 69e6cbc060f5826562c15ceb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:02,426 - lava_callback - INFO - Received callback for node 69e6cc0a60f5826562c15dbf INFO: 172.21.0.1:40974 - "POST /node/69e6cc0a60f5826562c15dbf HTTP/1.0" 202 Accepted 2026-04-23 01:00:02,431 - lava_callback - INFO - Starting async job submit for node 69e6cc0a60f5826562c15dbf 2026-04-23 01:00:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,451 - lava_callback - DEBUG - Processing node 69e6cc0a60f5826562c15dbf: baseline-arm-baylibre 2026-04-23 01:00:02,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc0a60f5826562c15dbf 2026-04-23 01:00:02,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:00:02,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,515 - lava_callback - ERROR - Error processing callback for node 69e6cc0a60f5826562c15dbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:00:15,457 - lava_callback - INFO - Received callback for node 69e96f088137cb226ce1f6e9 INFO: 172.21.0.1:45838 - "POST /node/69e96f088137cb226ce1f6e9 HTTP/1.0" 202 Accepted 2026-04-23 01:00:15,467 - lava_callback - INFO - Starting async job submit for node 69e96f088137cb226ce1f6e9 2026-04-23 01:00:15,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:15,508 - lava_callback - DEBUG - Processing node 69e96f088137cb226ce1f6e9: baseline-arm 2026-04-23 01:00:15,517 - lava_callback - WARNING - Failed to upload log 2026-04-23 01:00:15,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:15,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:15,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96f088137cb226ce1f6e9/lava-logs.yaml 2026-04-23 01:00:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:15,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:15,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96f088137cb226ce1f6e9/lava_callback.json.gz 2026-04-23 01:00:15,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:15,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:00:15,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:16,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:16,066 - lava_callback - INFO - Completed processing callback for node 69e96f088137cb226ce1f6e9 INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:25,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:25,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:33,309 - lava_callback - INFO - Received callback for node 69e9691f8137cb226ce1f374 INFO: 172.21.0.1:40540 - "POST /node/69e9691f8137cb226ce1f374 HTTP/1.0" 202 Accepted 2026-04-23 01:00:33,320 - lava_callback - INFO - Starting async job submit for node 69e9691f8137cb226ce1f374 2026-04-23 01:00:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:33,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:33,404 - lava_callback - DEBUG - Processing node 69e9691f8137cb226ce1f374: ltp-input 2026-04-23 01:00:34,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:34,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:34,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/log.txt.gz 2026-04-23 01:00:34,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:34,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:34,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/lava-logs.yaml 2026-04-23 01:00:34,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:35,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:35,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/lava_callback.json.gz 2026-04-23 01:00:35,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:35,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:00:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:35,225 - lava_callback - INFO - Completed processing callback for node 69e9691f8137cb226ce1f374 INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:55,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:55,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 01:00:56,027 - lava_callback - INFO - Received callback for node 69e6cc3360f5826562c15dfb INFO: 172.21.0.1:42228 - "POST /node/69e6cc3360f5826562c15dfb HTTP/1.0" 202 Accepted 2026-04-23 01:00:56,032 - lava_callback - INFO - Starting async job submit for node 69e6cc3360f5826562c15dfb 2026-04-23 01:00:56,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,062 - lava_callback - DEBUG - Processing node 69e6cc3360f5826562c15dfb: baseline-arm-clabbe 2026-04-23 01:00:56,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc3360f5826562c15dfb 2026-04-23 01:00:56,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 01:00:56,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,145 - lava_callback - ERROR - Error processing callback for node 69e6cc3360f5826562c15dfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:01:15,958 - lava_callback - INFO - Received callback for node 69e6cc5960f5826562c15e13 INFO: 172.21.0.1:57488 - "POST /node/69e6cc5960f5826562c15e13 HTTP/1.0" 202 Accepted 2026-04-23 01:01:15,964 - lava_callback - INFO - Starting async job submit for node 69e6cc5960f5826562c15e13 2026-04-23 01:01:15,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:15,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:15,979 - lava_callback - DEBUG - Processing node 69e6cc5960f5826562c15e13: baseline-arm-clabbe 2026-04-23 01:01:15,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc5960f5826562c15e13 2026-04-23 01:01:15,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:16,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 01:01:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:16,037 - lava_callback - ERROR - Error processing callback for node 69e6cc5960f5826562c15e13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54926 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:01:50,071 - lava_callback - INFO - Received callback for node 69e969218137cb226ce1f377 INFO: 172.21.0.1:59484 - "POST /node/69e969218137cb226ce1f377 HTTP/1.0" 202 Accepted 2026-04-23 01:01:50,077 - lava_callback - INFO - Starting async job submit for node 69e969218137cb226ce1f377 2026-04-23 01:01:50,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:50,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:50,116 - lava_callback - DEBUG - Processing node 69e969218137cb226ce1f377: ltp-ipc 2026-04-23 01:01:50,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:50,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:50,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/log.txt.gz 2026-04-23 01:01:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:51,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:51,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/lava-logs.yaml 2026-04-23 01:01:51,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:51,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:51,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/lava_callback.json.gz 2026-04-23 01:01:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:51,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:01:51,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:51,441 - lava_callback - INFO - Completed processing callback for node 69e969218137cb226ce1f377 2026-04-23 01:01:55,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:02,587 - lava_callback - INFO - Received callback for node 69e6cc7a60f5826562c15e22 INFO: 172.21.0.1:50002 - "POST /node/69e6cc7a60f5826562c15e22 HTTP/1.0" 202 Accepted 2026-04-23 01:02:02,592 - lava_callback - INFO - Starting async job submit for node 69e6cc7a60f5826562c15e22 2026-04-23 01:02:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,607 - lava_callback - DEBUG - Processing node 69e6cc7a60f5826562c15e22: baseline-arm-baylibre 2026-04-23 01:02:02,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc7a60f5826562c15e22 2026-04-23 01:02:02,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:02:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,652 - lava_callback - ERROR - Error processing callback for node 69e6cc7a60f5826562c15e22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:10,724 - lava_callback - INFO - Received callback for node 69e969228137cb226ce1f37a INFO: 172.21.0.1:48488 - "POST /node/69e969228137cb226ce1f37a HTTP/1.0" 202 Accepted 2026-04-23 01:02:10,730 - lava_callback - INFO - Starting async job submit for node 69e969228137cb226ce1f37a 2026-04-23 01:02:10,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:10,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:10,769 - lava_callback - DEBUG - Processing node 69e969228137cb226ce1f37a: ltp-pty 2026-04-23 01:02:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/log.txt.gz 2026-04-23 01:02:11,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/lava-logs.yaml 2026-04-23 01:02:11,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/lava_callback.json.gz 2026-04-23 01:02:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:11,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:02:11,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:11,956 - lava_callback - INFO - Completed processing callback for node 69e969228137cb226ce1f37a INFO: 172.21.0.1:48502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:25,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:25,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:03:02,567 - lava_callback - INFO - Received callback for node 69e6ccc460f5826562c15e40 INFO: 172.21.0.1:53464 - "POST /node/69e6ccc460f5826562c15e40 HTTP/1.0" 202 Accepted 2026-04-23 01:03:02,573 - lava_callback - INFO - Starting async job submit for node 69e6ccc460f5826562c15e40 2026-04-23 01:03:02,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,617 - lava_callback - DEBUG - Processing node 69e6ccc460f5826562c15e40: baseline-arm-baylibre 2026-04-23 01:03:02,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ccc460f5826562c15e40 2026-04-23 01:03:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:03:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,688 - lava_callback - ERROR - Error processing callback for node 69e6ccc460f5826562c15e40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:22,668 - lava_callback - INFO - Received callback for node 69e6cd0b60f5826562c15e70 INFO: 172.21.0.1:41456 - "POST /node/69e6cd0b60f5826562c15e70 HTTP/1.0" 202 Accepted 2026-04-23 01:04:22,673 - lava_callback - INFO - Starting async job submit for node 69e6cd0b60f5826562c15e70 2026-04-23 01:04:22,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,689 - lava_callback - DEBUG - Processing node 69e6cd0b60f5826562c15e70: baseline-arm-baylibre 2026-04-23 01:04:22,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd0b60f5826562c15e70 2026-04-23 01:04:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:04:22,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,742 - lava_callback - ERROR - Error processing callback for node 69e6cd0b60f5826562c15e70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:32,010 - lava_callback - INFO - Received callback for node 69e969258137cb226ce1f380 INFO: 172.21.0.1:39438 - "POST /node/69e969258137cb226ce1f380 HTTP/1.0" 202 Accepted 2026-04-23 01:04:32,016 - lava_callback - INFO - Starting async job submit for node 69e969258137cb226ce1f380 2026-04-23 01:04:32,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:32,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:32,080 - lava_callback - DEBUG - Processing node 69e969258137cb226ce1f380: ltp-smoke 2026-04-23 01:04:32,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/log.txt.gz 2026-04-23 01:04:32,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/lava-logs.yaml 2026-04-23 01:04:32,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/lava_callback.json.gz 2026-04-23 01:04:33,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:33,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:04:33,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:33,075 - lava_callback - INFO - Completed processing callback for node 69e969258137cb226ce1f380 INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:49,743 - lava_callback - INFO - Received callback for node 69e969248137cb226ce1f37d INFO: 172.21.0.1:34802 - "POST /node/69e969248137cb226ce1f37d HTTP/1.0" 202 Accepted 2026-04-23 01:04:49,749 - lava_callback - INFO - Starting async job submit for node 69e969248137cb226ce1f37d 2026-04-23 01:04:49,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:49,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:49,789 - lava_callback - DEBUG - Processing node 69e969248137cb226ce1f37d: ltp-sched 2026-04-23 01:04:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/log.txt.gz 2026-04-23 01:04:50,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/lava-logs.yaml 2026-04-23 01:04:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/lava_callback.json.gz 2026-04-23 01:04:50,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:50,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:04:50,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:50,930 - lava_callback - INFO - Completed processing callback for node 69e969248137cb226ce1f37d 2026-04-23 01:04:55,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:55,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 01:04:56,146 - lava_callback - INFO - Received callback for node 69e6cd3160f5826562c15e98 INFO: 172.21.0.1:34812 - "POST /node/69e6cd3160f5826562c15e98 HTTP/1.0" 202 Accepted 2026-04-23 01:04:56,151 - lava_callback - INFO - Starting async job submit for node 69e6cd3160f5826562c15e98 2026-04-23 01:04:56,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,167 - lava_callback - DEBUG - Processing node 69e6cd3160f5826562c15e98: baseline-arm-clabbe 2026-04-23 01:04:56,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd3160f5826562c15e98 2026-04-23 01:04:56,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:04:56,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,228 - lava_callback - ERROR - Error processing callback for node 69e6cd3160f5826562c15e98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:05:49,083 - lava_callback - INFO - Received callback for node 69e969288137cb226ce1f386 INFO: 172.21.0.1:39942 - "POST /node/69e969288137cb226ce1f386 HTTP/1.0" 202 Accepted 2026-04-23 01:05:49,089 - lava_callback - INFO - Starting async job submit for node 69e969288137cb226ce1f386 2026-04-23 01:05:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:49,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:49,139 - lava_callback - DEBUG - Processing node 69e969288137cb226ce1f386: ltp-syscalls-ipc 2026-04-23 01:05:49,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:49,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:49,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/log.txt.gz 2026-04-23 01:05:49,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:49,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:49,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/lava-logs.yaml 2026-04-23 01:05:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:50,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:50,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/lava_callback.json.gz 2026-04-23 01:05:50,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:50,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:05:50,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:50,225 - lava_callback - INFO - Completed processing callback for node 69e969288137cb226ce1f386 2026-04-23 01:05:55,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:06:16,187 - lava_callback - INFO - Received callback for node 69e6cd7b60f5826562c15ed1 INFO: 172.21.0.1:45710 - "POST /node/69e6cd7b60f5826562c15ed1 HTTP/1.0" 202 Accepted 2026-04-23 01:06:16,194 - lava_callback - INFO - Starting async job submit for node 69e6cd7b60f5826562c15ed1 2026-04-23 01:06:16,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,215 - lava_callback - DEBUG - Processing node 69e6cd7b60f5826562c15ed1: baseline-arm-clabbe 2026-04-23 01:06:16,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd7b60f5826562c15ed1 2026-04-23 01:06:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:06:16,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,277 - lava_callback - ERROR - Error processing callback for node 69e6cd7b60f5826562c15ed1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:06:28,925 - lava_callback - INFO - Received callback for node 69e9692a8137cb226ce1f389 INFO: 172.21.0.1:51816 - "POST /node/69e9692a8137cb226ce1f389 HTTP/1.0" 202 Accepted 2026-04-23 01:06:28,938 - lava_callback - INFO - Starting async job submit for node 69e9692a8137cb226ce1f389 2026-04-23 01:06:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:28,988 - lava_callback - DEBUG - Processing node 69e9692a8137cb226ce1f389: ltp-timers 2026-04-23 01:06:29,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:29,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:29,616 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/log.txt.gz 2026-04-23 01:06:29,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:30,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:30,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/lava-logs.yaml 2026-04-23 01:06:30,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:30,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:30,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/lava_callback.json.gz 2026-04-23 01:06:30,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:30,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:06:30,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:30,325 - lava_callback - INFO - Completed processing callback for node 69e9692a8137cb226ce1f389 INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:06:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:55,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:07:36,247 - lava_callback - INFO - Received callback for node 69e6cdc760f5826562c15efb INFO: 172.21.0.1:43968 - "POST /node/69e6cdc760f5826562c15efb HTTP/1.0" 202 Accepted 2026-04-23 01:07:36,253 - lava_callback - INFO - Starting async job submit for node 69e6cdc760f5826562c15efb 2026-04-23 01:07:36,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,272 - lava_callback - DEBUG - Processing node 69e6cdc760f5826562c15efb: baseline-arm-clabbe 2026-04-23 01:07:36,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cdc760f5826562c15efb 2026-04-23 01:07:36,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:07:36,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,318 - lava_callback - ERROR - Error processing callback for node 69e6cdc760f5826562c15efb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:08:16,325 - lava_callback - INFO - Received callback for node 69e6cdec60f5826562c15f05 INFO: 172.21.0.1:54324 - "POST /node/69e6cdec60f5826562c15f05 HTTP/1.0" 202 Accepted 2026-04-23 01:08:16,330 - lava_callback - INFO - Starting async job submit for node 69e6cdec60f5826562c15f05 2026-04-23 01:08:16,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,345 - lava_callback - DEBUG - Processing node 69e6cdec60f5826562c15f05: baseline-arm-clabbe 2026-04-23 01:08:16,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cdec60f5826562c15f05 2026-04-23 01:08:16,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:08:16,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,411 - lava_callback - ERROR - Error processing callback for node 69e6cdec60f5826562c15f05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:08:36,288 - lava_callback - INFO - Received callback for node 69e6ce1160f5826562c15f11 INFO: 172.21.0.1:46558 - "POST /node/69e6ce1160f5826562c15f11 HTTP/1.0" 202 Accepted 2026-04-23 01:08:36,293 - lava_callback - INFO - Starting async job submit for node 69e6ce1160f5826562c15f11 2026-04-23 01:08:36,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,310 - lava_callback - DEBUG - Processing node 69e6ce1160f5826562c15f11: baseline-arm-clabbe 2026-04-23 01:08:36,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce1160f5826562c15f11 2026-04-23 01:08:36,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:08:36,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,355 - lava_callback - ERROR - Error processing callback for node 69e6ce1160f5826562c15f11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:08:52,265 - lava_callback - INFO - Received callback for node 69e9692c8137cb226ce1f390 INFO: 172.21.0.1:48690 - "POST /node/69e9692c8137cb226ce1f390 HTTP/1.0" 202 Accepted 2026-04-23 01:08:52,273 - lava_callback - INFO - Starting async job submit for node 69e9692c8137cb226ce1f390 2026-04-23 01:08:52,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:52,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:52,312 - lava_callback - DEBUG - Processing node 69e9692c8137cb226ce1f390: ltp-watchqueue 2026-04-23 01:08:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:52,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:52,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/log.txt.gz 2026-04-23 01:08:53,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:53,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:53,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/lava-logs.yaml 2026-04-23 01:08:53,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:53,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:53,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/lava_callback.json.gz 2026-04-23 01:08:53,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:53,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:08:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:53,512 - lava_callback - INFO - Completed processing callback for node 69e9692c8137cb226ce1f390 2026-04-23 01:08:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:55,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:09:16,267 - lava_callback - INFO - Received callback for node 69e6ce3760f5826562c15f1c INFO: 172.21.0.1:48230 - "POST /node/69e6ce3760f5826562c15f1c HTTP/1.0" 202 Accepted 2026-04-23 01:09:16,274 - lava_callback - INFO - Starting async job submit for node 69e6ce3760f5826562c15f1c 2026-04-23 01:09:16,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,291 - lava_callback - DEBUG - Processing node 69e6ce3760f5826562c15f1c: baseline-arm-clabbe 2026-04-23 01:09:16,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce3760f5826562c15f1c 2026-04-23 01:09:16,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:09:16,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,343 - lava_callback - ERROR - Error processing callback for node 69e6ce3760f5826562c15f1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:09:56,344 - lava_callback - INFO - Received callback for node 69e6ce5c60f5826562c15f2a INFO: 172.21.0.1:46872 - "POST /node/69e6ce5c60f5826562c15f2a HTTP/1.0" 202 Accepted 2026-04-23 01:09:56,353 - lava_callback - INFO - Starting async job submit for node 69e6ce5c60f5826562c15f2a 2026-04-23 01:09:56,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,372 - lava_callback - DEBUG - Processing node 69e6ce5c60f5826562c15f2a: baseline-arm-clabbe 2026-04-23 01:09:56,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce5c60f5826562c15f2a 2026-04-23 01:09:56,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:09:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,437 - lava_callback - ERROR - Error processing callback for node 69e6ce5c60f5826562c15f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:10:36,312 - lava_callback - INFO - Received callback for node 69e6ce8160f5826562c15f33 INFO: 172.21.0.1:59252 - "POST /node/69e6ce8160f5826562c15f33 HTTP/1.0" 202 Accepted 2026-04-23 01:10:36,318 - lava_callback - INFO - Starting async job submit for node 69e6ce8160f5826562c15f33 2026-04-23 01:10:36,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,342 - lava_callback - DEBUG - Processing node 69e6ce8160f5826562c15f33: baseline-arm-clabbe 2026-04-23 01:10:36,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce8160f5826562c15f33 2026-04-23 01:10:36,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:10:36,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,387 - lava_callback - ERROR - Error processing callback for node 69e6ce8160f5826562c15f33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:11:16,385 - lava_callback - INFO - Received callback for node 69e6cea760f5826562c15f3f INFO: 172.21.0.1:53236 - "POST /node/69e6cea760f5826562c15f3f HTTP/1.0" 202 Accepted 2026-04-23 01:11:16,390 - lava_callback - INFO - Starting async job submit for node 69e6cea760f5826562c15f3f 2026-04-23 01:11:16,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,405 - lava_callback - DEBUG - Processing node 69e6cea760f5826562c15f3f: baseline-arm-clabbe 2026-04-23 01:11:16,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cea760f5826562c15f3f 2026-04-23 01:11:16,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:11:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,450 - lava_callback - ERROR - Error processing callback for node 69e6cea760f5826562c15f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:19:20,887 - lava_callback - INFO - Received callback for node 69e96fc68137cb226ce1f75b INFO: 172.21.0.1:51700 - "POST /node/69e96fc68137cb226ce1f75b HTTP/1.0" 202 Accepted 2026-04-23 01:19:20,894 - lava_callback - INFO - Starting async job submit for node 69e96fc68137cb226ce1f75b 2026-04-23 01:19:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:20,960 - lava_callback - DEBUG - Processing node 69e96fc68137cb226ce1f75b: baseline-arm 2026-04-23 01:19:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:21,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:21,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/log.txt.gz 2026-04-23 01:19:22,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:22,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:22,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/lava-logs.yaml 2026-04-23 01:19:22,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:22,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:22,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/lava_callback.json.gz DEBUG: Setup failed for 69e96fc68137cb226ce1f75b. Transitting job node result: incomplete -> fail 2026-04-23 01:19:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:22,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:19:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:22,768 - lava_callback - INFO - Completed processing callback for node 69e96fc68137cb226ce1f75b 2026-04-23 01:19:25,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:25,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:20:53,175 - lava_callback - INFO - Received callback for node 69e96fc48137cb226ce1f757 INFO: 172.21.0.1:41920 - "POST /node/69e96fc48137cb226ce1f757 HTTP/1.0" 202 Accepted 2026-04-23 01:20:53,182 - lava_callback - INFO - Starting async job submit for node 69e96fc48137cb226ce1f757 2026-04-23 01:20:53,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:53,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:53,252 - lava_callback - DEBUG - Processing node 69e96fc48137cb226ce1f757: ltp-smoke 2026-04-23 01:20:53,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:53,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:53,833 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/log.txt.gz 2026-04-23 01:20:54,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:54,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:54,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/lava-logs.yaml 2026-04-23 01:20:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:54,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:54,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/lava_callback.json.gz 2026-04-23 01:20:54,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:54,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 01:20:54,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:54,745 - lava_callback - INFO - Completed processing callback for node 69e96fc48137cb226ce1f757 2026-04-23 01:20:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:55,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:22:57,124 - lava_callback - INFO - Received callback for node 69e96ff58137cb226ce1f76a INFO: 172.21.0.1:38504 - "POST /node/69e96ff58137cb226ce1f76a HTTP/1.0" 202 Accepted 2026-04-23 01:22:57,173 - lava_callback - INFO - Starting async job submit for node 69e96ff58137cb226ce1f76a 2026-04-23 01:22:57,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:57,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:57,211 - lava_callback - DEBUG - Processing node 69e96ff58137cb226ce1f76a: baseline-arm-pengutronix 2026-04-23 01:22:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/log.txt.gz 2026-04-23 01:22:57,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/lava-logs.yaml 2026-04-23 01:22:57,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/lava_callback.json.gz DEBUG: Setup failed for 69e96ff58137cb226ce1f76a. Transitting job node result: incomplete -> fail 2026-04-23 01:22:57,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:57,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:57,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:58,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:22:58,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:58,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:58,082 - lava_callback - INFO - Completed processing callback for node 69e96ff58137cb226ce1f76a INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:23:25,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:23:25,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:24:29,037 - lava_callback - INFO - Received callback for node 69e974c38137cb226ce1faeb INFO: 172.21.0.1:53660 - "POST /node/69e974c38137cb226ce1faeb HTTP/1.0" 202 Accepted 2026-04-23 01:24:29,043 - lava_callback - INFO - Starting async job submit for node 69e974c38137cb226ce1faeb 2026-04-23 01:24:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,067 - lava_callback - DEBUG - Processing node 69e974c38137cb226ce1faeb: baseline-arm 2026-04-23 01:24:29,072 - lava_callback - WARNING - Failed to upload log 2026-04-23 01:24:29,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:24:29,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:24:29,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e974c38137cb226ce1faeb/lava-logs.yaml 2026-04-23 01:24:29,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:24:29,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:24:29,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e974c38137cb226ce1faeb/lava_callback.json.gz 2026-04-23 01:24:29,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:24:29,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,331 - lava_callback - INFO - Completed processing callback for node 69e974c38137cb226ce1faeb INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:24:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:55,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET /node/69c39e9ebbc022e79264459a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:29:24,037 - lava_callback - INFO - Received callback for node 69e6d2df60f5826562c1615c INFO: 172.21.0.1:44596 - "POST /node/69e6d2df60f5826562c1615c HTTP/1.0" 202 Accepted 2026-04-23 01:29:24,044 - lava_callback - INFO - Starting async job submit for node 69e6d2df60f5826562c1615c 2026-04-23 01:29:24,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,062 - lava_callback - DEBUG - Processing node 69e6d2df60f5826562c1615c: baseline-arm64-baylibre 2026-04-23 01:29:24,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d2df60f5826562c1615c 2026-04-23 01:29:24,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:29:24,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,119 - lava_callback - ERROR - Error processing callback for node 69e6d2df60f5826562c1615c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:30:44,142 - lava_callback - INFO - Received callback for node 69e6d33260f5826562c16184 INFO: 172.21.0.1:46584 - "POST /node/69e6d33260f5826562c16184 HTTP/1.0" 202 Accepted 2026-04-23 01:30:44,149 - lava_callback - INFO - Starting async job submit for node 69e6d33260f5826562c16184 2026-04-23 01:30:44,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,185 - lava_callback - DEBUG - Processing node 69e6d33260f5826562c16184: baseline-arm64-baylibre 2026-04-23 01:30:44,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d33260f5826562c16184 2026-04-23 01:30:44,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:30:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,265 - lava_callback - ERROR - Error processing callback for node 69e6d33260f5826562c16184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET /node/699366aacebe99dd8e06570f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:32:04,159 - lava_callback - INFO - Received callback for node 69e6d38660f5826562c161ab INFO: 172.21.0.1:45274 - "POST /node/69e6d38660f5826562c161ab HTTP/1.0" 202 Accepted 2026-04-23 01:32:04,168 - lava_callback - INFO - Starting async job submit for node 69e6d38660f5826562c161ab 2026-04-23 01:32:04,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,184 - lava_callback - DEBUG - Processing node 69e6d38660f5826562c161ab: baseline-arm64-baylibre 2026-04-23 01:32:04,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d38660f5826562c161ab 2026-04-23 01:32:04,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:32:04,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,240 - lava_callback - ERROR - Error processing callback for node 69e6d38660f5826562c161ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET /node/699320a731166481c8de72d7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:33:24,256 - lava_callback - INFO - Received callback for node 69e6d3da60f5826562c161c9 INFO: 172.21.0.1:49160 - "POST /node/69e6d3da60f5826562c161c9 HTTP/1.0" 202 Accepted 2026-04-23 01:33:24,264 - lava_callback - INFO - Starting async job submit for node 69e6d3da60f5826562c161c9 2026-04-23 01:33:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,287 - lava_callback - DEBUG - Processing node 69e6d3da60f5826562c161c9: baseline-arm64-baylibre 2026-04-23 01:33:24,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d3da60f5826562c161c9 2026-04-23 01:33:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:33:24,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,382 - lava_callback - ERROR - Error processing callback for node 69e6d3da60f5826562c161c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:34:44,351 - lava_callback - INFO - Received callback for node 69e6d42c60f5826562c161f0 INFO: 172.21.0.1:51096 - "POST /node/69e6d42c60f5826562c161f0 HTTP/1.0" 202 Accepted 2026-04-23 01:34:44,356 - lava_callback - INFO - Starting async job submit for node 69e6d42c60f5826562c161f0 2026-04-23 01:34:44,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,377 - lava_callback - DEBUG - Processing node 69e6d42c60f5826562c161f0: baseline-arm64-baylibre 2026-04-23 01:34:44,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d42c60f5826562c161f0 2026-04-23 01:34:44,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:34:44,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,424 - lava_callback - ERROR - Error processing callback for node 69e6d42c60f5826562c161f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET /node/698a3ea722b4cc0f227b0482%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:36:04,398 - lava_callback - INFO - Received callback for node 69e6d47d60f5826562c16222 INFO: 172.21.0.1:42796 - "POST /node/69e6d47d60f5826562c16222 HTTP/1.0" 202 Accepted 2026-04-23 01:36:04,404 - lava_callback - INFO - Starting async job submit for node 69e6d47d60f5826562c16222 2026-04-23 01:36:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,419 - lava_callback - DEBUG - Processing node 69e6d47d60f5826562c16222: baseline-arm64-baylibre 2026-04-23 01:36:04,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d47d60f5826562c16222 2026-04-23 01:36:04,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:36:04,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,484 - lava_callback - ERROR - Error processing callback for node 69e6d47d60f5826562c16222: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET /node/698ef1bcf0e3ffbba67d2b7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50994 - "GET /node/69903be8985e4efca431dedb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:41:37,676 - lava_callback - INFO - Received callback for node 69e6d5cc60f5826562c162d8 INFO: 172.21.0.1:36142 - "POST /node/69e6d5cc60f5826562c162d8 HTTP/1.0" 202 Accepted 2026-04-23 01:41:37,682 - lava_callback - INFO - Starting async job submit for node 69e6d5cc60f5826562c162d8 2026-04-23 01:41:37,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,698 - lava_callback - DEBUG - Processing node 69e6d5cc60f5826562c162d8: baseline-arm64-clabbe 2026-04-23 01:41:37,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d5cc60f5826562c162d8 2026-04-23 01:41:37,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:41:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,750 - lava_callback - ERROR - Error processing callback for node 69e6d5cc60f5826562c162d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:43:17,663 - lava_callback - INFO - Received callback for node 69e6d61f60f5826562c162fb INFO: 172.21.0.1:52050 - "POST /node/69e6d61f60f5826562c162fb HTTP/1.0" 202 Accepted 2026-04-23 01:43:17,671 - lava_callback - INFO - Starting async job submit for node 69e6d61f60f5826562c162fb 2026-04-23 01:43:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,688 - lava_callback - DEBUG - Processing node 69e6d61f60f5826562c162fb: baseline-arm64-clabbe 2026-04-23 01:43:17,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d61f60f5826562c162fb 2026-04-23 01:43:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:43:17,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,736 - lava_callback - ERROR - Error processing callback for node 69e6d61f60f5826562c162fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:44:58,385 - lava_callback - INFO - Received callback for node 69e975798137cb226ce1fb27 INFO: 172.21.0.1:51672 - "POST /node/69e975798137cb226ce1fb27 HTTP/1.0" 202 Accepted 2026-04-23 01:44:58,392 - lava_callback - INFO - Starting async job submit for node 69e975798137cb226ce1fb27 2026-04-23 01:44:58,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:44:58,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:44:58,465 - lava_callback - DEBUG - Processing node 69e975798137cb226ce1fb27: baseline-arm 2026-04-23 01:44:59,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:44:59,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:44:59,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/log.txt.gz 2026-04-23 01:44:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:44:59,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:44:59,931 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/lava-logs.yaml 2026-04-23 01:44:59,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:00,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:00,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/lava_callback.json.gz DEBUG: Setup failed for 69e975798137cb226ce1fb27. Transitting job node result: incomplete -> fail 2026-04-23 01:45:00,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:45:00,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:45:00,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:45:00,388 - lava_callback - INFO - Completed processing callback for node 69e975798137cb226ce1fb27 INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:25,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:25,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:35,015 - lava_callback - INFO - Received callback for node 69e9759d8137cb226ce1fb33 INFO: 172.21.0.1:41786 - "POST /node/69e9759d8137cb226ce1fb33 HTTP/1.0" 202 Accepted 2026-04-23 01:45:35,022 - lava_callback - INFO - Starting async job submit for node 69e9759d8137cb226ce1fb33 2026-04-23 01:45:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:35,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None 2026-04-23 01:45:35,109 - lava_callback - DEBUG - Processing node 69e9759d8137cb226ce1fb33: ltp-smoke 2026-04-23 01:45:35,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:35,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:35,716 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/log.txt.gz 2026-04-23 01:45:35,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:36,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:36,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/lava-logs.yaml 2026-04-23 01:45:36,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:36,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:36,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/lava_callback.json.gz 2026-04-23 01:45:36,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None 2026-04-23 01:45:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 01:45:36,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:36,612 - lava_callback - INFO - Completed processing callback for node 69e9759d8137cb226ce1fb33 INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:55,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:46:37,892 - lava_callback - INFO - Received callback for node 69e6d6ee60f5826562c1634a INFO: 172.21.0.1:41552 - "POST /node/69e6d6ee60f5826562c1634a HTTP/1.0" 202 Accepted 2026-04-23 01:46:37,898 - lava_callback - INFO - Starting async job submit for node 69e6d6ee60f5826562c1634a 2026-04-23 01:46:37,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,912 - lava_callback - DEBUG - Processing node 69e6d6ee60f5826562c1634a: baseline-arm64-clabbe 2026-04-23 01:46:37,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d6ee60f5826562c1634a 2026-04-23 01:46:37,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:46:37,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,957 - lava_callback - ERROR - Error processing callback for node 69e6d6ee60f5826562c1634a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:47:16,722 - lava_callback - INFO - Received callback for node 69e975aa8137cb226ce1fb3a INFO: 172.21.0.1:49450 - "POST /node/69e975aa8137cb226ce1fb3a HTTP/1.0" 202 Accepted 2026-04-23 01:47:16,769 - lava_callback - INFO - Starting async job submit for node 69e975aa8137cb226ce1fb3a 2026-04-23 01:47:16,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:16,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:16,807 - lava_callback - DEBUG - Processing node 69e975aa8137cb226ce1fb3a: baseline-arm-pengutronix 2026-04-23 01:47:16,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/log.txt.gz 2026-04-23 01:47:17,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/lava-logs.yaml 2026-04-23 01:47:17,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/lava_callback.json.gz DEBUG: Setup failed for 69e975aa8137cb226ce1fb3a. Transitting job node result: incomplete -> fail 2026-04-23 01:47:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:17,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:47:17,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:17,769 - lava_callback - INFO - Completed processing callback for node 69e975aa8137cb226ce1fb3a 2026-04-23 01:47:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:47:57,945 - lava_callback - INFO - Received callback for node 69e6d74260f5826562c1636e INFO: 172.21.0.1:59728 - "POST /node/69e6d74260f5826562c1636e HTTP/1.0" 202 Accepted 2026-04-23 01:47:57,950 - lava_callback - INFO - Starting async job submit for node 69e6d74260f5826562c1636e 2026-04-23 01:47:57,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:57,966 - lava_callback - DEBUG - Processing node 69e6d74260f5826562c1636e: baseline-arm64-clabbe 2026-04-23 01:47:57,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d74260f5826562c1636e 2026-04-23 01:47:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:57,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:47:57,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:58,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:58,043 - lava_callback - ERROR - Error processing callback for node 69e6d74260f5826562c1636e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:49:17,997 - lava_callback - INFO - Received callback for node 69e6d79760f5826562c16388 INFO: 172.21.0.1:45188 - "POST /node/69e6d79760f5826562c16388 HTTP/1.0" 202 Accepted 2026-04-23 01:49:18,004 - lava_callback - INFO - Starting async job submit for node 69e6d79760f5826562c16388 2026-04-23 01:49:18,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,018 - lava_callback - DEBUG - Processing node 69e6d79760f5826562c16388: baseline-arm64-clabbe 2026-04-23 01:49:18,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d79760f5826562c16388 2026-04-23 01:49:18,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:49:18,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,063 - lava_callback - ERROR - Error processing callback for node 69e6d79760f5826562c16388: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:50:58,040 - lava_callback - INFO - Received callback for node 69e6d7ef60f5826562c163ad INFO: 172.21.0.1:46336 - "POST /node/69e6d7ef60f5826562c163ad HTTP/1.0" 202 Accepted 2026-04-23 01:50:58,046 - lava_callback - INFO - Starting async job submit for node 69e6d7ef60f5826562c163ad 2026-04-23 01:50:58,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,097 - lava_callback - DEBUG - Processing node 69e6d7ef60f5826562c163ad: baseline-arm64-clabbe 2026-04-23 01:50:58,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d7ef60f5826562c163ad 2026-04-23 01:50:58,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:50:58,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,142 - lava_callback - ERROR - Error processing callback for node 69e6d7ef60f5826562c163ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:52:18,096 - lava_callback - INFO - Received callback for node 69e6d84360f5826562c163ce INFO: 172.21.0.1:37186 - "POST /node/69e6d84360f5826562c163ce HTTP/1.0" 202 Accepted 2026-04-23 01:52:18,102 - lava_callback - INFO - Starting async job submit for node 69e6d84360f5826562c163ce 2026-04-23 01:52:18,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,117 - lava_callback - DEBUG - Processing node 69e6d84360f5826562c163ce: baseline-arm64-clabbe 2026-04-23 01:52:18,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d84360f5826562c163ce 2026-04-23 01:52:18,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:52:18,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,162 - lava_callback - ERROR - Error processing callback for node 69e6d84360f5826562c163ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:12:46,461 - lava_callback - INFO - Received callback for node 69e6dd0e60f5826562c165cc INFO: 172.21.0.1:53564 - "POST /node/69e6dd0e60f5826562c165cc HTTP/1.0" 202 Accepted 2026-04-23 02:12:46,466 - lava_callback - INFO - Starting async job submit for node 69e6dd0e60f5826562c165cc 2026-04-23 02:12:46,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,482 - lava_callback - DEBUG - Processing node 69e6dd0e60f5826562c165cc: baseline-arm-baylibre 2026-04-23 02:12:46,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd0e60f5826562c165cc 2026-04-23 02:12:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:12:46,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:12:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,535 - lava_callback - ERROR - Error processing callback for node 69e6dd0e60f5826562c165cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:13:26,501 - lava_callback - INFO - Received callback for node 69e6dd3360f5826562c165d7 INFO: 172.21.0.1:46872 - "POST /node/69e6dd3360f5826562c165d7 HTTP/1.0" 202 Accepted 2026-04-23 02:13:26,507 - lava_callback - INFO - Starting async job submit for node 69e6dd3360f5826562c165d7 2026-04-23 02:13:26,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:13:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,526 - lava_callback - DEBUG - Processing node 69e6dd3360f5826562c165d7: baseline-arm-baylibre 2026-04-23 02:13:26,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd3360f5826562c165d7 2026-04-23 02:13:26,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:13:26,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,577 - lava_callback - ERROR - Error processing callback for node 69e6dd3360f5826562c165d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:14:06,578 - lava_callback - INFO - Received callback for node 69e6dd5a60f5826562c165e3 INFO: 172.21.0.1:38822 - "POST /node/69e6dd5a60f5826562c165e3 HTTP/1.0" 202 Accepted 2026-04-23 02:14:06,583 - lava_callback - INFO - Starting async job submit for node 69e6dd5a60f5826562c165e3 2026-04-23 02:14:06,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,641 - lava_callback - DEBUG - Processing node 69e6dd5a60f5826562c165e3: baseline-arm-baylibre 2026-04-23 02:14:06,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd5a60f5826562c165e3 2026-04-23 02:14:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:14:06,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,710 - lava_callback - ERROR - Error processing callback for node 69e6dd5a60f5826562c165e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:15:59,181 - lava_callback - INFO - Received callback for node 69e6ddcb60f5826562c1660a INFO: 172.21.0.1:46624 - "POST /node/69e6ddcb60f5826562c1660a HTTP/1.0" 202 Accepted 2026-04-23 02:15:59,186 - lava_callback - INFO - Starting async job submit for node 69e6ddcb60f5826562c1660a 2026-04-23 02:15:59,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,201 - lava_callback - DEBUG - Processing node 69e6ddcb60f5826562c1660a: baseline-arm-clabbe 2026-04-23 02:15:59,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ddcb60f5826562c1660a 2026-04-23 02:15:59,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:15:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,246 - lava_callback - ERROR - Error processing callback for node 69e6ddcb60f5826562c1660a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:16:03,035 - lava_callback - INFO - Received callback for node 69e97cc58137cb226ce1ff57 INFO: 172.21.0.1:52600 - "POST /node/69e97cc58137cb226ce1ff57 HTTP/1.0" 202 Accepted 2026-04-23 02:16:03,043 - lava_callback - INFO - Starting async job submit for node 69e97cc58137cb226ce1ff57 2026-04-23 02:16:03,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:03,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:03,116 - lava_callback - DEBUG - Processing node 69e97cc58137cb226ce1ff57: baseline-arm 2026-04-23 02:16:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:03,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:03,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/log.txt.gz 2026-04-23 02:16:04,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:04,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:04,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/lava-logs.yaml 2026-04-23 02:16:04,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:04,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:04,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/lava_callback.json.gz DEBUG: Setup failed for 69e97cc58137cb226ce1ff57. Transitting job node result: incomplete -> fail 2026-04-23 02:16:04,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:04,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 02:16:04,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:04,978 - lava_callback - INFO - Completed processing callback for node 69e97cc58137cb226ce1ff57 INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:39,117 - lava_callback - INFO - Received callback for node 69e6ddf060f5826562c16618 INFO: 172.21.0.1:49012 - "POST /node/69e6ddf060f5826562c16618 HTTP/1.0" 202 Accepted 2026-04-23 02:16:39,122 - lava_callback - INFO - Starting async job submit for node 69e6ddf060f5826562c16618 2026-04-23 02:16:39,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,144 - lava_callback - DEBUG - Processing node 69e6ddf060f5826562c16618: baseline-arm-clabbe 2026-04-23 02:16:39,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ddf060f5826562c16618 2026-04-23 02:16:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:16:39,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,191 - lava_callback - ERROR - Error processing callback for node 69e6ddf060f5826562c16618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:54,364 - lava_callback - INFO - Received callback for node 69e97cea8137cb226ce1ff60 INFO: 172.21.0.1:42156 - "POST /node/69e97cea8137cb226ce1ff60 HTTP/1.0" 202 Accepted 2026-04-23 02:16:54,371 - lava_callback - INFO - Starting async job submit for node 69e97cea8137cb226ce1ff60 2026-04-23 02:16:54,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:54,448 - lava_callback - DEBUG - Processing node 69e97cea8137cb226ce1ff60: ltp-smoke 2026-04-23 02:16:54,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/log.txt.gz 2026-04-23 02:16:55,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/lava-logs.yaml 2026-04-23 02:16:55,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/lava_callback.json.gz 2026-04-23 02:16:55,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:55,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 02:16:55,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:55,989 - lava_callback - INFO - Completed processing callback for node 69e97cea8137cb226ce1ff60 INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:59,190 - lava_callback - INFO - Received callback for node 69e6de1560f5826562c16627 INFO: 172.21.0.1:42178 - "POST /node/69e6de1560f5826562c16627 HTTP/1.0" 202 Accepted 2026-04-23 02:16:59,197 - lava_callback - INFO - Starting async job submit for node 69e6de1560f5826562c16627 2026-04-23 02:16:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,211 - lava_callback - DEBUG - Processing node 69e6de1560f5826562c16627: baseline-arm-clabbe 2026-04-23 02:16:59,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de1560f5826562c16627 2026-04-23 02:16:59,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:16:59,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,265 - lava_callback - ERROR - Error processing callback for node 69e6de1560f5826562c16627: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:17:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:25,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:17:39,173 - lava_callback - INFO - Received callback for node 69e6de3b60f5826562c16632 INFO: 172.21.0.1:42078 - "POST /node/69e6de3b60f5826562c16632 HTTP/1.0" 202 Accepted 2026-04-23 02:17:39,179 - lava_callback - INFO - Starting async job submit for node 69e6de3b60f5826562c16632 2026-04-23 02:17:39,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,194 - lava_callback - DEBUG - Processing node 69e6de3b60f5826562c16632: baseline-arm-clabbe 2026-04-23 02:17:39,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de3b60f5826562c16632 2026-04-23 02:17:39,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:17:39,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,257 - lava_callback - ERROR - Error processing callback for node 69e6de3b60f5826562c16632: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:18:19,243 - lava_callback - INFO - Received callback for node 69e6de6060f5826562c16640 INFO: 172.21.0.1:35008 - "POST /node/69e6de6060f5826562c16640 HTTP/1.0" 202 Accepted 2026-04-23 02:18:19,252 - lava_callback - INFO - Starting async job submit for node 69e6de6060f5826562c16640 2026-04-23 02:18:19,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,269 - lava_callback - DEBUG - Processing node 69e6de6060f5826562c16640: baseline-arm-clabbe 2026-04-23 02:18:19,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de6060f5826562c16640 2026-04-23 02:18:19,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:18:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,315 - lava_callback - ERROR - Error processing callback for node 69e6de6060f5826562c16640: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:18:59,217 - lava_callback - INFO - Received callback for node 69e6de8660f5826562c1664d INFO: 172.21.0.1:41158 - "POST /node/69e6de8660f5826562c1664d HTTP/1.0" 202 Accepted 2026-04-23 02:18:59,222 - lava_callback - INFO - Starting async job submit for node 69e6de8660f5826562c1664d 2026-04-23 02:18:59,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,245 - lava_callback - DEBUG - Processing node 69e6de8660f5826562c1664d: baseline-arm-clabbe 2026-04-23 02:18:59,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de8660f5826562c1664d 2026-04-23 02:18:59,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:18:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,291 - lava_callback - ERROR - Error processing callback for node 69e6de8660f5826562c1664d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:19:39,256 - lava_callback - INFO - Received callback for node 69e6deac60f5826562c1665d INFO: 172.21.0.1:40888 - "POST /node/69e6deac60f5826562c1665d HTTP/1.0" 202 Accepted 2026-04-23 02:19:39,261 - lava_callback - INFO - Starting async job submit for node 69e6deac60f5826562c1665d 2026-04-23 02:19:39,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,276 - lava_callback - DEBUG - Processing node 69e6deac60f5826562c1665d: baseline-arm-clabbe 2026-04-23 02:19:39,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6deac60f5826562c1665d 2026-04-23 02:19:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:19:39,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,322 - lava_callback - ERROR - Error processing callback for node 69e6deac60f5826562c1665d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:20:18,306 - lava_callback - INFO - Received callback for node 69e97d5c8137cb226ce1ffa8 INFO: 172.21.0.1:46590 - "POST /node/69e97d5c8137cb226ce1ffa8 HTTP/1.0" 202 Accepted 2026-04-23 02:20:18,357 - lava_callback - INFO - Starting async job submit for node 69e97d5c8137cb226ce1ffa8 2026-04-23 02:20:18,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:18,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:18,395 - lava_callback - DEBUG - Processing node 69e97d5c8137cb226ce1ffa8: baseline-arm-pengutronix 2026-04-23 02:20:18,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:18,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:18,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/log.txt.gz 2026-04-23 02:20:18,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:19,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:19,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/lava-logs.yaml 2026-04-23 02:20:19,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:19,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:19,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/lava_callback.json.gz DEBUG: Setup failed for 69e97d5c8137cb226ce1ffa8. Transitting job node result: incomplete -> fail 2026-04-23 02:20:19,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:19,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 02:20:19,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:19,273 - lava_callback - INFO - Received callback for node 69e6ded260f5826562c1666f INFO: 172.21.0.1:46604 - "POST /node/69e6ded260f5826562c1666f HTTP/1.0" 202 Accepted 2026-04-23 02:20:19,292 - lava_callback - INFO - Completed processing callback for node 69e97d5c8137cb226ce1ffa8 2026-04-23 02:20:19,292 - lava_callback - INFO - Starting async job submit for node 69e6ded260f5826562c1666f 2026-04-23 02:20:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,308 - lava_callback - DEBUG - Processing node 69e6ded260f5826562c1666f: baseline-arm-clabbe 2026-04-23 02:20:19,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ded260f5826562c1666f 2026-04-23 02:20:19,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:20:19,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,357 - lava_callback - ERROR - Error processing callback for node 69e6ded260f5826562c1666f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:20:25,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:25,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:20:59,350 - lava_callback - INFO - Received callback for node 69e6def760f5826562c1667c INFO: 172.21.0.1:37012 - "POST /node/69e6def760f5826562c1667c HTTP/1.0" 202 Accepted 2026-04-23 02:20:59,356 - lava_callback - INFO - Starting async job submit for node 69e6def760f5826562c1667c 2026-04-23 02:20:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,373 - lava_callback - DEBUG - Processing node 69e6def760f5826562c1667c: baseline-arm-clabbe 2026-04-23 02:20:59,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6def760f5826562c1667c 2026-04-23 02:20:59,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:20:59,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,431 - lava_callback - ERROR - Error processing callback for node 69e6def760f5826562c1667c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:21:26,988 - lava_callback - INFO - Received callback for node 69e6df2160f5826562c1668c INFO: 172.21.0.1:49850 - "POST /node/69e6df2160f5826562c1668c HTTP/1.0" 202 Accepted 2026-04-23 02:21:26,995 - lava_callback - INFO - Starting async job submit for node 69e6df2160f5826562c1668c 2026-04-23 02:21:26,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,009 - lava_callback - DEBUG - Processing node 69e6df2160f5826562c1668c: baseline-arm64-baylibre 2026-04-23 02:21:27,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6df2160f5826562c1668c 2026-04-23 02:21:27,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:21:27,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,067 - lava_callback - ERROR - Error processing callback for node 69e6df2160f5826562c1668c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:22:47,051 - lava_callback - INFO - Received callback for node 69e6df7560f5826562c166b8 INFO: 172.21.0.1:38728 - "POST /node/69e6df7560f5826562c166b8 HTTP/1.0" 202 Accepted 2026-04-23 02:22:47,056 - lava_callback - INFO - Starting async job submit for node 69e6df7560f5826562c166b8 2026-04-23 02:22:47,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,072 - lava_callback - DEBUG - Processing node 69e6df7560f5826562c166b8: baseline-arm64-baylibre 2026-04-23 02:22:47,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6df7560f5826562c166b8 2026-04-23 02:22:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:22:47,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,118 - lava_callback - ERROR - Error processing callback for node 69e6df7560f5826562c166b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:24:27,126 - lava_callback - INFO - Received callback for node 69e6dfc960f5826562c166f8 INFO: 172.21.0.1:55852 - "POST /node/69e6dfc960f5826562c166f8 HTTP/1.0" 202 Accepted 2026-04-23 02:24:27,132 - lava_callback - INFO - Starting async job submit for node 69e6dfc960f5826562c166f8 2026-04-23 02:24:27,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,150 - lava_callback - DEBUG - Processing node 69e6dfc960f5826562c166f8: baseline-arm64-baylibre 2026-04-23 02:24:27,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dfc960f5826562c166f8 2026-04-23 02:24:27,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:24:27,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,198 - lava_callback - ERROR - Error processing callback for node 69e6dfc960f5826562c166f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:27:07,287 - lava_callback - INFO - Received callback for node 69e6e07160f5826562c16752 INFO: 172.21.0.1:60274 - "POST /node/69e6e07160f5826562c16752 HTTP/1.0" 202 Accepted 2026-04-23 02:27:07,293 - lava_callback - INFO - Starting async job submit for node 69e6e07160f5826562c16752 2026-04-23 02:27:07,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,309 - lava_callback - DEBUG - Processing node 69e6e07160f5826562c16752: baseline-arm64-baylibre 2026-04-23 02:27:07,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e07160f5826562c16752 2026-04-23 02:27:07,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:27:07,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,354 - lava_callback - ERROR - Error processing callback for node 69e6e07160f5826562c16752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:28:27,381 - lava_callback - INFO - Received callback for node 69e6e0c560f5826562c16797 INFO: 172.21.0.1:57616 - "POST /node/69e6e0c560f5826562c16797 HTTP/1.0" 202 Accepted 2026-04-23 02:28:27,386 - lava_callback - INFO - Starting async job submit for node 69e6e0c560f5826562c16797 2026-04-23 02:28:27,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,403 - lava_callback - DEBUG - Processing node 69e6e0c560f5826562c16797: baseline-arm64-baylibre 2026-04-23 02:28:27,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e0c560f5826562c16797 2026-04-23 02:28:27,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:28:27,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,461 - lava_callback - ERROR - Error processing callback for node 69e6e0c560f5826562c16797: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:29:47,458 - lava_callback - INFO - Received callback for node 69e6e11860f5826562c167c1 INFO: 172.21.0.1:46784 - "POST /node/69e6e11860f5826562c167c1 HTTP/1.0" 202 Accepted 2026-04-23 02:29:47,467 - lava_callback - INFO - Starting async job submit for node 69e6e11860f5826562c167c1 2026-04-23 02:29:47,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,486 - lava_callback - DEBUG - Processing node 69e6e11860f5826562c167c1: baseline-arm64-baylibre 2026-04-23 02:29:47,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e11860f5826562c167c1 2026-04-23 02:29:47,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:29:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,546 - lava_callback - ERROR - Error processing callback for node 69e6e11860f5826562c167c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:33:39,920 - lava_callback - INFO - Received callback for node 69e6e1ff60f5826562c1682d INFO: 172.21.0.1:39232 - "POST /node/69e6e1ff60f5826562c1682d HTTP/1.0" 202 Accepted 2026-04-23 02:33:39,926 - lava_callback - INFO - Starting async job submit for node 69e6e1ff60f5826562c1682d 2026-04-23 02:33:39,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:39,943 - lava_callback - DEBUG - Processing node 69e6e1ff60f5826562c1682d: baseline-arm64-clabbe 2026-04-23 02:33:39,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e1ff60f5826562c1682d 2026-04-23 02:33:39,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:39,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:33:39,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:40,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:40,005 - lava_callback - ERROR - Error processing callback for node 69e6e1ff60f5826562c1682d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 02:36:15,428 - lava_callback - INFO - Received callback for node 69e985938137cb226ce2022f INFO: 172.21.0.1:38614 - "POST /node/69e985938137cb226ce2022f HTTP/1.0" 202 Accepted 2026-04-23 02:36:15,436 - lava_callback - INFO - Starting async job submit for node 69e985938137cb226ce2022f 2026-04-23 02:36:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,460 - lava_callback - DEBUG - Processing node 69e985938137cb226ce2022f: baseline-nfs-arm64 2026-04-23 02:36:15,462 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:36:15,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:15,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:15,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985938137cb226ce2022f/lava-logs.yaml 2026-04-23 02:36:15,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:15,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:15,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985938137cb226ce2022f/lava_callback.json.gz 2026-04-23 02:36:15,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,789 - lava_callback - INFO - Completed processing callback for node 69e985938137cb226ce2022f INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:25,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:25,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:36:26,130 - lava_callback - INFO - Received callback for node 69e985788137cb226ce201e1 INFO: 172.21.0.1:55420 - "POST /node/69e985788137cb226ce201e1 HTTP/1.0" 202 Accepted 2026-04-23 02:36:26,140 - lava_callback - INFO - Starting async job submit for node 69e985788137cb226ce201e1 2026-04-23 02:36:26,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:26,282 - lava_callback - DEBUG - Processing node 69e985788137cb226ce201e1: baseline-arm64 2026-04-23 02:36:26,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:26,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/log.txt.gz 2026-04-23 02:36:26,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:26,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/lava-logs.yaml 2026-04-23 02:36:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:26,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/lava_callback.json.gz 2026-04-23 02:36:26,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:26,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:27,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:27,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:27,026 - lava_callback - INFO - Completed processing callback for node 69e985788137cb226ce201e1 INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:37,919 - lava_callback - INFO - Received callback for node 69e985aa8137cb226ce2027c INFO: 172.21.0.1:52620 - "POST /node/69e985aa8137cb226ce2027c HTTP/1.0" 202 Accepted 2026-04-23 02:36:37,929 - lava_callback - INFO - Starting async job submit for node 69e985aa8137cb226ce2027c 2026-04-23 02:36:37,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:37,976 - lava_callback - DEBUG - Processing node 69e985aa8137cb226ce2027c: baseline-nfs-arm64 2026-04-23 02:36:37,978 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:36:37,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:38,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:38,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985aa8137cb226ce2027c/lava-logs.yaml 2026-04-23 02:36:38,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:38,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:38,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985aa8137cb226ce2027c/lava_callback.json.gz 2026-04-23 02:36:38,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:38,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:38,283 - lava_callback - INFO - Completed processing callback for node 69e985aa8137cb226ce2027c 2026-04-23 02:36:39,991 - lava_callback - INFO - Received callback for node 69e6e2a760f5826562c1687c INFO: 172.21.0.1:55934 - "POST /node/69e6e2a760f5826562c1687c HTTP/1.0" 202 Accepted 2026-04-23 02:36:39,997 - lava_callback - INFO - Starting async job submit for node 69e6e2a760f5826562c1687c 2026-04-23 02:36:39,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,019 - lava_callback - DEBUG - Processing node 69e6e2a760f5826562c1687c: baseline-arm64-clabbe 2026-04-23 02:36:40,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e2a760f5826562c1687c 2026-04-23 02:36:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:36:40,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,070 - lava_callback - ERROR - Error processing callback for node 69e6e2a760f5826562c1687c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:55,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:55,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:01,275 - lava_callback - INFO - Received callback for node 69e9857a8137cb226ce201ed INFO: 172.21.0.1:34916 - "POST /node/69e9857a8137cb226ce201ed HTTP/1.0" 202 Accepted 2026-04-23 02:37:01,281 - lava_callback - INFO - Starting async job submit for node 69e9857a8137cb226ce201ed 2026-04-23 02:37:01,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:01,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:01,322 - lava_callback - DEBUG - Processing node 69e9857a8137cb226ce201ed: baseline-arm64 2026-04-23 02:37:01,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:01,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:01,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/log.txt.gz 2026-04-23 02:37:01,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:02,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:02,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/lava-logs.yaml 2026-04-23 02:37:02,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:02,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:02,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/lava_callback.json.gz 2026-04-23 02:37:02,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:02,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:02,330 - lava_callback - INFO - Completed processing callback for node 69e9857a8137cb226ce201ed 2026-04-23 02:37:04,481 - lava_callback - INFO - Received callback for node 69e985848137cb226ce20208 INFO: 172.21.0.1:34924 - "POST /node/69e985848137cb226ce20208 HTTP/1.0" 202 Accepted 2026-04-23 02:37:04,488 - lava_callback - INFO - Starting async job submit for node 69e985848137cb226ce20208 2026-04-23 02:37:04,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:04,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:04,520 - lava_callback - DEBUG - Processing node 69e985848137cb226ce20208: baseline-arm64 2026-04-23 02:37:04,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:04,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:04,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/log.txt.gz 2026-04-23 02:37:04,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:05,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:05,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/lava-logs.yaml 2026-04-23 02:37:05,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:05,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:05,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/lava_callback.json.gz 2026-04-23 02:37:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:05,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:05,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:05,280 - lava_callback - INFO - Completed processing callback for node 69e985848137cb226ce20208 INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:07,108 - lava_callback - INFO - Received callback for node 69e985818137cb226ce201ff INFO: 172.21.0.1:34940 - "POST /node/69e985818137cb226ce201ff HTTP/1.0" 202 Accepted 2026-04-23 02:37:07,114 - lava_callback - INFO - Starting async job submit for node 69e985818137cb226ce201ff 2026-04-23 02:37:07,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:07,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:07,152 - lava_callback - DEBUG - Processing node 69e985818137cb226ce201ff: baseline-arm64 2026-04-23 02:37:07,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:07,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:07,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/log.txt.gz 2026-04-23 02:37:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:08,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:08,150 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/lava-logs.yaml 2026-04-23 02:37:08,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:08,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:08,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/lava_callback.json.gz 2026-04-23 02:37:08,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:08,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:08,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:08,323 - lava_callback - INFO - Completed processing callback for node 69e985818137cb226ce201ff 2026-04-23 02:37:13,350 - lava_callback - INFO - Received callback for node 69e9857d8137cb226ce201f3 INFO: 172.21.0.1:35354 - "POST /node/69e9857d8137cb226ce201f3 HTTP/1.0" 202 Accepted 2026-04-23 02:37:13,356 - lava_callback - INFO - Starting async job submit for node 69e9857d8137cb226ce201f3 2026-04-23 02:37:13,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,400 - lava_callback - DEBUG - Processing node 69e9857d8137cb226ce201f3: baseline-arm64 2026-04-23 02:37:13,580 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:37:13,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:13,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:13,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857d8137cb226ce201f3/lava-logs.yaml 2026-04-23 02:37:13,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:13,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:13,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857d8137cb226ce201f3/lava_callback.json.gz 2026-04-23 02:37:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:13,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,992 - lava_callback - INFO - Completed processing callback for node 69e9857d8137cb226ce201f3 INFO: 172.21.0.1:35370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:18,917 - lava_callback - INFO - Received callback for node 69e985858137cb226ce2020b INFO: 172.21.0.1:35388 - "POST /node/69e985858137cb226ce2020b HTTP/1.0" 202 Accepted 2026-04-23 02:37:18,923 - lava_callback - INFO - Starting async job submit for node 69e985858137cb226ce2020b 2026-04-23 02:37:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:18,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:18,969 - lava_callback - DEBUG - Processing node 69e985858137cb226ce2020b: baseline-arm64 2026-04-23 02:37:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/log.txt.gz 2026-04-23 02:37:19,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/lava-logs.yaml 2026-04-23 02:37:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/lava_callback.json.gz 2026-04-23 02:37:19,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:19,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:19,768 - lava_callback - INFO - Received callback for node 69e985798137cb226ce201e4 2026-04-23 02:37:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56190 - "POST /node/69e985798137cb226ce201e4 HTTP/1.0" 202 Accepted 2026-04-23 02:37:19,776 - lava_callback - INFO - Starting async job submit for node 69e985798137cb226ce201e4 2026-04-23 02:37:19,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:19,824 - lava_callback - INFO - Completed processing callback for node 69e985858137cb226ce2020b 2026-04-23 02:37:19,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:19,830 - lava_callback - DEBUG - Processing node 69e985798137cb226ce201e4: baseline-arm64 2026-04-23 02:37:20,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/log.txt.gz 2026-04-23 02:37:20,291 - lava_callback - INFO - Received callback for node 69e985828137cb226ce20202 INFO: 172.21.0.1:56198 - "POST /node/69e985828137cb226ce20202 HTTP/1.0" 202 Accepted 2026-04-23 02:37:20,307 - lava_callback - INFO - Starting async job submit for node 69e985828137cb226ce20202 2026-04-23 02:37:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:20,403 - lava_callback - DEBUG - Processing node 69e985828137cb226ce20202: baseline-arm64 2026-04-23 02:37:20,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/lava-logs.yaml 2026-04-23 02:37:20,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/lava_callback.json.gz 2026-04-23 02:37:20,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:20,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:20,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:21,020 - lava_callback - INFO - Completed processing callback for node 69e985798137cb226ce201e4 2026-04-23 02:37:21,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/log.txt.gz 2026-04-23 02:37:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:21,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,532 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/lava-logs.yaml 2026-04-23 02:37:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:21,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/lava_callback.json.gz 2026-04-23 02:37:21,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:21,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:21,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:21,758 - lava_callback - INFO - Completed processing callback for node 69e985828137cb226ce20202 2026-04-23 02:37:25,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-23 02:37:26,228 - lava_callback - INFO - Received callback for node 69e9858a8137cb226ce20217 INFO: 172.21.0.1:56214 - "POST /node/69e9858a8137cb226ce20217 HTTP/1.0" 202 Accepted 2026-04-23 02:37:26,234 - lava_callback - INFO - Starting async job submit for node 69e9858a8137cb226ce20217 2026-04-23 02:37:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:26,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:26,270 - lava_callback - DEBUG - Processing node 69e9858a8137cb226ce20217: baseline-arm64 INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:26,570 - lava_callback - INFO - Received callback for node 69e985838137cb226ce20205 INFO: 172.21.0.1:56236 - "POST /node/69e985838137cb226ce20205 HTTP/1.0" 202 Accepted 2026-04-23 02:37:26,607 - lava_callback - INFO - Starting async job submit for node 69e985838137cb226ce20205 2026-04-23 02:37:26,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:26,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:26,669 - lava_callback - DEBUG - Processing node 69e985838137cb226ce20205: baseline-arm64 2026-04-23 02:37:26,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:26,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/log.txt.gz 2026-04-23 02:37:27,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/lava-logs.yaml 2026-04-23 02:37:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/log.txt.gz 2026-04-23 02:37:27,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/lava_callback.json.gz 2026-04-23 02:37:27,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:27,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:27,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:27,958 - lava_callback - INFO - Completed processing callback for node 69e9858a8137cb226ce20217 2026-04-23 02:37:28,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:28,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/lava-logs.yaml 2026-04-23 02:37:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:28,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:28,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/lava_callback.json.gz 2026-04-23 02:37:28,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:28,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:28,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:28,416 - lava_callback - INFO - Completed processing callback for node 69e985838137cb226ce20205 2026-04-23 02:37:29,130 - lava_callback - INFO - Received callback for node 69e985878137cb226ce20211 INFO: 172.21.0.1:56238 - "POST /node/69e985878137cb226ce20211 HTTP/1.0" 202 Accepted 2026-04-23 02:37:29,136 - lava_callback - INFO - Starting async job submit for node 69e985878137cb226ce20211 2026-04-23 02:37:29,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:29,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:29,175 - lava_callback - DEBUG - Processing node 69e985878137cb226ce20211: baseline-arm64 2026-04-23 02:37:29,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/log.txt.gz 2026-04-23 02:37:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/lava-logs.yaml 2026-04-23 02:37:29,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/lava_callback.json.gz 2026-04-23 02:37:30,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:30,073 - lava_callback - INFO - Completed processing callback for node 69e985878137cb226ce20211 2026-04-23 02:37:31,575 - lava_callback - INFO - Received callback for node 69e985808137cb226ce201fc INFO: 172.21.0.1:50984 - "POST /node/69e985808137cb226ce201fc HTTP/1.0" 202 Accepted 2026-04-23 02:37:31,581 - lava_callback - INFO - Starting async job submit for node 69e985808137cb226ce201fc 2026-04-23 02:37:31,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:31,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:31,617 - lava_callback - DEBUG - Processing node 69e985808137cb226ce201fc: baseline-arm64 2026-04-23 02:37:31,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:31,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:31,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/log.txt.gz 2026-04-23 02:37:32,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:32,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:32,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/lava-logs.yaml 2026-04-23 02:37:32,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:32,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:32,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/lava_callback.json.gz 2026-04-23 02:37:32,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:32,542 - lava_callback - INFO - Completed processing callback for node 69e985808137cb226ce201fc INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:36,855 - lava_callback - INFO - Received callback for node 69e985898137cb226ce20214 INFO: 172.21.0.1:50996 - "POST /node/69e985898137cb226ce20214 HTTP/1.0" 202 Accepted 2026-04-23 02:37:36,865 - lava_callback - INFO - Starting async job submit for node 69e985898137cb226ce20214 2026-04-23 02:37:36,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:36,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:36,908 - lava_callback - DEBUG - Processing node 69e985898137cb226ce20214: baseline-arm64 2026-04-23 02:37:37,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/log.txt.gz 2026-04-23 02:37:37,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/lava-logs.yaml 2026-04-23 02:37:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/lava_callback.json.gz 2026-04-23 02:37:37,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:37,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:37,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:37,973 - lava_callback - INFO - Completed processing callback for node 69e985898137cb226ce20214 2026-04-23 02:37:38,408 - lava_callback - INFO - Received callback for node 69e9857e8137cb226ce201f6 INFO: 172.21.0.1:51006 - "POST /node/69e9857e8137cb226ce201f6 HTTP/1.0" 202 Accepted 2026-04-23 02:37:38,415 - lava_callback - INFO - Starting async job submit for node 69e9857e8137cb226ce201f6 2026-04-23 02:37:38,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:38,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:38,479 - lava_callback - DEBUG - Processing node 69e9857e8137cb226ce201f6: baseline-arm64 2026-04-23 02:37:38,679 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:37:38,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:38,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:38,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857e8137cb226ce201f6/lava-logs.yaml 2026-04-23 02:37:38,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:39,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:39,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857e8137cb226ce201f6/lava_callback.json.gz 2026-04-23 02:37:39,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:39,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:39,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:39,157 - lava_callback - INFO - Completed processing callback for node 69e9857e8137cb226ce201f6 2026-04-23 02:37:42,561 - lava_callback - INFO - Received callback for node 69e985918137cb226ce20229 INFO: 172.21.0.1:39174 - "POST /node/69e985918137cb226ce20229 HTTP/1.0" 202 Accepted 2026-04-23 02:37:42,569 - lava_callback - INFO - Starting async job submit for node 69e985918137cb226ce20229 2026-04-23 02:37:42,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:42,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:42,616 - lava_callback - DEBUG - Processing node 69e985918137cb226ce20229: baseline-nfs-arm64 2026-04-23 02:37:43,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:43,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:43,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/log.txt.gz 2026-04-23 02:37:43,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:43,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:43,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/lava-logs.yaml 2026-04-23 02:37:43,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:44,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:44,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/lava_callback.json.gz 2026-04-23 02:37:44,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:44,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:44,110 - lava_callback - INFO - Completed processing callback for node 69e985918137cb226ce20229 2026-04-23 02:37:45,206 - lava_callback - INFO - Received callback for node 69e985988137cb226ce20257 INFO: 172.21.0.1:39190 - "POST /node/69e985988137cb226ce20257 HTTP/1.0" 202 Accepted 2026-04-23 02:37:45,213 - lava_callback - INFO - Starting async job submit for node 69e985988137cb226ce20257 2026-04-23 02:37:45,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:45,249 - lava_callback - DEBUG - Processing node 69e985988137cb226ce20257: baseline-nfs-arm64 2026-04-23 02:37:45,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:45,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:45,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/log.txt.gz 2026-04-23 02:37:46,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:46,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:46,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/lava-logs.yaml 2026-04-23 02:37:46,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:46,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:46,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/lava_callback.json.gz 2026-04-23 02:37:46,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:46,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:46,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:46,410 - lava_callback - INFO - Completed processing callback for node 69e985988137cb226ce20257 INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:48,266 - lava_callback - INFO - Received callback for node 69e985bd8137cb226ce202d4 INFO: 172.21.0.1:39198 - "POST /node/69e985bd8137cb226ce202d4 HTTP/1.0" 202 Accepted 2026-04-23 02:37:48,272 - lava_callback - INFO - Starting async job submit for node 69e985bd8137cb226ce202d4 2026-04-23 02:37:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:48,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:48,342 - lava_callback - DEBUG - Processing node 69e985bd8137cb226ce202d4: baseline-arm64-pengutronix 2026-04-23 02:37:48,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:48,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:48,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/log.txt.gz 2026-04-23 02:37:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:48,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:48,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/lava-logs.yaml 2026-04-23 02:37:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:49,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:49,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/lava_callback.json.gz 2026-04-23 02:37:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:49,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:49,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:49,089 - lava_callback - INFO - Completed processing callback for node 69e985bd8137cb226ce202d4 2026-04-23 02:37:52,602 - lava_callback - INFO - Received callback for node 69e9858e8137cb226ce20223 INFO: 172.21.0.1:52476 - "POST /node/69e9858e8137cb226ce20223 HTTP/1.0" 202 Accepted 2026-04-23 02:37:52,611 - lava_callback - INFO - Starting async job submit for node 69e9858e8137cb226ce20223 2026-04-23 02:37:52,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:52,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:52,675 - lava_callback - DEBUG - Processing node 69e9858e8137cb226ce20223: baseline-nfs-arm64 2026-04-23 02:37:53,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/log.txt.gz 2026-04-23 02:37:53,345 - lava_callback - INFO - Received callback for node 69e985c18137cb226ce202dd INFO: 172.21.0.1:52482 - "POST /node/69e985c18137cb226ce202dd HTTP/1.0" 202 Accepted 2026-04-23 02:37:53,364 - lava_callback - INFO - Starting async job submit for node 69e985c18137cb226ce202dd 2026-04-23 02:37:53,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:53,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:53,478 - lava_callback - DEBUG - Processing node 69e985c18137cb226ce202dd: baseline-arm64-foundriesio 2026-04-23 02:37:53,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/lava-logs.yaml 2026-04-23 02:37:53,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/log.txt.gz 2026-04-23 02:37:53,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/lava_callback.json.gz 2026-04-23 02:37:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:54,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:54,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:54,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:54,101 - lava_callback - INFO - Completed processing callback for node 69e9858e8137cb226ce20223 2026-04-23 02:37:54,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:54,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/lava-logs.yaml 2026-04-23 02:37:54,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:54,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:54,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/lava_callback.json.gz 2026-04-23 02:37:54,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:54,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:54,389 - lava_callback - INFO - Completed processing callback for node 69e985c18137cb226ce202dd 2026-04-23 02:37:54,613 - lava_callback - INFO - Received callback for node 69e985928137cb226ce2022c INFO: 172.21.0.1:52486 - "POST /node/69e985928137cb226ce2022c HTTP/1.0" 202 Accepted 2026-04-23 02:37:54,624 - lava_callback - INFO - Starting async job submit for node 69e985928137cb226ce2022c 2026-04-23 02:37:54,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:54,664 - lava_callback - DEBUG - Processing node 69e985928137cb226ce2022c: baseline-nfs-arm64 2026-04-23 02:37:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:55,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:55,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/log.txt.gz 2026-04-23 02:37:55,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:55,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-23 02:37:55,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:55,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:55,964 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/lava-logs.yaml 2026-04-23 02:37:55,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,111 - lava_callback - INFO - Received callback for node 69e985be8137cb226ce202d7 INFO: 172.21.0.1:52490 - "POST /node/69e985be8137cb226ce202d7 HTTP/1.0" 202 Accepted 2026-04-23 02:37:56,118 - lava_callback - INFO - Starting async job submit for node 69e985be8137cb226ce202d7 2026-04-23 02:37:56,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/lava_callback.json.gz 2026-04-23 02:37:56,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:56,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:56,210 - lava_callback - DEBUG - Processing node 69e985be8137cb226ce202d7: baseline-arm64-pengutronix 2026-04-23 02:37:56,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:56,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:56,448 - lava_callback - INFO - Completed processing callback for node 69e985928137cb226ce2022c 2026-04-23 02:37:56,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:56,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/log.txt.gz 2026-04-23 02:37:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/lava-logs.yaml 2026-04-23 02:37:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/lava_callback.json.gz 2026-04-23 02:37:56,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:57,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:57,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:57,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:57,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:57,036 - lava_callback - INFO - Completed processing callback for node 69e985be8137cb226ce202d7 INFO: 172.21.0.1:52500 - "GET /node/6950776279dde14bd05ee896%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:07,297 - lava_callback - INFO - Received callback for node 69e985bb8137cb226ce202d1 INFO: 172.21.0.1:60332 - "POST /node/69e985bb8137cb226ce202d1 HTTP/1.0" 202 Accepted 2026-04-23 02:38:07,307 - lava_callback - INFO - Starting async job submit for node 69e985bb8137cb226ce202d1 2026-04-23 02:38:07,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:07,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:07,369 - lava_callback - DEBUG - Processing node 69e985bb8137cb226ce202d1: baseline-arm64-kontron 2026-04-23 02:38:07,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:07,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:07,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/log.txt.gz 2026-04-23 02:38:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:08,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:08,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/lava-logs.yaml 2026-04-23 02:38:08,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:08,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:08,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/lava_callback.json.gz 2026-04-23 02:38:08,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:08,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:08,306 - lava_callback - INFO - Completed processing callback for node 69e985bb8137cb226ce202d1 2026-04-23 02:38:08,794 - lava_callback - INFO - Received callback for node 69e9859a8137cb226ce2025a INFO: 172.21.0.1:60344 - "POST /node/69e9859a8137cb226ce2025a HTTP/1.0" 202 Accepted 2026-04-23 02:38:08,805 - lava_callback - INFO - Starting async job submit for node 69e9859a8137cb226ce2025a 2026-04-23 02:38:08,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:08,852 - lava_callback - DEBUG - Processing node 69e9859a8137cb226ce2025a: baseline-nfs-arm64 2026-04-23 02:38:09,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/log.txt.gz 2026-04-23 02:38:09,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/lava-logs.yaml 2026-04-23 02:38:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/lava_callback.json.gz 2026-04-23 02:38:09,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:09,985 - lava_callback - INFO - Completed processing callback for node 69e9859a8137cb226ce2025a 2026-04-23 02:38:12,151 - lava_callback - INFO - Received callback for node 69e985c08137cb226ce202da INFO: 172.21.0.1:43430 - "POST /node/69e985c08137cb226ce202da HTTP/1.0" 202 Accepted 2026-04-23 02:38:12,157 - lava_callback - INFO - Starting async job submit for node 69e985c08137cb226ce202da 2026-04-23 02:38:12,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:12,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:12,201 - lava_callback - DEBUG - Processing node 69e985c08137cb226ce202da: baseline-arm64-pengutronix 2026-04-23 02:38:12,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/log.txt.gz 2026-04-23 02:38:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/lava-logs.yaml 2026-04-23 02:38:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/lava_callback.json.gz 2026-04-23 02:38:12,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:13,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:13,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:13,086 - lava_callback - INFO - Completed processing callback for node 69e985c08137cb226ce202da 2026-04-23 02:38:13,288 - lava_callback - INFO - Received callback for node 69e985948137cb226ce20232 INFO: 172.21.0.1:43444 - "POST /node/69e985948137cb226ce20232 HTTP/1.0" 202 Accepted 2026-04-23 02:38:13,295 - lava_callback - INFO - Starting async job submit for node 69e985948137cb226ce20232 2026-04-23 02:38:13,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:13,365 - lava_callback - DEBUG - Processing node 69e985948137cb226ce20232: baseline-nfs-arm64 2026-04-23 02:38:13,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:13,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:13,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/log.txt.gz 2026-04-23 02:38:13,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:14,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:14,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/lava-logs.yaml 2026-04-23 02:38:14,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:14,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:14,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/lava_callback.json.gz 2026-04-23 02:38:14,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:14,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:14,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:14,752 - lava_callback - INFO - Completed processing callback for node 69e985948137cb226ce20232 INFO: 172.21.0.1:43460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:17,397 - lava_callback - INFO - Received callback for node 69e985af8137cb226ce2028c INFO: 172.21.0.1:43474 - "POST /node/69e985af8137cb226ce2028c HTTP/1.0" 202 Accepted 2026-04-23 02:38:17,404 - lava_callback - INFO - Starting async job submit for node 69e985af8137cb226ce2028c 2026-04-23 02:38:17,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:17,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:17,439 - lava_callback - DEBUG - Processing node 69e985af8137cb226ce2028c: baseline-arm64-broonie 2026-04-23 02:38:17,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:17,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:17,886 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/log.txt.gz 2026-04-23 02:38:18,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:18,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:18,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/lava-logs.yaml 2026-04-23 02:38:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:18,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:18,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/lava_callback.json.gz 2026-04-23 02:38:18,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:18,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:18,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:18,547 - lava_callback - INFO - Completed processing callback for node 69e985af8137cb226ce2028c 2026-04-23 02:38:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:25,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:32,509 - lava_callback - INFO - Received callback for node 69e985b18137cb226ce2028f INFO: 172.21.0.1:52114 - "POST /node/69e985b18137cb226ce2028f HTTP/1.0" 202 Accepted 2026-04-23 02:38:32,516 - lava_callback - INFO - Starting async job submit for node 69e985b18137cb226ce2028f 2026-04-23 02:38:32,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:32,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:32,558 - lava_callback - DEBUG - Processing node 69e985b18137cb226ce2028f: baseline-arm64-broonie 2026-04-23 02:38:32,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:32,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:32,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/log.txt.gz 2026-04-23 02:38:33,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:33,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:33,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/lava-logs.yaml 2026-04-23 02:38:33,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:33,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:33,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/lava_callback.json.gz 2026-04-23 02:38:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:33,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:33,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:33,467 - lava_callback - INFO - Completed processing callback for node 69e985b18137cb226ce2028f INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:52,297 - lava_callback - INFO - Received callback for node 69e985ab8137cb226ce20283 INFO: 172.21.0.1:40874 - "POST /node/69e985ab8137cb226ce20283 HTTP/1.0" 202 Accepted 2026-04-23 02:38:52,303 - lava_callback - INFO - Starting async job submit for node 69e985ab8137cb226ce20283 2026-04-23 02:38:52,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:52,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:52,341 - lava_callback - DEBUG - Processing node 69e985ab8137cb226ce20283: baseline-arm64-broonie 2026-04-23 02:38:52,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:52,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:52,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/log.txt.gz 2026-04-23 02:38:52,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:53,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:53,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/lava-logs.yaml 2026-04-23 02:38:53,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:53,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:53,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/lava_callback.json.gz 2026-04-23 02:38:53,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:53,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:53,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:53,282 - lava_callback - INFO - Completed processing callback for node 69e985ab8137cb226ce20283 2026-04-23 02:38:53,789 - lava_callback - INFO - Received callback for node 69e985ac8137cb226ce20286 INFO: 172.21.0.1:40884 - "POST /node/69e985ac8137cb226ce20286 HTTP/1.0" 202 Accepted 2026-04-23 02:38:53,795 - lava_callback - INFO - Starting async job submit for node 69e985ac8137cb226ce20286 2026-04-23 02:38:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:53,840 - lava_callback - DEBUG - Processing node 69e985ac8137cb226ce20286: baseline-arm64-broonie 2026-04-23 02:38:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/log.txt.gz 2026-04-23 02:38:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/lava-logs.yaml 2026-04-23 02:38:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/lava_callback.json.gz 2026-04-23 02:38:54,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:54,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:54,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:54,827 - lava_callback - INFO - Completed processing callback for node 69e985ac8137cb226ce20286 2026-04-23 02:38:55,249 - lava_callback - INFO - Received callback for node 69e985b38137cb226ce20292 INFO: 172.21.0.1:40898 - "POST /node/69e985b38137cb226ce20292 HTTP/1.0" 202 Accepted 2026-04-23 02:38:55,255 - lava_callback - INFO - Starting async job submit for node 69e985b38137cb226ce20292 2026-04-23 02:38:55,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:55,294 - lava_callback - DEBUG - Processing node 69e985b38137cb226ce20292: baseline-arm64-broonie 2026-04-23 02:38:55,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:55,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:55,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:38:55,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:55,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/log.txt.gz 2026-04-23 02:38:55,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:56,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:56,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/lava-logs.yaml 2026-04-23 02:38:56,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:56,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:56,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/lava_callback.json.gz 2026-04-23 02:38:56,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:56,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:56,226 - lava_callback - INFO - Completed processing callback for node 69e985b38137cb226ce20292 INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:20,143 - lava_callback - INFO - Received callback for node 69e6e34c60f5826562c168dc INFO: 172.21.0.1:56340 - "POST /node/69e6e34c60f5826562c168dc HTTP/1.0" 202 Accepted 2026-04-23 02:39:20,148 - lava_callback - INFO - Starting async job submit for node 69e6e34c60f5826562c168dc 2026-04-23 02:39:20,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,175 - lava_callback - DEBUG - Processing node 69e6e34c60f5826562c168dc: baseline-arm64-clabbe 2026-04-23 02:39:20,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e34c60f5826562c168dc 2026-04-23 02:39:20,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:39:20,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,222 - lava_callback - ERROR - Error processing callback for node 69e6e34c60f5826562c168dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:39:25,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:25,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:38,178 - lava_callback - INFO - Received callback for node 69e986528137cb226ce20420 INFO: 172.21.0.1:49166 - "POST /node/69e986528137cb226ce20420 HTTP/1.0" 202 Accepted 2026-04-23 02:39:38,184 - lava_callback - INFO - Starting async job submit for node 69e986528137cb226ce20420 2026-04-23 02:39:38,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,202 - lava_callback - DEBUG - Processing node 69e986528137cb226ce20420: baseline-nfs-arm64 2026-04-23 02:39:38,204 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:39:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:38,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:38,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e986528137cb226ce20420/lava-logs.yaml 2026-04-23 02:39:38,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:38,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:38,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e986528137cb226ce20420/lava_callback.json.gz 2026-04-23 02:39:38,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:39:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,676 - lava_callback - INFO - Completed processing callback for node 69e986528137cb226ce20420 2026-04-23 02:39:39,262 - lava_callback - INFO - Received callback for node 69e9857f8137cb226ce201f9 INFO: 172.21.0.1:49180 - "POST /node/69e9857f8137cb226ce201f9 HTTP/1.0" 202 Accepted 2026-04-23 02:39:39,268 - lava_callback - INFO - Starting async job submit for node 69e9857f8137cb226ce201f9 2026-04-23 02:39:39,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:39,300 - lava_callback - DEBUG - Processing node 69e9857f8137cb226ce201f9: baseline-arm64 2026-04-23 02:39:39,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:39,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:39,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/log.txt.gz 2026-04-23 02:39:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:40,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:40,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/lava-logs.yaml 2026-04-23 02:39:40,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:40,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:40,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/lava_callback.json.gz 2026-04-23 02:39:40,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:39:40,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:40,408 - lava_callback - INFO - Completed processing callback for node 69e9857f8137cb226ce201f9 INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:55,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:00,081 - lava_callback - INFO - Received callback for node 69e9858d8137cb226ce20220 INFO: 172.21.0.1:56834 - "POST /node/69e9858d8137cb226ce20220 HTTP/1.0" 202 Accepted 2026-04-23 02:40:00,089 - lava_callback - INFO - Starting async job submit for node 69e9858d8137cb226ce20220 2026-04-23 02:40:00,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:00,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:00,133 - lava_callback - DEBUG - Processing node 69e9858d8137cb226ce20220: baseline-nfs-arm64 2026-04-23 02:40:00,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:00,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:00,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/log.txt.gz 2026-04-23 02:40:01,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:01,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:01,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/lava-logs.yaml 2026-04-23 02:40:01,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:01,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:01,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/lava_callback.json.gz 2026-04-23 02:40:01,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:01,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:40:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:01,355 - lava_callback - INFO - Completed processing callback for node 69e9858d8137cb226ce20220 INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:25,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:35,563 - lava_callback - INFO - Received callback for node 69e985ad8137cb226ce20289 INFO: 172.21.0.1:33598 - "POST /node/69e985ad8137cb226ce20289 HTTP/1.0" 202 Accepted 2026-04-23 02:40:35,569 - lava_callback - INFO - Starting async job submit for node 69e985ad8137cb226ce20289 2026-04-23 02:40:35,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:35,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:35,606 - lava_callback - DEBUG - Processing node 69e985ad8137cb226ce20289: baseline-arm64-broonie 2026-04-23 02:40:35,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/log.txt.gz 2026-04-23 02:40:36,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/lava-logs.yaml 2026-04-23 02:40:36,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/lava_callback.json.gz 2026-04-23 02:40:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:36,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:40:36,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:36,513 - lava_callback - INFO - Completed processing callback for node 69e985ad8137cb226ce20289 INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:40,161 - lava_callback - INFO - Received callback for node 69e6e3a160f5826562c168fd INFO: 172.21.0.1:44966 - "POST /node/69e6e3a160f5826562c168fd HTTP/1.0" 202 Accepted 2026-04-23 02:40:40,166 - lava_callback - INFO - Starting async job submit for node 69e6e3a160f5826562c168fd 2026-04-23 02:40:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,181 - lava_callback - DEBUG - Processing node 69e6e3a160f5826562c168fd: baseline-arm64-clabbe 2026-04-23 02:40:40,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e3a160f5826562c168fd 2026-04-23 02:40:40,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:40:40,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,236 - lava_callback - ERROR - Error processing callback for node 69e6e3a160f5826562c168fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:55,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:55,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:36,656 - lava_callback - INFO - Received callback for node 69e9869e8137cb226ce2045d INFO: 172.21.0.1:46176 - "POST /node/69e9869e8137cb226ce2045d HTTP/1.0" 202 Accepted 2026-04-23 02:41:36,662 - lava_callback - INFO - Starting async job submit for node 69e9869e8137cb226ce2045d 2026-04-23 02:41:36,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:36,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:36,708 - lava_callback - DEBUG - Processing node 69e9869e8137cb226ce2045d: baseline-arm64 2026-04-23 02:41:36,841 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:41:36,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:37,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:37,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9869e8137cb226ce2045d/lava-logs.yaml 2026-04-23 02:41:37,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:37,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:37,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9869e8137cb226ce2045d/lava_callback.json.gz 2026-04-23 02:41:37,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:37,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:41:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:37,486 - lava_callback - INFO - Completed processing callback for node 69e9869e8137cb226ce2045d INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:55,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:55,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:41:56,320 - lava_callback - INFO - Received callback for node 69e985c18137cb226ce202e0 INFO: 172.21.0.1:51826 - "POST /node/69e985c18137cb226ce202e0 HTTP/1.0" 202 Accepted 2026-04-23 02:41:56,331 - lava_callback - INFO - Starting async job submit for node 69e985c18137cb226ce202e0 2026-04-23 02:41:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:56,395 - lava_callback - DEBUG - Processing node 69e985c18137cb226ce202e0: baseline-arm64-foundriesio INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:57,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:57,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:57,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/log.txt.gz 2026-04-23 02:41:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:58,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:58,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/lava-logs.yaml 2026-04-23 02:41:58,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:58,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:58,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/lava_callback.json.gz DEBUG: 69e985c18137cb226ce202e0 Transitting job node result: pass -> incomplete 2026-04-23 02:41:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:58,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:58,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:41:59,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:59,023 - lava_callback - INFO - Completed processing callback for node 69e985c18137cb226ce202e0 INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:42:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:42:25,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:25,463 - lava_callback - INFO - Received callback for node 69e986f48137cb226ce20498 INFO: 172.21.0.1:50944 - "POST /node/69e986f48137cb226ce20498 HTTP/1.0" 202 Accepted 2026-04-23 02:43:25,469 - lava_callback - INFO - Starting async job submit for node 69e986f48137cb226ce20498 2026-04-23 02:43:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:25,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:25,505 - lava_callback - DEBUG - Processing node 69e986f48137cb226ce20498: baseline-arm64 2026-04-23 02:43:26,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:26,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/log.txt.gz 2026-04-23 02:43:26,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:26,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/lava-logs.yaml 2026-04-23 02:43:26,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:26,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/lava_callback.json.gz 2026-04-23 02:43:26,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:26,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:43:26,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:26,974 - lava_callback - INFO - Completed processing callback for node 69e986f48137cb226ce20498 INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:40,277 - lava_callback - INFO - Received callback for node 69e6e44760f5826562c1696d INFO: 172.21.0.1:42652 - "POST /node/69e6e44760f5826562c1696d HTTP/1.0" 202 Accepted 2026-04-23 02:43:40,282 - lava_callback - INFO - Starting async job submit for node 69e6e44760f5826562c1696d 2026-04-23 02:43:40,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,297 - lava_callback - DEBUG - Processing node 69e6e44760f5826562c1696d: baseline-arm64-clabbe 2026-04-23 02:43:40,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e44760f5826562c1696d 2026-04-23 02:43:40,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:43:40,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,349 - lava_callback - ERROR - Error processing callback for node 69e6e44760f5826562c1696d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:53,405 - lava_callback - INFO - Received callback for node 69e9858b8137cb226ce2021a INFO: 172.21.0.1:44730 - "POST /node/69e9858b8137cb226ce2021a HTTP/1.0" 202 Accepted 2026-04-23 02:43:53,414 - lava_callback - INFO - Starting async job submit for node 69e9858b8137cb226ce2021a 2026-04-23 02:43:53,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:53,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:53,467 - lava_callback - DEBUG - Processing node 69e9858b8137cb226ce2021a: baseline-arm64 2026-04-23 02:43:53,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:53,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:53,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/log.txt.gz 2026-04-23 02:43:54,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:54,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:54,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/lava-logs.yaml 2026-04-23 02:43:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:54,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:54,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/lava_callback.json.gz DEBUG: Setup failed for 69e9858b8137cb226ce2021a. Transitting job node result: incomplete -> fail 2026-04-23 02:43:54,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:54,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:43:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:55,048 - lava_callback - INFO - Completed processing callback for node 69e9858b8137cb226ce2021a 2026-04-23 02:43:55,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:55,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:44:21,498 - lava_callback - INFO - Received callback for node 69e987468137cb226ce204cc INFO: 172.21.0.1:36396 - "POST /node/69e987468137cb226ce204cc HTTP/1.0" 202 Accepted 2026-04-23 02:44:21,504 - lava_callback - INFO - Starting async job submit for node 69e987468137cb226ce204cc 2026-04-23 02:44:21,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:21,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:21,547 - lava_callback - DEBUG - Processing node 69e987468137cb226ce204cc: baseline-arm64 2026-04-23 02:44:21,685 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:44:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:44:22,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:44:22,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e987468137cb226ce204cc/lava-logs.yaml 2026-04-23 02:44:22,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:44:22,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:44:22,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e987468137cb226ce204cc/lava_callback.json.gz 2026-04-23 02:44:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:44:22,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:22,365 - lava_callback - INFO - Completed processing callback for node 69e987468137cb226ce204cc 2026-04-23 02:44:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:25,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:45:00,354 - lava_callback - INFO - Received callback for node 69e6e49960f5826562c16986 INFO: 172.21.0.1:50654 - "POST /node/69e6e49960f5826562c16986 HTTP/1.0" 202 Accepted 2026-04-23 02:45:00,359 - lava_callback - INFO - Starting async job submit for node 69e6e49960f5826562c16986 2026-04-23 02:45:00,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,376 - lava_callback - DEBUG - Processing node 69e6e49960f5826562c16986: baseline-arm64-clabbe 2026-04-23 02:45:00,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e49960f5826562c16986 2026-04-23 02:45:00,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:45:00,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,437 - lava_callback - ERROR - Error processing callback for node 69e6e49960f5826562c16986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:04,399 - lava_callback - INFO - Received callback for node 69e985868137cb226ce2020e INFO: 172.21.0.1:53842 - "POST /node/69e985868137cb226ce2020e HTTP/1.0" 202 Accepted 2026-04-23 02:47:04,406 - lava_callback - INFO - Starting async job submit for node 69e985868137cb226ce2020e 2026-04-23 02:47:04,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:04,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:04,443 - lava_callback - DEBUG - Processing node 69e985868137cb226ce2020e: baseline-arm64 2026-04-23 02:47:05,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/log.txt.gz 2026-04-23 02:47:05,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/lava-logs.yaml 2026-04-23 02:47:05,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/lava_callback.json.gz 2026-04-23 02:47:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:47:05,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:05,808 - lava_callback - INFO - Completed processing callback for node 69e985868137cb226ce2020e INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:25,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:25,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:35,840 - lava_callback - INFO - Received callback for node 69e9883a8137cb226ce20560 INFO: 172.21.0.1:44726 - "POST /node/69e9883a8137cb226ce20560 HTTP/1.0" 202 Accepted 2026-04-23 02:47:35,847 - lava_callback - INFO - Starting async job submit for node 69e9883a8137cb226ce20560 2026-04-23 02:47:35,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:35,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:35,864 - lava_callback - DEBUG - Processing node 69e9883a8137cb226ce20560: baseline-nfs-arm64 2026-04-23 02:47:35,866 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:47:35,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:35,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:35,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9883a8137cb226ce20560/lava-logs.yaml 2026-04-23 02:47:35,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:36,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:36,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9883a8137cb226ce20560/lava_callback.json.gz 2026-04-23 02:47:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:47:36,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:36,122 - lava_callback - INFO - Completed processing callback for node 69e9883a8137cb226ce20560 INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:55,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:55,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:36,165 - lava_callback - INFO - Received callback for node 69e988fc8137cb226ce205d7 INFO: 172.21.0.1:37082 - "POST /node/69e988fc8137cb226ce205d7 HTTP/1.0" 202 Accepted 2026-04-23 02:51:36,172 - lava_callback - INFO - Starting async job submit for node 69e988fc8137cb226ce205d7 2026-04-23 02:51:36,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:36,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:36,215 - lava_callback - DEBUG - Processing node 69e988fc8137cb226ce205d7: baseline-arm64 2026-04-23 02:51:36,353 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:51:36,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:37,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:51:37,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988fc8137cb226ce205d7/lava-logs.yaml 2026-04-23 02:51:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:51:37,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:51:37,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988fc8137cb226ce205d7/lava_callback.json.gz 2026-04-23 02:51:37,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:37,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:51:37,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:37,512 - lava_callback - INFO - Completed processing callback for node 69e988fc8137cb226ce205d7 INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:55,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:55,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:52:31,982 - lava_callback - INFO - Received callback for node 69e988868137cb226ce20598 INFO: 172.21.0.1:43058 - "POST /node/69e988868137cb226ce20598 HTTP/1.0" 202 Accepted 2026-04-23 02:52:31,988 - lava_callback - INFO - Starting async job submit for node 69e988868137cb226ce20598 2026-04-23 02:52:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:32,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:32,021 - lava_callback - DEBUG - Processing node 69e988868137cb226ce20598: baseline-arm64 2026-04-23 02:52:32,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:32,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:32,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/log.txt.gz 2026-04-23 02:52:32,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:32,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:32,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/lava-logs.yaml 2026-04-23 02:52:32,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:33,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:33,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/lava_callback.json.gz 2026-04-23 02:52:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:33,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:52:33,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:33,153 - lava_callback - INFO - Completed processing callback for node 69e988868137cb226ce20598 INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:52:55,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:55,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:28,049 - lava_callback - INFO - Received callback for node 69e989a38137cb226ce2063f INFO: 172.21.0.1:52282 - "POST /node/69e989a38137cb226ce2063f HTTP/1.0" 202 Accepted 2026-04-23 02:55:28,056 - lava_callback - INFO - Starting async job submit for node 69e989a38137cb226ce2063f 2026-04-23 02:55:28,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:28,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:28,094 - lava_callback - DEBUG - Processing node 69e989a38137cb226ce2063f: baseline-arm64 2026-04-23 02:55:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:28,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:28,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/log.txt.gz 2026-04-23 02:55:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:29,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:29,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/lava-logs.yaml 2026-04-23 02:55:29,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:29,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:29,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/lava_callback.json.gz 2026-04-23 02:55:29,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:29,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:55:29,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:29,630 - lava_callback - INFO - Completed processing callback for node 69e989a38137cb226ce2063f INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:37,739 - lava_callback - INFO - Received callback for node 69e989678137cb226ce20610 INFO: 172.21.0.1:43998 - "POST /node/69e989678137cb226ce20610 HTTP/1.0" 202 Accepted 2026-04-23 02:55:37,751 - lava_callback - INFO - Starting async job submit for node 69e989678137cb226ce20610 2026-04-23 02:55:37,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:37,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:37,825 - lava_callback - DEBUG - Processing node 69e989678137cb226ce20610: baseline-arm64-foundriesio 2026-04-23 02:55:38,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:38,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:38,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/log.txt.gz 2026-04-23 02:55:39,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:39,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:39,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/lava-logs.yaml 2026-04-23 02:55:39,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:39,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:39,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/lava_callback.json.gz DEBUG: 69e989678137cb226ce20610 Transitting job node result: pass -> incomplete 2026-04-23 02:55:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:39,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:55:39,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:39,733 - lava_callback - INFO - Completed processing callback for node 69e989678137cb226ce20610 INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:55,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:55,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:56:19,477 - lava_callback - INFO - Received callback for node 69e985978137cb226ce20238 INFO: 172.21.0.1:39826 - "POST /node/69e985978137cb226ce20238 HTTP/1.0" 202 Accepted 2026-04-23 02:56:19,485 - lava_callback - INFO - Starting async job submit for node 69e985978137cb226ce20238 2026-04-23 02:56:19,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:19,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:19,550 - lava_callback - DEBUG - Processing node 69e985978137cb226ce20238: baseline-nfs-arm64 2026-04-23 02:56:20,482 - lava_callback - INFO - Received callback for node 69e985908137cb226ce20226 INFO: 172.21.0.1:49880 - "POST /node/69e985908137cb226ce20226 HTTP/1.0" 202 Accepted 2026-04-23 02:56:20,491 - lava_callback - INFO - Starting async job submit for node 69e985908137cb226ce20226 2026-04-23 02:56:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:20,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:20,569 - lava_callback - DEBUG - Processing node 69e985908137cb226ce20226: baseline-nfs-arm64 2026-04-23 02:56:20,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:20,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/log.txt.gz 2026-04-23 02:56:22,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/lava-logs.yaml 2026-04-23 02:56:22,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/log.txt.gz 2026-04-23 02:56:22,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/lava_callback.json.gz DEBUG: Setup failed for 69e985978137cb226ce20238. Transitting job node result: incomplete -> fail 2026-04-23 02:56:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:23,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:56:23,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:23,364 - lava_callback - INFO - Completed processing callback for node 69e985978137cb226ce20238 2026-04-23 02:56:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:23,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:23,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/lava-logs.yaml 2026-04-23 02:56:23,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:23,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:23,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/lava_callback.json.gz DEBUG: Setup failed for 69e985908137cb226ce20226. Transitting job node result: incomplete -> fail 2026-04-23 02:56:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:24,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:56:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:24,261 - lava_callback - INFO - Completed processing callback for node 69e985908137cb226ce20226 2026-04-23 02:56:25,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET /node/693fc96b575bc060ce149c3e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET /node/693e5f56407f32424eb650bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:57:32,819 - lava_callback - INFO - Received callback for node 69e98a458137cb226ce206a8 INFO: 172.21.0.1:54538 - "POST /node/69e98a458137cb226ce206a8 HTTP/1.0" 202 Accepted 2026-04-23 02:57:32,826 - lava_callback - INFO - Starting async job submit for node 69e98a458137cb226ce206a8 2026-04-23 02:57:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:32,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:32,871 - lava_callback - DEBUG - Processing node 69e98a458137cb226ce206a8: baseline-arm64 2026-04-23 02:57:33,115 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:57:33,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:57:33,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:57:33,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98a458137cb226ce206a8/lava-logs.yaml 2026-04-23 02:57:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:57:33,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:57:33,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98a458137cb226ce206a8/lava_callback.json.gz 2026-04-23 02:57:33,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:57:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:33,826 - lava_callback - INFO - Completed processing callback for node 69e98a458137cb226ce206a8 INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:57:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:55,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET /node/698ec99fdb401c547d5730c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:59:51,153 - lava_callback - INFO - Received callback for node 69e985968137cb226ce20235 INFO: 172.21.0.1:37854 - "POST /node/69e985968137cb226ce20235 HTTP/1.0" 202 Accepted 2026-04-23 02:59:51,161 - lava_callback - INFO - Starting async job submit for node 69e985968137cb226ce20235 2026-04-23 02:59:51,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:51,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:51,226 - lava_callback - DEBUG - Processing node 69e985968137cb226ce20235: baseline-nfs-arm64 2026-04-23 02:59:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:51,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:51,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/log.txt.gz 2026-04-23 02:59:52,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:52,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:52,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/lava-logs.yaml 2026-04-23 02:59:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:52,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:52,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/lava_callback.json.gz 2026-04-23 02:59:52,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:52,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:59:52,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:52,814 - lava_callback - INFO - Completed processing callback for node 69e985968137cb226ce20235 2026-04-23 02:59:55,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:56,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:02:09,683 - lava_callback - INFO - Received callback for node 69e989f78137cb226ce2066e INFO: 172.21.0.1:55130 - "POST /node/69e989f78137cb226ce2066e HTTP/1.0" 202 Accepted 2026-04-23 03:02:09,690 - lava_callback - INFO - Starting async job submit for node 69e989f78137cb226ce2066e 2026-04-23 03:02:09,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:09,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:09,744 - lava_callback - DEBUG - Processing node 69e989f78137cb226ce2066e: baseline-arm64 2026-04-23 03:02:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:10,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:10,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/log.txt.gz 2026-04-23 03:02:10,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:10,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:10,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/lava-logs.yaml 2026-04-23 03:02:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:11,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:11,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/lava_callback.json.gz DEBUG: Setup failed for 69e989f78137cb226ce2066e. Transitting job node result: incomplete -> fail 2026-04-23 03:02:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:11,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:02:11,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:11,265 - lava_callback - INFO - Completed processing callback for node 69e989f78137cb226ce2066e INFO: 172.21.0.1:60044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:02:26,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:26,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:05:29,518 - lava_callback - INFO - Received callback for node 69e6e96c60f5826562c16c17 INFO: 172.21.0.1:40646 - "POST /node/69e6e96c60f5826562c16c17 HTTP/1.0" 202 Accepted 2026-04-23 03:05:29,523 - lava_callback - INFO - Starting async job submit for node 69e6e96c60f5826562c16c17 2026-04-23 03:05:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,543 - lava_callback - DEBUG - Processing node 69e6e96c60f5826562c16c17: baseline-arm64-baylibre 2026-04-23 03:05:29,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e96c60f5826562c16c17 2026-04-23 03:05:29,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:05:29,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,589 - lava_callback - ERROR - Error processing callback for node 69e6e96c60f5826562c16c17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:06:49,504 - lava_callback - INFO - Received callback for node 69e6e9bf60f5826562c16c3b INFO: 172.21.0.1:44082 - "POST /node/69e6e9bf60f5826562c16c3b HTTP/1.0" 202 Accepted 2026-04-23 03:06:49,512 - lava_callback - INFO - Starting async job submit for node 69e6e9bf60f5826562c16c3b 2026-04-23 03:06:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,529 - lava_callback - DEBUG - Processing node 69e6e9bf60f5826562c16c3b: baseline-arm64-baylibre 2026-04-23 03:06:49,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e9bf60f5826562c16c3b 2026-04-23 03:06:49,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:06:49,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,589 - lava_callback - ERROR - Error processing callback for node 69e6e9bf60f5826562c16c3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:07:11,024 - lava_callback - INFO - Received callback for node 69e98ca88137cb226ce207df INFO: 172.21.0.1:33780 - "POST /node/69e98ca88137cb226ce207df HTTP/1.0" 202 Accepted 2026-04-23 03:07:11,031 - lava_callback - INFO - Starting async job submit for node 69e98ca88137cb226ce207df 2026-04-23 03:07:11,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,120 - lava_callback - DEBUG - Processing node 69e98ca88137cb226ce207df: baseline-arm64 2026-04-23 03:07:11,255 - lava_callback - WARNING - Failed to upload log 2026-04-23 03:07:11,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:07:11,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:07:11,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98ca88137cb226ce207df/lava-logs.yaml 2026-04-23 03:07:11,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:07:11,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:07:11,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98ca88137cb226ce207df/lava_callback.json.gz 2026-04-23 03:07:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:07:11,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,919 - lava_callback - INFO - Completed processing callback for node 69e98ca88137cb226ce207df INFO: 172.21.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:07:26,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:26,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:08:09,554 - lava_callback - INFO - Received callback for node 69e6ea1360f5826562c16c69 INFO: 172.21.0.1:49024 - "POST /node/69e6ea1360f5826562c16c69 HTTP/1.0" 202 Accepted 2026-04-23 03:08:09,559 - lava_callback - INFO - Starting async job submit for node 69e6ea1360f5826562c16c69 2026-04-23 03:08:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,584 - lava_callback - DEBUG - Processing node 69e6ea1360f5826562c16c69: baseline-arm64-baylibre 2026-04-23 03:08:09,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ea1360f5826562c16c69 2026-04-23 03:08:09,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:08:09,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,628 - lava_callback - ERROR - Error processing callback for node 69e6ea1360f5826562c16c69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:09:49,692 - lava_callback - INFO - Received callback for node 69e6ea6860f5826562c16c95 INFO: 172.21.0.1:49416 - "POST /node/69e6ea6860f5826562c16c95 HTTP/1.0" 202 Accepted 2026-04-23 03:09:49,698 - lava_callback - INFO - Starting async job submit for node 69e6ea6860f5826562c16c95 2026-04-23 03:09:49,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,718 - lava_callback - DEBUG - Processing node 69e6ea6860f5826562c16c95: baseline-arm64-baylibre 2026-04-23 03:09:49,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ea6860f5826562c16c95 2026-04-23 03:09:49,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:09:49,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,761 - lava_callback - ERROR - Error processing callback for node 69e6ea6860f5826562c16c95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:11:09,751 - lava_callback - INFO - Received callback for node 69e6eabc60f5826562c16cca INFO: 172.21.0.1:51184 - "POST /node/69e6eabc60f5826562c16cca HTTP/1.0" 202 Accepted 2026-04-23 03:11:09,756 - lava_callback - INFO - Starting async job submit for node 69e6eabc60f5826562c16cca 2026-04-23 03:11:09,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,771 - lava_callback - DEBUG - Processing node 69e6eabc60f5826562c16cca: baseline-arm64-baylibre 2026-04-23 03:11:09,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6eabc60f5826562c16cca 2026-04-23 03:11:09,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:11:09,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,815 - lava_callback - ERROR - Error processing callback for node 69e6eabc60f5826562c16cca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:11:46,711 - lava_callback - INFO - Received callback for node 69e98d218137cb226ce20820 INFO: 172.21.0.1:46724 - "POST /node/69e98d218137cb226ce20820 HTTP/1.0" 202 Accepted 2026-04-23 03:11:46,717 - lava_callback - INFO - Starting async job submit for node 69e98d218137cb226ce20820 2026-04-23 03:11:46,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:46,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:46,750 - lava_callback - DEBUG - Processing node 69e98d218137cb226ce20820: baseline-arm64 2026-04-23 03:11:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/log.txt.gz 2026-04-23 03:11:47,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/lava-logs.yaml 2026-04-23 03:11:47,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/lava_callback.json.gz 2026-04-23 03:11:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:48,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:11:48,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:48,133 - lava_callback - INFO - Completed processing callback for node 69e98d218137cb226ce20820 2026-04-23 03:11:56,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:56,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:10,664 - lava_callback - INFO - Received callback for node 69e98dc68137cb226ce2087a INFO: 172.21.0.1:49132 - "POST /node/69e98dc68137cb226ce2087a HTTP/1.0" 202 Accepted 2026-04-23 03:12:10,671 - lava_callback - INFO - Starting async job submit for node 69e98dc68137cb226ce2087a 2026-04-23 03:12:10,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:10,711 - lava_callback - DEBUG - Processing node 69e98dc68137cb226ce2087a: baseline-arm64 2026-04-23 03:12:11,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/log.txt.gz 2026-04-23 03:12:11,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/lava-logs.yaml 2026-04-23 03:12:11,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/lava_callback.json.gz 2026-04-23 03:12:12,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:12,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:12:12,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:12,051 - lava_callback - INFO - Completed processing callback for node 69e98dc68137cb226ce2087a INFO: 172.21.0.1:49138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:20,078 - lava_callback - INFO - Received callback for node 69e9857b8137cb226ce201f0 INFO: 172.21.0.1:33730 - "POST /node/69e9857b8137cb226ce201f0 HTTP/1.0" 202 Accepted 2026-04-23 03:12:20,084 - lava_callback - INFO - Starting async job submit for node 69e9857b8137cb226ce201f0 2026-04-23 03:12:20,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:20,131 - lava_callback - DEBUG - Processing node 69e9857b8137cb226ce201f0: baseline-arm64 2026-04-23 03:12:20,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/log.txt.gz 2026-04-23 03:12:20,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/lava-logs.yaml 2026-04-23 03:12:20,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/lava_callback.json.gz 2026-04-23 03:12:20,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:20,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:12:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:21,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:21,059 - lava_callback - INFO - Completed processing callback for node 69e9857b8137cb226ce201f0 2026-04-23 03:12:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:26,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:29,763 - lava_callback - INFO - Received callback for node 69e6eb1060f5826562c16cef INFO: 172.21.0.1:41798 - "POST /node/69e6eb1060f5826562c16cef HTTP/1.0" 202 Accepted 2026-04-23 03:12:29,769 - lava_callback - INFO - Starting async job submit for node 69e6eb1060f5826562c16cef 2026-04-23 03:12:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,784 - lava_callback - DEBUG - Processing node 69e6eb1060f5826562c16cef: baseline-arm64-baylibre 2026-04-23 03:12:29,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6eb1060f5826562c16cef 2026-04-23 03:12:29,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:12:29,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,836 - lava_callback - ERROR - Error processing callback for node 69e6eb1060f5826562c16cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:13:57,318 - lava_callback - INFO - Received callback for node 69e9858c8137cb226ce2021d INFO: 172.21.0.1:50822 - "POST /node/69e9858c8137cb226ce2021d HTTP/1.0" 202 Accepted 2026-04-23 03:13:57,325 - lava_callback - INFO - Starting async job submit for node 69e9858c8137cb226ce2021d 2026-04-23 03:13:57,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:57,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:57,375 - lava_callback - DEBUG - Processing node 69e9858c8137cb226ce2021d: baseline-nfs-arm64 2026-04-23 03:13:57,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:57,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:57,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/log.txt.gz 2026-04-23 03:13:58,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:58,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:58,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/lava-logs.yaml 2026-04-23 03:13:58,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:58,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:58,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/lava_callback.json.gz 2026-04-23 03:13:58,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:13:58,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:58,628 - lava_callback - INFO - Completed processing callback for node 69e9858c8137cb226ce2021d INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:14:26,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:14:26,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:16:03,564 - lava_callback - INFO - Received callback for node 69e98e328137cb226ce208cd INFO: 172.21.0.1:50856 - "POST /node/69e98e328137cb226ce208cd HTTP/1.0" 202 Accepted 2026-04-23 03:16:03,572 - lava_callback - INFO - Starting async job submit for node 69e98e328137cb226ce208cd 2026-04-23 03:16:03,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:03,624 - lava_callback - DEBUG - Processing node 69e98e328137cb226ce208cd: baseline-arm64-foundriesio 2026-04-23 03:16:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:04,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:04,781 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/log.txt.gz 2026-04-23 03:16:05,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:05,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:05,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/lava-logs.yaml 2026-04-23 03:16:05,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:05,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:05,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/lava_callback.json.gz DEBUG: 69e98e328137cb226ce208cd Transitting job node result: pass -> incomplete 2026-04-23 03:16:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:16:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:05,748 - lava_callback - INFO - Completed processing callback for node 69e98e328137cb226ce208cd INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:16:26,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:18:01,815 - lava_callback - INFO - Received callback for node 69e6ec6560f5826562c16d99 INFO: 172.21.0.1:38100 - "POST /node/69e6ec6560f5826562c16d99 HTTP/1.0" 202 Accepted 2026-04-23 03:18:01,821 - lava_callback - INFO - Starting async job submit for node 69e6ec6560f5826562c16d99 2026-04-23 03:18:01,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,835 - lava_callback - DEBUG - Processing node 69e6ec6560f5826562c16d99: baseline-arm64-clabbe 2026-04-23 03:18:01,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ec6560f5826562c16d99 2026-04-23 03:18:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:18:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,884 - lava_callback - ERROR - Error processing callback for node 69e6ec6560f5826562c16d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:19:41,925 - lava_callback - INFO - Received callback for node 69e6ecb860f5826562c16dc8 INFO: 172.21.0.1:58534 - "POST /node/69e6ecb860f5826562c16dc8 HTTP/1.0" 202 Accepted 2026-04-23 03:19:41,935 - lava_callback - INFO - Starting async job submit for node 69e6ecb860f5826562c16dc8 2026-04-23 03:19:41,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:41,950 - lava_callback - DEBUG - Processing node 69e6ecb860f5826562c16dc8: baseline-arm64-clabbe 2026-04-23 03:19:41,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ecb860f5826562c16dc8 2026-04-23 03:19:41,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:41,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:19:41,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:42,005 - lava_callback - ERROR - Error processing callback for node 69e6ecb860f5826562c16dc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:20:34,726 - lava_callback - INFO - Received callback for node 69e98fbe8137cb226ce209a6 INFO: 172.21.0.1:39136 - "POST /node/69e98fbe8137cb226ce209a6 HTTP/1.0" 202 Accepted 2026-04-23 03:20:34,732 - lava_callback - INFO - Starting async job submit for node 69e98fbe8137cb226ce209a6 2026-04-23 03:20:34,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:34,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:34,776 - lava_callback - DEBUG - Processing node 69e98fbe8137cb226ce209a6: baseline-arm64 2026-04-23 03:20:34,976 - lava_callback - WARNING - Failed to upload log 2026-04-23 03:20:35,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:20:35,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:20:35,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98fbe8137cb226ce209a6/lava-logs.yaml 2026-04-23 03:20:35,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:20:35,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:20:35,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98fbe8137cb226ce209a6/lava_callback.json.gz 2026-04-23 03:20:35,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:35,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:20:35,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:35,547 - lava_callback - INFO - Completed processing callback for node 69e98fbe8137cb226ce209a6 INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:20:56,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:56,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:21:01,953 - lava_callback - INFO - Received callback for node 69e6ed0f60f5826562c16ddf INFO: 172.21.0.1:55464 - "POST /node/69e6ed0f60f5826562c16ddf HTTP/1.0" 202 Accepted 2026-04-23 03:21:01,958 - lava_callback - INFO - Starting async job submit for node 69e6ed0f60f5826562c16ddf 2026-04-23 03:21:01,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:01,973 - lava_callback - DEBUG - Processing node 69e6ed0f60f5826562c16ddf: baseline-arm64-clabbe 2026-04-23 03:21:01,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ed0f60f5826562c16ddf 2026-04-23 03:21:01,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:01,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:21:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:02,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:02,019 - lava_callback - ERROR - Error processing callback for node 69e6ed0f60f5826562c16ddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:22:22,035 - lava_callback - INFO - Received callback for node 69e6ed6360f5826562c16e07 INFO: 172.21.0.1:58214 - "POST /node/69e6ed6360f5826562c16e07 HTTP/1.0" 202 Accepted 2026-04-23 03:22:22,040 - lava_callback - INFO - Starting async job submit for node 69e6ed6360f5826562c16e07 2026-04-23 03:22:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,059 - lava_callback - DEBUG - Processing node 69e6ed6360f5826562c16e07: baseline-arm64-clabbe 2026-04-23 03:22:22,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ed6360f5826562c16e07 2026-04-23 03:22:22,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:22:22,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,105 - lava_callback - ERROR - Error processing callback for node 69e6ed6360f5826562c16e07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:23:42,126 - lava_callback - INFO - Received callback for node 69e6edb760f5826562c16e2b INFO: 172.21.0.1:37872 - "POST /node/69e6edb760f5826562c16e2b HTTP/1.0" 202 Accepted 2026-04-23 03:23:42,132 - lava_callback - INFO - Starting async job submit for node 69e6edb760f5826562c16e2b 2026-04-23 03:23:42,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,146 - lava_callback - DEBUG - Processing node 69e6edb760f5826562c16e2b: baseline-arm64-clabbe 2026-04-23 03:23:42,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6edb760f5826562c16e2b 2026-04-23 03:23:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:23:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,195 - lava_callback - ERROR - Error processing callback for node 69e6edb760f5826562c16e2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:25:22,141 - lava_callback - INFO - Received callback for node 69e6ee0c60f5826562c16e50 INFO: 172.21.0.1:33676 - "POST /node/69e6ee0c60f5826562c16e50 HTTP/1.0" 202 Accepted 2026-04-23 03:25:22,146 - lava_callback - INFO - Starting async job submit for node 69e6ee0c60f5826562c16e50 2026-04-23 03:25:22,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,167 - lava_callback - DEBUG - Processing node 69e6ee0c60f5826562c16e50: baseline-arm64-clabbe 2026-04-23 03:25:22,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ee0c60f5826562c16e50 2026-04-23 03:25:22,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:25:22,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,212 - lava_callback - ERROR - Error processing callback for node 69e6ee0c60f5826562c16e50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:26:42,182 - lava_callback - INFO - Received callback for node 69e6ee5f60f5826562c16e77 INFO: 172.21.0.1:45870 - "POST /node/69e6ee5f60f5826562c16e77 HTTP/1.0" 202 Accepted 2026-04-23 03:26:42,187 - lava_callback - INFO - Starting async job submit for node 69e6ee5f60f5826562c16e77 2026-04-23 03:26:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,203 - lava_callback - DEBUG - Processing node 69e6ee5f60f5826562c16e77: baseline-arm64-clabbe 2026-04-23 03:26:42,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ee5f60f5826562c16e77 2026-04-23 03:26:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:26:42,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,248 - lava_callback - ERROR - Error processing callback for node 69e6ee5f60f5826562c16e77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:33:39,395 - lava_callback - INFO - Received callback for node 69e991638137cb226ce20a90 INFO: 172.21.0.1:37232 - "POST /node/69e991638137cb226ce20a90 HTTP/1.0" 202 Accepted 2026-04-23 03:33:39,402 - lava_callback - INFO - Starting async job submit for node 69e991638137cb226ce20a90 2026-04-23 03:33:39,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:39,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:39,476 - lava_callback - DEBUG - Processing node 69e991638137cb226ce20a90: baseline-arm64 2026-04-23 03:33:39,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/log.txt.gz 2026-04-23 03:33:40,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/lava-logs.yaml 2026-04-23 03:33:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/lava_callback.json.gz DEBUG: Setup failed for 69e991638137cb226ce20a90. Transitting job node result: incomplete -> fail 2026-04-23 03:33:40,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:33:40,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:40,975 - lava_callback - INFO - Completed processing callback for node 69e991638137cb226ce20a90 INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:33:56,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:56,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:34:32,729 - lava_callback - INFO - Received callback for node 69e990bf8137cb226ce20a33 INFO: 172.21.0.1:52738 - "POST /node/69e990bf8137cb226ce20a33 HTTP/1.0" 202 Accepted 2026-04-23 03:34:32,735 - lava_callback - INFO - Starting async job submit for node 69e990bf8137cb226ce20a33 2026-04-23 03:34:32,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:32,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:32,798 - lava_callback - DEBUG - Processing node 69e990bf8137cb226ce20a33: baseline-nfs-arm64 2026-04-23 03:34:33,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:33,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:33,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/log.txt.gz 2026-04-23 03:34:33,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:33,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:33,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/lava-logs.yaml 2026-04-23 03:34:33,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:34,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:34,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/lava_callback.json.gz 2026-04-23 03:34:34,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:34,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:34:34,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:34,183 - lava_callback - INFO - Completed processing callback for node 69e990bf8137cb226ce20a33 INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:34:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:56,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:35:39,763 - lava_callback - INFO - Received callback for node 69e98eca8137cb226ce20920 INFO: 172.21.0.1:42826 - "POST /node/69e98eca8137cb226ce20920 HTTP/1.0" 202 Accepted 2026-04-23 03:35:39,771 - lava_callback - INFO - Starting async job submit for node 69e98eca8137cb226ce20920 2026-04-23 03:35:39,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:39,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:39,827 - lava_callback - DEBUG - Processing node 69e98eca8137cb226ce20920: baseline-nfs-arm64 2026-04-23 03:35:40,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/log.txt.gz 2026-04-23 03:35:41,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/lava-logs.yaml 2026-04-23 03:35:41,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/lava_callback.json.gz DEBUG: Setup failed for 69e98eca8137cb226ce20920. Transitting job node result: incomplete -> fail 2026-04-23 03:35:42,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:42,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:35:42,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:42,205 - lava_callback - INFO - Completed processing callback for node 69e98eca8137cb226ce20920 INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:35:56,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:56,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:36:43,422 - lava_callback - INFO - Received callback for node 69e98f1c8137cb226ce20953 INFO: 172.21.0.1:38442 - "POST /node/69e98f1c8137cb226ce20953 HTTP/1.0" 202 Accepted 2026-04-23 03:36:43,430 - lava_callback - INFO - Starting async job submit for node 69e98f1c8137cb226ce20953 2026-04-23 03:36:43,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:43,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:43,513 - lava_callback - DEBUG - Processing node 69e98f1c8137cb226ce20953: baseline-nfs-arm64 2026-04-23 03:36:44,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:44,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:44,930 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/log.txt.gz 2026-04-23 03:36:45,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:45,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:45,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/lava-logs.yaml 2026-04-23 03:36:45,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:46,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:46,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/lava_callback.json.gz DEBUG: Setup failed for 69e98f1c8137cb226ce20953. Transitting job node result: incomplete -> fail 2026-04-23 03:36:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:46,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:36:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:46,310 - lava_callback - INFO - Completed processing callback for node 69e98f1c8137cb226ce20953 INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:36:56,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:56,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:38:11,408 - lava_callback - INFO - Received callback for node 69e6f11c60f5826562c16f79 INFO: 172.21.0.1:49176 - "POST /node/69e6f11c60f5826562c16f79 HTTP/1.0" 202 Accepted 2026-04-23 03:38:11,413 - lava_callback - INFO - Starting async job submit for node 69e6f11c60f5826562c16f79 2026-04-23 03:38:11,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,428 - lava_callback - DEBUG - Processing node 69e6f11c60f5826562c16f79: baseline-arm-baylibre 2026-04-23 03:38:11,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f11c60f5826562c16f79 2026-04-23 03:38:11,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:38:11,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,473 - lava_callback - ERROR - Error processing callback for node 69e6f11c60f5826562c16f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:41:11,508 - lava_callback - INFO - Received callback for node 69e6f1d360f5826562c16f8d INFO: 172.21.0.1:33010 - "POST /node/69e6f1d360f5826562c16f8d HTTP/1.0" 202 Accepted 2026-04-23 03:41:11,514 - lava_callback - INFO - Starting async job submit for node 69e6f1d360f5826562c16f8d 2026-04-23 03:41:11,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,531 - lava_callback - DEBUG - Processing node 69e6f1d360f5826562c16f8d: baseline-arm-baylibre 2026-04-23 03:41:11,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f1d360f5826562c16f8d 2026-04-23 03:41:11,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:41:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,583 - lava_callback - ERROR - Error processing callback for node 69e6f1d360f5826562c16f8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:41:51,426 - lava_callback - INFO - Received callback for node 69e6f1fa60f5826562c16f9b INFO: 172.21.0.1:55964 - "POST /node/69e6f1fa60f5826562c16f9b HTTP/1.0" 202 Accepted 2026-04-23 03:41:51,432 - lava_callback - INFO - Starting async job submit for node 69e6f1fa60f5826562c16f9b 2026-04-23 03:41:51,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,446 - lava_callback - DEBUG - Processing node 69e6f1fa60f5826562c16f9b: baseline-arm-baylibre 2026-04-23 03:41:51,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f1fa60f5826562c16f9b 2026-04-23 03:41:51,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:41:51,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,511 - lava_callback - ERROR - Error processing callback for node 69e6f1fa60f5826562c16f9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:43:11,613 - lava_callback - INFO - Received callback for node 69e6f24a60f5826562c16faa INFO: 172.21.0.1:36856 - "POST /node/69e6f24a60f5826562c16faa HTTP/1.0" 202 Accepted 2026-04-23 03:43:11,618 - lava_callback - INFO - Starting async job submit for node 69e6f24a60f5826562c16faa 2026-04-23 03:43:11,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,634 - lava_callback - DEBUG - Processing node 69e6f24a60f5826562c16faa: baseline-arm-baylibre 2026-04-23 03:43:11,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f24a60f5826562c16faa 2026-04-23 03:43:11,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:43:11,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,690 - lava_callback - ERROR - Error processing callback for node 69e6f24a60f5826562c16faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:47:11,783 - lava_callback - INFO - Received callback for node 69e6f33c60f5826562c16fbe INFO: 172.21.0.1:45888 - "POST /node/69e6f33c60f5826562c16fbe HTTP/1.0" 202 Accepted 2026-04-23 03:47:11,789 - lava_callback - INFO - Starting async job submit for node 69e6f33c60f5826562c16fbe 2026-04-23 03:47:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,803 - lava_callback - DEBUG - Processing node 69e6f33c60f5826562c16fbe: baseline-arm-baylibre 2026-04-23 03:47:11,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f33c60f5826562c16fbe 2026-04-23 03:47:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:47:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,850 - lava_callback - ERROR - Error processing callback for node 69e6f33c60f5826562c16fbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:47:19,537 - lava_callback - INFO - Received callback for node 69e995e98137cb226ce20d34 INFO: 172.21.0.1:45910 - "POST /node/69e995e98137cb226ce20d34 HTTP/1.0" 202 Accepted 2026-04-23 03:47:19,543 - lava_callback - INFO - Starting async job submit for node 69e995e98137cb226ce20d34 2026-04-23 03:47:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:19,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:19,578 - lava_callback - DEBUG - Processing node 69e995e98137cb226ce20d34: baseline-arm64 2026-04-23 03:47:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/log.txt.gz 2026-04-23 03:47:20,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/lava-logs.yaml 2026-04-23 03:47:20,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/lava_callback.json.gz 2026-04-23 03:47:20,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:20,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:47:20,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:20,695 - lava_callback - INFO - Completed processing callback for node 69e995e98137cb226ce20d34 2026-04-23 03:47:26,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:26,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:48:11,706 - lava_callback - INFO - Received callback for node 69e6f37860f5826562c16fcd INFO: 172.21.0.1:38254 - "POST /node/69e6f37860f5826562c16fcd HTTP/1.0" 202 Accepted 2026-04-23 03:48:11,715 - lava_callback - INFO - Starting async job submit for node 69e6f37860f5826562c16fcd 2026-04-23 03:48:11,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,734 - lava_callback - DEBUG - Processing node 69e6f37860f5826562c16fcd: baseline-arm-baylibre 2026-04-23 03:48:11,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f37860f5826562c16fcd 2026-04-23 03:48:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:48:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,777 - lava_callback - ERROR - Error processing callback for node 69e6f37860f5826562c16fcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 03:48:14,249 - lava_callback - INFO - Received callback for node 69e995968137cb226ce20d08 INFO: 172.21.0.1:38266 - "POST /node/69e995968137cb226ce20d08 HTTP/1.0" 202 Accepted 2026-04-23 03:48:14,255 - lava_callback - INFO - Starting async job submit for node 69e995968137cb226ce20d08 2026-04-23 03:48:14,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:14,286 - lava_callback - DEBUG - Processing node 69e995968137cb226ce20d08: baseline-arm64 2026-04-23 03:48:14,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:48:14,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:14,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/log.txt.gz 2026-04-23 03:48:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:48:15,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:15,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/lava-logs.yaml 2026-04-23 03:48:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38280 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 03:48:15,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:15,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/lava_callback.json.gz 2026-04-23 03:48:15,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:15,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:48:15,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:15,334 - lava_callback - INFO - Completed processing callback for node 69e995968137cb226ce20d08 INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:48:26,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:26,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:25,483 - lava_callback - INFO - Received callback for node 69e996ea8137cb226ce20da9 INFO: 172.21.0.1:53502 - "POST /node/69e996ea8137cb226ce20da9 HTTP/1.0" 202 Accepted 2026-04-23 03:51:25,490 - lava_callback - INFO - Starting async job submit for node 69e996ea8137cb226ce20da9 2026-04-23 03:51:25,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:25,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:25,532 - lava_callback - DEBUG - Processing node 69e996ea8137cb226ce20da9: baseline-arm64-foundriesio 2026-04-23 03:51:25,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:51:26,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/log.txt.gz 2026-04-23 03:51:26,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:51:26,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/lava-logs.yaml 2026-04-23 03:51:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:26,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/lava_callback.json.gz 2026-04-23 03:51:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:26,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:51:26,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:26,746 - lava_callback - INFO - Completed processing callback for node 69e996ea8137cb226ce20da9 INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:56,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:56,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:53:03,237 - lava_callback - INFO - Received callback for node 69e6f48d60f5826562c16ffd INFO: 172.21.0.1:49670 - "POST /node/69e6f48d60f5826562c16ffd HTTP/1.0" 202 Accepted 2026-04-23 03:53:03,243 - lava_callback - INFO - Starting async job submit for node 69e6f48d60f5826562c16ffd 2026-04-23 03:53:03,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,258 - lava_callback - DEBUG - Processing node 69e6f48d60f5826562c16ffd: baseline-arm-clabbe 2026-04-23 03:53:03,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f48d60f5826562c16ffd 2026-04-23 03:53:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:53:03,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,330 - lava_callback - ERROR - Error processing callback for node 69e6f48d60f5826562c16ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:53:43,214 - lava_callback - INFO - Received callback for node 69e6f4b360f5826562c1700d INFO: 172.21.0.1:45622 - "POST /node/69e6f4b360f5826562c1700d HTTP/1.0" 202 Accepted 2026-04-23 03:53:43,219 - lava_callback - INFO - Starting async job submit for node 69e6f4b360f5826562c1700d 2026-04-23 03:53:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,234 - lava_callback - DEBUG - Processing node 69e6f4b360f5826562c1700d: baseline-arm-clabbe 2026-04-23 03:53:43,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f4b360f5826562c1700d 2026-04-23 03:53:43,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:53:43,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,281 - lava_callback - ERROR - Error processing callback for node 69e6f4b360f5826562c1700d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:54:23,255 - lava_callback - INFO - Received callback for node 69e6f4e260f5826562c1701b INFO: 172.21.0.1:53540 - "POST /node/69e6f4e260f5826562c1701b HTTP/1.0" 202 Accepted 2026-04-23 03:54:23,260 - lava_callback - INFO - Starting async job submit for node 69e6f4e260f5826562c1701b 2026-04-23 03:54:23,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,275 - lava_callback - DEBUG - Processing node 69e6f4e260f5826562c1701b: baseline-arm-clabbe 2026-04-23 03:54:23,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f4e260f5826562c1701b 2026-04-23 03:54:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:54:23,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,320 - lava_callback - ERROR - Error processing callback for node 69e6f4e260f5826562c1701b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:55:03,221 - lava_callback - INFO - Received callback for node 69e6f50860f5826562c17029 INFO: 172.21.0.1:45074 - "POST /node/69e6f50860f5826562c17029 HTTP/1.0" 202 Accepted 2026-04-23 03:55:03,227 - lava_callback - INFO - Starting async job submit for node 69e6f50860f5826562c17029 2026-04-23 03:55:03,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,246 - lava_callback - DEBUG - Processing node 69e6f50860f5826562c17029: baseline-arm-clabbe 2026-04-23 03:55:03,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f50860f5826562c17029 2026-04-23 03:55:03,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:55:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,289 - lava_callback - ERROR - Error processing callback for node 69e6f50860f5826562c17029: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:55:43,322 - lava_callback - INFO - Received callback for node 69e6f52d60f5826562c17039 INFO: 172.21.0.1:36922 - "POST /node/69e6f52d60f5826562c17039 HTTP/1.0" 202 Accepted 2026-04-23 03:55:43,327 - lava_callback - INFO - Starting async job submit for node 69e6f52d60f5826562c17039 2026-04-23 03:55:43,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,352 - lava_callback - DEBUG - Processing node 69e6f52d60f5826562c17039: baseline-arm-clabbe 2026-04-23 03:55:43,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f52d60f5826562c17039 2026-04-23 03:55:43,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:55:43,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,397 - lava_callback - ERROR - Error processing callback for node 69e6f52d60f5826562c17039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:56:23,318 - lava_callback - INFO - Received callback for node 69e6f55b60f5826562c17047 INFO: 172.21.0.1:46366 - "POST /node/69e6f55b60f5826562c17047 HTTP/1.0" 202 Accepted 2026-04-23 03:56:23,326 - lava_callback - INFO - Starting async job submit for node 69e6f55b60f5826562c17047 2026-04-23 03:56:23,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,350 - lava_callback - DEBUG - Processing node 69e6f55b60f5826562c17047: baseline-arm-clabbe 2026-04-23 03:56:23,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f55b60f5826562c17047 2026-04-23 03:56:23,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:56:23,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,398 - lava_callback - ERROR - Error processing callback for node 69e6f55b60f5826562c17047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:57:03,356 - lava_callback - INFO - Received callback for node 69e6f58060f5826562c17054 INFO: 172.21.0.1:43214 - "POST /node/69e6f58060f5826562c17054 HTTP/1.0" 202 Accepted 2026-04-23 03:57:03,362 - lava_callback - INFO - Starting async job submit for node 69e6f58060f5826562c17054 2026-04-23 03:57:03,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,377 - lava_callback - DEBUG - Processing node 69e6f58060f5826562c17054: baseline-arm-clabbe 2026-04-23 03:57:03,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f58060f5826562c17054 2026-04-23 03:57:03,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:57:03,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,433 - lava_callback - ERROR - Error processing callback for node 69e6f58060f5826562c17054: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:57:43,394 - lava_callback - INFO - Received callback for node 69e6f5a560f5826562c17065 INFO: 172.21.0.1:52612 - "POST /node/69e6f5a560f5826562c17065 HTTP/1.0" 202 Accepted 2026-04-23 03:57:43,399 - lava_callback - INFO - Starting async job submit for node 69e6f5a560f5826562c17065 2026-04-23 03:57:43,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,415 - lava_callback - DEBUG - Processing node 69e6f5a560f5826562c17065: baseline-arm-clabbe 2026-04-23 03:57:43,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f5a560f5826562c17065 2026-04-23 03:57:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:57:43,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,470 - lava_callback - ERROR - Error processing callback for node 69e6f5a560f5826562c17065: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:01:23,560 - lava_callback - INFO - Received callback for node 69e6f68860f5826562c17077 INFO: 172.21.0.1:50058 - "POST /node/69e6f68860f5826562c17077 HTTP/1.0" 202 Accepted 2026-04-23 04:01:23,566 - lava_callback - INFO - Starting async job submit for node 69e6f68860f5826562c17077 2026-04-23 04:01:23,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,581 - lava_callback - DEBUG - Processing node 69e6f68860f5826562c17077: baseline-arm-clabbe 2026-04-23 04:01:23,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f68860f5826562c17077 2026-04-23 04:01:23,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 04:01:23,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,639 - lava_callback - ERROR - Error processing callback for node 69e6f68860f5826562c17077: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:08:20,909 - lava_callback - INFO - Received callback for node 69e999758137cb226ce20f2a INFO: 172.21.0.1:35636 - "POST /node/69e999758137cb226ce20f2a HTTP/1.0" 202 Accepted 2026-04-23 04:08:20,916 - lava_callback - INFO - Starting async job submit for node 69e999758137cb226ce20f2a 2026-04-23 04:08:20,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:20,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:20,967 - lava_callback - DEBUG - Processing node 69e999758137cb226ce20f2a: baseline-arm64 2026-04-23 04:08:21,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:21,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:21,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/log.txt.gz 2026-04-23 04:08:21,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:21,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:21,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/lava-logs.yaml 2026-04-23 04:08:21,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:22,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:22,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/lava_callback.json.gz DEBUG: Setup failed for 69e999758137cb226ce20f2a. Transitting job node result: incomplete -> fail 2026-04-23 04:08:22,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:22,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:08:22,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:22,401 - lava_callback - INFO - Completed processing callback for node 69e999758137cb226ce20f2a 2026-04-23 04:08:26,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:26,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:13:13,928 - lava_callback - INFO - Received callback for node 69e999cb8137cb226ce20f59 INFO: 172.21.0.1:44582 - "POST /node/69e999cb8137cb226ce20f59 HTTP/1.0" 202 Accepted 2026-04-23 04:13:13,935 - lava_callback - INFO - Starting async job submit for node 69e999cb8137cb226ce20f59 2026-04-23 04:13:13,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:13,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:13,974 - lava_callback - DEBUG - Processing node 69e999cb8137cb226ce20f59: baseline-nfs-arm64 2026-04-23 04:13:14,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:13:14,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:14,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/log.txt.gz 2026-04-23 04:13:14,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44586 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 04:13:15,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:15,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/lava-logs.yaml 2026-04-23 04:13:15,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:13:15,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:15,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/lava_callback.json.gz 2026-04-23 04:13:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:15,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:13:15,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:15,593 - lava_callback - INFO - Completed processing callback for node 69e999cb8137cb226ce20f59 INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:13:26,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:26,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:23:45,370 - lava_callback - INFO - Received callback for node 69e99a1c8137cb226ce20f80 INFO: 172.21.0.1:49274 - "POST /node/69e99a1c8137cb226ce20f80 HTTP/1.0" 202 Accepted 2026-04-23 04:23:45,378 - lava_callback - INFO - Starting async job submit for node 69e99a1c8137cb226ce20f80 2026-04-23 04:23:45,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:45,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:45,441 - lava_callback - DEBUG - Processing node 69e99a1c8137cb226ce20f80: baseline-nfs-arm64 2026-04-23 04:23:46,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:23:46,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:46,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/log.txt.gz 2026-04-23 04:23:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:23:47,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:47,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/lava-logs.yaml 2026-04-23 04:23:47,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:23:47,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:47,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/lava_callback.json.gz DEBUG: Setup failed for 69e99a1c8137cb226ce20f80. Transitting job node result: incomplete -> fail 2026-04-23 04:23:47,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:47,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:23:47,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:47,988 - lava_callback - INFO - Completed processing callback for node 69e99a1c8137cb226ce20f80 2026-04-23 04:23:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:56,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:04,554 - lava_callback - INFO - Received callback for node 69e99a6e8137cb226ce20fad INFO: 172.21.0.1:60382 - "POST /node/69e99a6e8137cb226ce20fad HTTP/1.0" 202 Accepted 2026-04-23 04:25:04,566 - lava_callback - INFO - Starting async job submit for node 69e99a6e8137cb226ce20fad 2026-04-23 04:25:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:04,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:04,631 - lava_callback - DEBUG - Processing node 69e99a6e8137cb226ce20fad: baseline-nfs-arm64 2026-04-23 04:25:05,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:06,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:06,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/log.txt.gz INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:06,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:07,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:07,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/lava-logs.yaml 2026-04-23 04:25:07,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:07,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:07,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/lava_callback.json.gz DEBUG: Setup failed for 69e99a6e8137cb226ce20fad. Transitting job node result: incomplete -> fail 2026-04-23 04:25:07,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:07,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:25:07,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:07,501 - lava_callback - INFO - Completed processing callback for node 69e99a6e8137cb226ce20fad INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:26,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:44:20,565 - lava_callback - INFO - Received callback for node 69e99ee08137cb226ce21014 INFO: 172.21.0.1:48008 - "POST /node/69e99ee08137cb226ce21014 HTTP/1.0" 202 Accepted 2026-04-23 04:44:20,574 - lava_callback - INFO - Starting async job submit for node 69e99ee08137cb226ce21014 2026-04-23 04:44:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:20,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:20,634 - lava_callback - DEBUG - Processing node 69e99ee08137cb226ce21014: baseline-nfs-arm64 2026-04-23 04:44:21,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:21,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:21,699 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/log.txt.gz 2026-04-23 04:44:22,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:22,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:22,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/lava-logs.yaml 2026-04-23 04:44:22,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:22,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:22,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/lava_callback.json.gz DEBUG: Setup failed for 69e99ee08137cb226ce21014. Transitting job node result: incomplete -> fail 2026-04-23 04:44:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:22,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:44:22,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:22,874 - lava_callback - INFO - Completed processing callback for node 69e99ee08137cb226ce21014 2026-04-23 04:44:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:26,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:24,870 - lava_callback - INFO - Received callback for node 69e99f348137cb226ce21043 INFO: 172.21.0.1:37848 - "POST /node/69e99f348137cb226ce21043 HTTP/1.0" 202 Accepted 2026-04-23 04:45:24,878 - lava_callback - INFO - Starting async job submit for node 69e99f348137cb226ce21043 2026-04-23 04:45:24,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:24,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:24,951 - lava_callback - DEBUG - Processing node 69e99f348137cb226ce21043: baseline-nfs-arm64 2026-04-23 04:45:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:26,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:26,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/log.txt.gz INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:27,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:27,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/lava-logs.yaml 2026-04-23 04:45:27,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:27,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:27,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/lava_callback.json.gz DEBUG: Setup failed for 69e99f348137cb226ce21043. Transitting job node result: incomplete -> fail 2026-04-23 04:45:27,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:45:27,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:27,689 - lava_callback - INFO - Completed processing callback for node 69e99f348137cb226ce21043 2026-04-23 04:45:35,077 - lava_callback - INFO - Received callback for node 69e700e260f5826562c170e7 INFO: 172.21.0.1:34702 - "POST /node/69e700e260f5826562c170e7 HTTP/1.0" 202 Accepted 2026-04-23 04:45:35,082 - lava_callback - INFO - Starting async job submit for node 69e700e260f5826562c170e7 2026-04-23 04:45:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,097 - lava_callback - DEBUG - Processing node 69e700e260f5826562c170e7: baseline-arm-baylibre 2026-04-23 04:45:35,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e700e260f5826562c170e7 2026-04-23 04:45:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:45:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,142 - lava_callback - ERROR - Error processing callback for node 69e700e260f5826562c170e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:46:14,945 - lava_callback - INFO - Received callback for node 69e7010a60f5826562c170f2 INFO: 172.21.0.1:58806 - "POST /node/69e7010a60f5826562c170f2 HTTP/1.0" 202 Accepted 2026-04-23 04:46:14,951 - lava_callback - INFO - Starting async job submit for node 69e7010a60f5826562c170f2 2026-04-23 04:46:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:14,967 - lava_callback - DEBUG - Processing node 69e7010a60f5826562c170f2: baseline-arm-baylibre 2026-04-23 04:46:14,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7010a60f5826562c170f2 2026-04-23 04:46:14,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:14,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:46:14,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:15,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:15,012 - lava_callback - ERROR - Error processing callback for node 69e7010a60f5826562c170f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:47:35,068 - lava_callback - INFO - Received callback for node 69e7015b60f5826562c17103 INFO: 172.21.0.1:46542 - "POST /node/69e7015b60f5826562c17103 HTTP/1.0" 202 Accepted 2026-04-23 04:47:35,073 - lava_callback - INFO - Starting async job submit for node 69e7015b60f5826562c17103 2026-04-23 04:47:35,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,089 - lava_callback - DEBUG - Processing node 69e7015b60f5826562c17103: baseline-arm-baylibre 2026-04-23 04:47:35,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7015b60f5826562c17103 2026-04-23 04:47:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:47:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,143 - lava_callback - ERROR - Error processing callback for node 69e7015b60f5826562c17103: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:48:35,084 - lava_callback - INFO - Received callback for node 69e7019860f5826562c17110 INFO: 172.21.0.1:40680 - "POST /node/69e7019860f5826562c17110 HTTP/1.0" 202 Accepted 2026-04-23 04:48:35,090 - lava_callback - INFO - Starting async job submit for node 69e7019860f5826562c17110 2026-04-23 04:48:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,105 - lava_callback - DEBUG - Processing node 69e7019860f5826562c17110: baseline-arm-baylibre 2026-04-23 04:48:35,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7019860f5826562c17110 2026-04-23 04:48:35,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:48:35,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,159 - lava_callback - ERROR - Error processing callback for node 69e7019860f5826562c17110: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:49:15,154 - lava_callback - INFO - Received callback for node 69e701bd60f5826562c1711b INFO: 172.21.0.1:35838 - "POST /node/69e701bd60f5826562c1711b HTTP/1.0" 202 Accepted 2026-04-23 04:49:15,159 - lava_callback - INFO - Starting async job submit for node 69e701bd60f5826562c1711b 2026-04-23 04:49:15,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 04:49:15,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,175 - lava_callback - DEBUG - Processing node 69e701bd60f5826562c1711b: baseline-arm-baylibre 2026-04-23 04:49:15,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e701bd60f5826562c1711b 2026-04-23 04:49:15,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:49:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,227 - lava_callback - ERROR - Error processing callback for node 69e701bd60f5826562c1711b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:51:45,721 - lava_callback - INFO - Received callback for node 69e7025460f5826562c17136 INFO: 172.21.0.1:55718 - "POST /node/69e7025460f5826562c17136 HTTP/1.0" 202 Accepted 2026-04-23 04:51:45,726 - lava_callback - INFO - Starting async job submit for node 69e7025460f5826562c17136 2026-04-23 04:51:45,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,746 - lava_callback - DEBUG - Processing node 69e7025460f5826562c17136: baseline-arm-clabbe 2026-04-23 04:51:45,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7025460f5826562c17136 2026-04-23 04:51:45,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:51:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,796 - lava_callback - ERROR - Error processing callback for node 69e7025460f5826562c17136: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:52:25,725 - lava_callback - INFO - Received callback for node 69e7027b60f5826562c17144 INFO: 172.21.0.1:41212 - "POST /node/69e7027b60f5826562c17144 HTTP/1.0" 202 Accepted 2026-04-23 04:52:25,731 - lava_callback - INFO - Starting async job submit for node 69e7027b60f5826562c17144 2026-04-23 04:52:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,746 - lava_callback - DEBUG - Processing node 69e7027b60f5826562c17144: baseline-arm-clabbe 2026-04-23 04:52:25,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7027b60f5826562c17144 2026-04-23 04:52:25,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:52:25,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,794 - lava_callback - ERROR - Error processing callback for node 69e7027b60f5826562c17144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:53:05,739 - lava_callback - INFO - Received callback for node 69e702a060f5826562c17152 INFO: 172.21.0.1:59616 - "POST /node/69e702a060f5826562c17152 HTTP/1.0" 202 Accepted 2026-04-23 04:53:05,744 - lava_callback - INFO - Starting async job submit for node 69e702a060f5826562c17152 2026-04-23 04:53:05,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,765 - lava_callback - DEBUG - Processing node 69e702a060f5826562c17152: baseline-arm-clabbe 2026-04-23 04:53:05,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e702a060f5826562c17152 2026-04-23 04:53:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:53:05,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,839 - lava_callback - ERROR - Error processing callback for node 69e702a060f5826562c17152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:53:45,725 - lava_callback - INFO - Received callback for node 69e702cb60f5826562c1715f INFO: 172.21.0.1:46142 - "POST /node/69e702cb60f5826562c1715f HTTP/1.0" 202 Accepted 2026-04-23 04:53:45,730 - lava_callback - INFO - Starting async job submit for node 69e702cb60f5826562c1715f 2026-04-23 04:53:45,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,745 - lava_callback - DEBUG - Processing node 69e702cb60f5826562c1715f: baseline-arm-clabbe 2026-04-23 04:53:45,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e702cb60f5826562c1715f 2026-04-23 04:53:45,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:53:45,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,799 - lava_callback - ERROR - Error processing callback for node 69e702cb60f5826562c1715f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:54:45,827 - lava_callback - INFO - Received callback for node 69e7030760f5826562c1716e INFO: 172.21.0.1:44922 - "POST /node/69e7030760f5826562c1716e HTTP/1.0" 202 Accepted 2026-04-23 04:54:45,833 - lava_callback - INFO - Starting async job submit for node 69e7030760f5826562c1716e 2026-04-23 04:54:45,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,847 - lava_callback - DEBUG - Processing node 69e7030760f5826562c1716e: baseline-arm-clabbe 2026-04-23 04:54:45,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7030760f5826562c1716e 2026-04-23 04:54:45,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:54:45,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,904 - lava_callback - ERROR - Error processing callback for node 69e7030760f5826562c1716e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:55:25,819 - lava_callback - INFO - Received callback for node 69e7032b60f5826562c1717b INFO: 172.21.0.1:53102 - "POST /node/69e7032b60f5826562c1717b HTTP/1.0" 202 Accepted 2026-04-23 04:55:25,824 - lava_callback - INFO - Starting async job submit for node 69e7032b60f5826562c1717b 2026-04-23 04:55:25,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,839 - lava_callback - DEBUG - Processing node 69e7032b60f5826562c1717b: baseline-arm-clabbe 2026-04-23 04:55:25,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7032b60f5826562c1717b 2026-04-23 04:55:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:55:25,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,919 - lava_callback - ERROR - Error processing callback for node 69e7032b60f5826562c1717b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:56:05,879 - lava_callback - INFO - Received callback for node 69e7035560f5826562c17188 INFO: 172.21.0.1:53266 - "POST /node/69e7035560f5826562c17188 HTTP/1.0" 202 Accepted 2026-04-23 04:56:05,884 - lava_callback - INFO - Starting async job submit for node 69e7035560f5826562c17188 2026-04-23 04:56:05,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,911 - lava_callback - DEBUG - Processing node 69e7035560f5826562c17188: baseline-arm-clabbe 2026-04-23 04:56:05,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7035560f5826562c17188 2026-04-23 04:56:05,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:56:05,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,989 - lava_callback - ERROR - Error processing callback for node 69e7035560f5826562c17188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:56:45,892 - lava_callback - INFO - Received callback for node 69e7037f60f5826562c17195 INFO: 172.21.0.1:45402 - "POST /node/69e7037f60f5826562c17195 HTTP/1.0" 202 Accepted 2026-04-23 04:56:45,897 - lava_callback - INFO - Starting async job submit for node 69e7037f60f5826562c17195 2026-04-23 04:56:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,913 - lava_callback - DEBUG - Processing node 69e7037f60f5826562c17195: baseline-arm-clabbe 2026-04-23 04:56:45,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7037f60f5826562c17195 2026-04-23 04:56:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:56:45,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,964 - lava_callback - ERROR - Error processing callback for node 69e7037f60f5826562c17195: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:58:46,031 - lava_callback - INFO - Received callback for node 69e703f860f5826562c171b9 INFO: 172.21.0.1:38314 - "POST /node/69e703f860f5826562c171b9 HTTP/1.0" 202 Accepted 2026-04-23 04:58:46,038 - lava_callback - INFO - Starting async job submit for node 69e703f860f5826562c171b9 2026-04-23 04:58:46,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,053 - lava_callback - DEBUG - Processing node 69e703f860f5826562c171b9: baseline-arm-clabbe 2026-04-23 04:58:46,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e703f860f5826562c171b9 2026-04-23 04:58:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:58:46,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,112 - lava_callback - ERROR - Error processing callback for node 69e703f860f5826562c171b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:20:37,134 - lava_callback - INFO - Received callback for node 69e7091660f5826562c1727f INFO: 172.21.0.1:41052 - "POST /node/69e7091660f5826562c1727f HTTP/1.0" 202 Accepted 2026-04-23 05:20:37,139 - lava_callback - INFO - Starting async job submit for node 69e7091660f5826562c1727f 2026-04-23 05:20:37,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,163 - lava_callback - DEBUG - Processing node 69e7091660f5826562c1727f: baseline-arm64-baylibre 2026-04-23 05:20:37,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7091660f5826562c1727f 2026-04-23 05:20:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:20:37,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,219 - lava_callback - ERROR - Error processing callback for node 69e7091660f5826562c1727f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:21:57,145 - lava_callback - INFO - Received callback for node 69e7096760f5826562c1729f INFO: 172.21.0.1:58068 - "POST /node/69e7096760f5826562c1729f HTTP/1.0" 202 Accepted 2026-04-23 05:21:57,150 - lava_callback - INFO - Starting async job submit for node 69e7096760f5826562c1729f 2026-04-23 05:21:57,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,172 - lava_callback - DEBUG - Processing node 69e7096760f5826562c1729f: baseline-arm64-baylibre 2026-04-23 05:21:57,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7096760f5826562c1729f 2026-04-23 05:21:57,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:21:57,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,219 - lava_callback - ERROR - Error processing callback for node 69e7096760f5826562c1729f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:23:37,040 - lava_callback - INFO - Received callback for node 69e709ca60f5826562c172c5 INFO: 172.21.0.1:43186 - "POST /node/69e709ca60f5826562c172c5 HTTP/1.0" 202 Accepted 2026-04-23 05:23:37,047 - lava_callback - INFO - Starting async job submit for node 69e709ca60f5826562c172c5 2026-04-23 05:23:37,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,062 - lava_callback - DEBUG - Processing node 69e709ca60f5826562c172c5: baseline-arm64-baylibre 2026-04-23 05:23:37,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e709ca60f5826562c172c5 2026-04-23 05:23:37,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:23:37,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,110 - lava_callback - ERROR - Error processing callback for node 69e709ca60f5826562c172c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:24:57,124 - lava_callback - INFO - Received callback for node 69e70a1b60f5826562c172e3 INFO: 172.21.0.1:49334 - "POST /node/69e70a1b60f5826562c172e3 HTTP/1.0" 202 Accepted 2026-04-23 05:24:57,129 - lava_callback - INFO - Starting async job submit for node 69e70a1b60f5826562c172e3 2026-04-23 05:24:57,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,152 - lava_callback - DEBUG - Processing node 69e70a1b60f5826562c172e3: baseline-arm64-baylibre 2026-04-23 05:24:57,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70a1b60f5826562c172e3 2026-04-23 05:24:57,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:24:57,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,206 - lava_callback - ERROR - Error processing callback for node 69e70a1b60f5826562c172e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:26:37,217 - lava_callback - INFO - Received callback for node 69e70a8060f5826562c1730a INFO: 172.21.0.1:49938 - "POST /node/69e70a8060f5826562c1730a HTTP/1.0" 202 Accepted 2026-04-23 05:26:37,222 - lava_callback - INFO - Starting async job submit for node 69e70a8060f5826562c1730a 2026-04-23 05:26:37,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,237 - lava_callback - DEBUG - Processing node 69e70a8060f5826562c1730a: baseline-arm64-baylibre 2026-04-23 05:26:37,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70a8060f5826562c1730a 2026-04-23 05:26:37,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:26:37,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,287 - lava_callback - ERROR - Error processing callback for node 69e70a8060f5826562c1730a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:28:37,412 - lava_callback - INFO - Received callback for node 69e70af960f5826562c1732c INFO: 172.21.0.1:34016 - "POST /node/69e70af960f5826562c1732c HTTP/1.0" 202 Accepted 2026-04-23 05:28:37,417 - lava_callback - INFO - Starting async job submit for node 69e70af960f5826562c1732c 2026-04-23 05:28:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,432 - lava_callback - DEBUG - Processing node 69e70af960f5826562c1732c: baseline-arm64-baylibre 2026-04-23 05:28:37,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70af960f5826562c1732c 2026-04-23 05:28:37,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:28:37,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,477 - lava_callback - ERROR - Error processing callback for node 69e70af960f5826562c1732c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:30:47,345 - lava_callback - INFO - Received callback for node 69e70b7860f5826562c17350 INFO: 172.21.0.1:35168 - "POST /node/69e70b7860f5826562c17350 HTTP/1.0" 202 Accepted 2026-04-23 05:30:47,350 - lava_callback - INFO - Starting async job submit for node 69e70b7860f5826562c17350 2026-04-23 05:30:47,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,366 - lava_callback - DEBUG - Processing node 69e70b7860f5826562c17350: baseline-arm64-clabbe 2026-04-23 05:30:47,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70b7860f5826562c17350 2026-04-23 05:30:47,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:30:47,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,411 - lava_callback - ERROR - Error processing callback for node 69e70b7860f5826562c17350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:32:07,440 - lava_callback - INFO - Received callback for node 69e70bca60f5826562c17376 INFO: 172.21.0.1:59570 - "POST /node/69e70bca60f5826562c17376 HTTP/1.0" 202 Accepted 2026-04-23 05:32:07,445 - lava_callback - INFO - Starting async job submit for node 69e70bca60f5826562c17376 2026-04-23 05:32:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,461 - lava_callback - DEBUG - Processing node 69e70bca60f5826562c17376: baseline-arm64-clabbe 2026-04-23 05:32:07,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70bca60f5826562c17376 2026-04-23 05:32:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:32:07,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,512 - lava_callback - ERROR - Error processing callback for node 69e70bca60f5826562c17376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:33:47,481 - lava_callback - INFO - Received callback for node 69e70c2c60f5826562c17395 INFO: 172.21.0.1:60658 - "POST /node/69e70c2c60f5826562c17395 HTTP/1.0" 202 Accepted 2026-04-23 05:33:47,487 - lava_callback - INFO - Starting async job submit for node 69e70c2c60f5826562c17395 2026-04-23 05:33:47,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,506 - lava_callback - DEBUG - Processing node 69e70c2c60f5826562c17395: baseline-arm64-clabbe 2026-04-23 05:33:47,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70c2c60f5826562c17395 2026-04-23 05:33:47,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:33:47,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,553 - lava_callback - ERROR - Error processing callback for node 69e70c2c60f5826562c17395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:35:07,582 - lava_callback - INFO - Received callback for node 69e70c7d60f5826562c173bb INFO: 172.21.0.1:46238 - "POST /node/69e70c7d60f5826562c173bb HTTP/1.0" 202 Accepted 2026-04-23 05:35:07,587 - lava_callback - INFO - Starting async job submit for node 69e70c7d60f5826562c173bb 2026-04-23 05:35:07,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,609 - lava_callback - DEBUG - Processing node 69e70c7d60f5826562c173bb: baseline-arm64-clabbe 2026-04-23 05:35:07,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70c7d60f5826562c173bb 2026-04-23 05:35:07,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:35:07,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,661 - lava_callback - ERROR - Error processing callback for node 69e70c7d60f5826562c173bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:36:27,574 - lava_callback - INFO - Received callback for node 69e70ccd60f5826562c173d8 INFO: 172.21.0.1:42778 - "POST /node/69e70ccd60f5826562c173d8 HTTP/1.0" 202 Accepted 2026-04-23 05:36:27,580 - lava_callback - INFO - Starting async job submit for node 69e70ccd60f5826562c173d8 2026-04-23 05:36:27,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,608 - lava_callback - DEBUG - Processing node 69e70ccd60f5826562c173d8: baseline-arm64-clabbe 2026-04-23 05:36:27,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70ccd60f5826562c173d8 2026-04-23 05:36:27,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:36:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,655 - lava_callback - ERROR - Error processing callback for node 69e70ccd60f5826562c173d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:37:47,671 - lava_callback - INFO - Received callback for node 69e70d1e60f5826562c173fc INFO: 172.21.0.1:49280 - "POST /node/69e70d1e60f5826562c173fc HTTP/1.0" 202 Accepted 2026-04-23 05:37:47,677 - lava_callback - INFO - Starting async job submit for node 69e70d1e60f5826562c173fc 2026-04-23 05:37:47,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,694 - lava_callback - DEBUG - Processing node 69e70d1e60f5826562c173fc: baseline-arm64-clabbe 2026-04-23 05:37:47,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70d1e60f5826562c173fc 2026-04-23 05:37:47,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:37:47,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,746 - lava_callback - ERROR - Error processing callback for node 69e70d1e60f5826562c173fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:39:07,734 - lava_callback - INFO - Received callback for node 69e70d6e60f5826562c17422 INFO: 172.21.0.1:45536 - "POST /node/69e70d6e60f5826562c17422 HTTP/1.0" 202 Accepted 2026-04-23 05:39:07,740 - lava_callback - INFO - Starting async job submit for node 69e70d6e60f5826562c17422 2026-04-23 05:39:07,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,755 - lava_callback - DEBUG - Processing node 69e70d6e60f5826562c17422: baseline-arm64-clabbe 2026-04-23 05:39:07,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70d6e60f5826562c17422 2026-04-23 05:39:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:39:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,808 - lava_callback - ERROR - Error processing callback for node 69e70d6e60f5826562c17422: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:46:18,455 - lava_callback - INFO - Received callback for node 69e70f2660f5826562c17449 INFO: 172.21.0.1:36196 - "POST /node/69e70f2660f5826562c17449 HTTP/1.0" 202 Accepted 2026-04-23 05:46:18,460 - lava_callback - INFO - Starting async job submit for node 69e70f2660f5826562c17449 2026-04-23 05:46:18,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,477 - lava_callback - DEBUG - Processing node 69e70f2660f5826562c17449: baseline-arm-baylibre 2026-04-23 05:46:18,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70f2660f5826562c17449 2026-04-23 05:46:18,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:46:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,532 - lava_callback - ERROR - Error processing callback for node 69e70f2660f5826562c17449: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:48:18,462 - lava_callback - INFO - Received callback for node 69e70f9e60f5826562c17459 INFO: 172.21.0.1:46798 - "POST /node/69e70f9e60f5826562c17459 HTTP/1.0" 202 Accepted 2026-04-23 05:48:18,467 - lava_callback - INFO - Starting async job submit for node 69e70f9e60f5826562c17459 2026-04-23 05:48:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,483 - lava_callback - DEBUG - Processing node 69e70f9e60f5826562c17459: baseline-arm-baylibre 2026-04-23 05:48:18,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70f9e60f5826562c17459 2026-04-23 05:48:18,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:48:18,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,528 - lava_callback - ERROR - Error processing callback for node 69e70f9e60f5826562c17459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:50:18,522 - lava_callback - INFO - Received callback for node 69e7101660f5826562c17467 INFO: 172.21.0.1:32966 - "POST /node/69e7101660f5826562c17467 HTTP/1.0" 202 Accepted 2026-04-23 05:50:18,528 - lava_callback - INFO - Starting async job submit for node 69e7101660f5826562c17467 2026-04-23 05:50:18,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,542 - lava_callback - DEBUG - Processing node 69e7101660f5826562c17467: baseline-arm-baylibre 2026-04-23 05:50:18,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7101660f5826562c17467 2026-04-23 05:50:18,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:50:18,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,602 - lava_callback - ERROR - Error processing callback for node 69e7101660f5826562c17467: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:51:18,567 - lava_callback - INFO - Received callback for node 69e7105460f5826562c17478 INFO: 172.21.0.1:49816 - "POST /node/69e7105460f5826562c17478 HTTP/1.0" 202 Accepted 2026-04-23 05:51:18,573 - lava_callback - INFO - Starting async job submit for node 69e7105460f5826562c17478 2026-04-23 05:51:18,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,593 - lava_callback - DEBUG - Processing node 69e7105460f5826562c17478: baseline-arm-baylibre 2026-04-23 05:51:18,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7105460f5826562c17478 2026-04-23 05:51:18,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:51:18,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,660 - lava_callback - ERROR - Error processing callback for node 69e7105460f5826562c17478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:51:58,705 - lava_callback - INFO - Received callback for node 69e7107860f5826562c17485 INFO: 172.21.0.1:47774 - "POST /node/69e7107860f5826562c17485 HTTP/1.0" 202 Accepted 2026-04-23 05:51:58,713 - lava_callback - INFO - Starting async job submit for node 69e7107860f5826562c17485 2026-04-23 05:51:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,733 - lava_callback - DEBUG - Processing node 69e7107860f5826562c17485: baseline-arm-baylibre 2026-04-23 05:51:58,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7107860f5826562c17485 2026-04-23 05:51:58,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:51:58,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,781 - lava_callback - ERROR - Error processing callback for node 69e7107860f5826562c17485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:54:28,396 - lava_callback - INFO - Received callback for node 69e7110b60f5826562c17491 INFO: 172.21.0.1:42172 - "POST /node/69e7110b60f5826562c17491 HTTP/1.0" 202 Accepted 2026-04-23 05:54:28,402 - lava_callback - INFO - Starting async job submit for node 69e7110b60f5826562c17491 2026-04-23 05:54:28,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,431 - lava_callback - DEBUG - Processing node 69e7110b60f5826562c17491: baseline-arm-clabbe 2026-04-23 05:54:28,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7110b60f5826562c17491 2026-04-23 05:54:28,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:54:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,497 - lava_callback - ERROR - Error processing callback for node 69e7110b60f5826562c17491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:55:28,458 - lava_callback - INFO - Received callback for node 69e7114760f5826562c1749f INFO: 172.21.0.1:54460 - "POST /node/69e7114760f5826562c1749f HTTP/1.0" 202 Accepted 2026-04-23 05:55:28,463 - lava_callback - INFO - Starting async job submit for node 69e7114760f5826562c1749f 2026-04-23 05:55:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,477 - lava_callback - DEBUG - Processing node 69e7114760f5826562c1749f: baseline-arm-clabbe 2026-04-23 05:55:28,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7114760f5826562c1749f 2026-04-23 05:55:28,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:55:28,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,537 - lava_callback - ERROR - Error processing callback for node 69e7114760f5826562c1749f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:56:28,462 - lava_callback - INFO - Received callback for node 69e7118360f5826562c174b0 INFO: 172.21.0.1:41262 - "POST /node/69e7118360f5826562c174b0 HTTP/1.0" 202 Accepted 2026-04-23 05:56:28,468 - lava_callback - INFO - Starting async job submit for node 69e7118360f5826562c174b0 2026-04-23 05:56:28,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,484 - lava_callback - DEBUG - Processing node 69e7118360f5826562c174b0: baseline-arm-clabbe 2026-04-23 05:56:28,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7118360f5826562c174b0 2026-04-23 05:56:28,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:56:28,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,550 - lava_callback - ERROR - Error processing callback for node 69e7118360f5826562c174b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:57:08,439 - lava_callback - INFO - Received callback for node 69e711a860f5826562c174bd INFO: 172.21.0.1:46400 - "POST /node/69e711a860f5826562c174bd HTTP/1.0" 202 Accepted 2026-04-23 05:57:08,444 - lava_callback - INFO - Starting async job submit for node 69e711a860f5826562c174bd 2026-04-23 05:57:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,459 - lava_callback - DEBUG - Processing node 69e711a860f5826562c174bd: baseline-arm-clabbe 2026-04-23 05:57:08,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711a860f5826562c174bd 2026-04-23 05:57:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:57:08,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,511 - lava_callback - ERROR - Error processing callback for node 69e711a860f5826562c174bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:57:48,676 - lava_callback - INFO - Received callback for node 69e711cd60f5826562c174cb INFO: 172.21.0.1:53054 - "POST /node/69e711cd60f5826562c174cb HTTP/1.0" 202 Accepted 2026-04-23 05:57:48,682 - lava_callback - INFO - Starting async job submit for node 69e711cd60f5826562c174cb 2026-04-23 05:57:48,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,701 - lava_callback - DEBUG - Processing node 69e711cd60f5826562c174cb: baseline-arm-clabbe 2026-04-23 05:57:48,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711cd60f5826562c174cb 2026-04-23 05:57:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:57:48,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,747 - lava_callback - ERROR - Error processing callback for node 69e711cd60f5826562c174cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:58:39,090 - lava_callback - INFO - Received callback for node 69e711fa60f5826562c174dc INFO: 172.21.0.1:37424 - "POST /node/69e711fa60f5826562c174dc HTTP/1.0" 202 Accepted 2026-04-23 05:58:39,096 - lava_callback - INFO - Starting async job submit for node 69e711fa60f5826562c174dc 2026-04-23 05:58:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,117 - lava_callback - DEBUG - Processing node 69e711fa60f5826562c174dc: baseline-arm64-baylibre 2026-04-23 05:58:39,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711fa60f5826562c174dc 2026-04-23 05:58:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 05:58:39,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,179 - lava_callback - ERROR - Error processing callback for node 69e711fa60f5826562c174dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:59:48,619 - lava_callback - INFO - Received callback for node 69e7124660f5826562c17502 INFO: 172.21.0.1:40134 - "POST /node/69e7124660f5826562c17502 HTTP/1.0" 202 Accepted 2026-04-23 05:59:48,624 - lava_callback - INFO - Starting async job submit for node 69e7124660f5826562c17502 2026-04-23 05:59:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,640 - lava_callback - DEBUG - Processing node 69e7124660f5826562c17502: baseline-arm-clabbe 2026-04-23 05:59:48,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7124660f5826562c17502 2026-04-23 05:59:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:59:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,684 - lava_callback - ERROR - Error processing callback for node 69e7124660f5826562c17502: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:00:28,627 - lava_callback - INFO - Received callback for node 69e7126c60f5826562c17511 INFO: 172.21.0.1:49300 - "POST /node/69e7126c60f5826562c17511 HTTP/1.0" 202 Accepted 2026-04-23 06:00:28,633 - lava_callback - INFO - Starting async job submit for node 69e7126c60f5826562c17511 2026-04-23 06:00:28,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,648 - lava_callback - DEBUG - Processing node 69e7126c60f5826562c17511: baseline-arm-clabbe 2026-04-23 06:00:28,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7126c60f5826562c17511 2026-04-23 06:00:28,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:00:28,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,692 - lava_callback - ERROR - Error processing callback for node 69e7126c60f5826562c17511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:01:08,710 - lava_callback - INFO - Received callback for node 69e712a060f5826562c17520 INFO: 172.21.0.1:38816 - "POST /node/69e712a060f5826562c17520 HTTP/1.0" 202 Accepted 2026-04-23 06:01:08,715 - lava_callback - INFO - Starting async job submit for node 69e712a060f5826562c17520 2026-04-23 06:01:08,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,732 - lava_callback - DEBUG - Processing node 69e712a060f5826562c17520: baseline-arm64-clabbe 2026-04-23 06:01:08,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e712a060f5826562c17520 2026-04-23 06:01:08,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:01:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,788 - lava_callback - ERROR - Error processing callback for node 69e712a060f5826562c17520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:02:28,746 - lava_callback - INFO - Received callback for node 69e712e260f5826562c17540 INFO: 172.21.0.1:45256 - "POST /node/69e712e260f5826562c17540 HTTP/1.0" 202 Accepted 2026-04-23 06:02:28,752 - lava_callback - INFO - Starting async job submit for node 69e712e260f5826562c17540 2026-04-23 06:02:28,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,774 - lava_callback - DEBUG - Processing node 69e712e260f5826562c17540: baseline-arm-clabbe 2026-04-23 06:02:28,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e712e260f5826562c17540 2026-04-23 06:02:28,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:02:28,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,853 - lava_callback - ERROR - Error processing callback for node 69e712e260f5826562c17540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:03:08,728 - lava_callback - INFO - Received callback for node 69e7130860f5826562c1754d INFO: 172.21.0.1:43010 - "POST /node/69e7130860f5826562c1754d HTTP/1.0" 202 Accepted 2026-04-23 06:03:08,735 - lava_callback - INFO - Starting async job submit for node 69e7130860f5826562c1754d 2026-04-23 06:03:08,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,750 - lava_callback - DEBUG - Processing node 69e7130860f5826562c1754d: baseline-arm-clabbe 2026-04-23 06:03:08,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7130860f5826562c1754d 2026-04-23 06:03:08,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:03:08,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,804 - lava_callback - ERROR - Error processing callback for node 69e7130860f5826562c1754d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:03:48,789 - lava_callback - INFO - Received callback for node 69e7133c60f5826562c17560 INFO: 172.21.0.1:59474 - "POST /node/69e7133c60f5826562c17560 HTTP/1.0" 202 Accepted 2026-04-23 06:03:48,795 - lava_callback - INFO - Starting async job submit for node 69e7133c60f5826562c17560 2026-04-23 06:03:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,821 - lava_callback - DEBUG - Processing node 69e7133c60f5826562c17560: baseline-arm64-clabbe 2026-04-23 06:03:48,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7133c60f5826562c17560 2026-04-23 06:03:48,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:03:48,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,866 - lava_callback - ERROR - Error processing callback for node 69e7133c60f5826562c17560: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:05:08,795 - lava_callback - INFO - Received callback for node 69e7137f60f5826562c1757e INFO: 172.21.0.1:57398 - "POST /node/69e7137f60f5826562c1757e HTTP/1.0" 202 Accepted 2026-04-23 06:05:08,800 - lava_callback - INFO - Starting async job submit for node 69e7137f60f5826562c1757e 2026-04-23 06:05:08,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,815 - lava_callback - DEBUG - Processing node 69e7137f60f5826562c1757e: baseline-arm-clabbe 2026-04-23 06:05:08,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7137f60f5826562c1757e 2026-04-23 06:05:08,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:05:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,865 - lava_callback - ERROR - Error processing callback for node 69e7137f60f5826562c1757e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:05:48,855 - lava_callback - INFO - Received callback for node 69e713b260f5826562c17592 INFO: 172.21.0.1:41652 - "POST /node/69e713b260f5826562c17592 HTTP/1.0" 202 Accepted 2026-04-23 06:05:48,860 - lava_callback - INFO - Starting async job submit for node 69e713b260f5826562c17592 2026-04-23 06:05:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,877 - lava_callback - DEBUG - Processing node 69e713b260f5826562c17592: baseline-arm64-clabbe 2026-04-23 06:05:48,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e713b260f5826562c17592 2026-04-23 06:05:48,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:05:48,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,935 - lava_callback - ERROR - Error processing callback for node 69e713b260f5826562c17592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:06:48,947 - lava_callback - INFO - Received callback for node 69e713f360f5826562c175b1 INFO: 172.21.0.1:49640 - "POST /node/69e713f360f5826562c175b1 HTTP/1.0" 202 Accepted 2026-04-23 06:06:48,953 - lava_callback - INFO - Starting async job submit for node 69e713f360f5826562c175b1 2026-04-23 06:06:48,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:48,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:48,979 - lava_callback - DEBUG - Processing node 69e713f360f5826562c175b1: baseline-arm-clabbe 2026-04-23 06:06:48,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e713f360f5826562c175b1 2026-04-23 06:06:48,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:48,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:06:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:49,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:49,030 - lava_callback - ERROR - Error processing callback for node 69e713f360f5826562c175b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:07:48,992 - lava_callback - INFO - Received callback for node 69e7142660f5826562c175c3 INFO: 172.21.0.1:53156 - "POST /node/69e7142660f5826562c175c3 HTTP/1.0" 202 Accepted 2026-04-23 06:07:48,998 - lava_callback - INFO - Starting async job submit for node 69e7142660f5826562c175c3 2026-04-23 06:07:48,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,012 - lava_callback - DEBUG - Processing node 69e7142660f5826562c175c3: baseline-arm64-clabbe 2026-04-23 06:07:49,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7142660f5826562c175c3 2026-04-23 06:07:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:07:49,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,056 - lava_callback - ERROR - Error processing callback for node 69e7142660f5826562c175c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:08:49,058 - lava_callback - INFO - Received callback for node 69e7146960f5826562c175df INFO: 172.21.0.1:40538 - "POST /node/69e7146960f5826562c175df HTTP/1.0" 202 Accepted 2026-04-23 06:08:49,063 - lava_callback - INFO - Starting async job submit for node 69e7146960f5826562c175df 2026-04-23 06:08:49,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,087 - lava_callback - DEBUG - Processing node 69e7146960f5826562c175df: baseline-arm-clabbe 2026-04-23 06:08:49,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7146960f5826562c175df 2026-04-23 06:08:49,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:08:49,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,137 - lava_callback - ERROR - Error processing callback for node 69e7146960f5826562c175df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:09:29,017 - lava_callback - INFO - Received callback for node 69e7149060f5826562c175ee INFO: 172.21.0.1:38170 - "POST /node/69e7149060f5826562c175ee HTTP/1.0" 202 Accepted 2026-04-23 06:09:29,022 - lava_callback - INFO - Starting async job submit for node 69e7149060f5826562c175ee 2026-04-23 06:09:29,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,037 - lava_callback - DEBUG - Processing node 69e7149060f5826562c175ee: baseline-arm-clabbe 2026-04-23 06:09:29,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7149060f5826562c175ee 2026-04-23 06:09:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:09:29,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,093 - lava_callback - ERROR - Error processing callback for node 69e7149060f5826562c175ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:10:29,076 - lava_callback - INFO - Received callback for node 69e714c360f5826562c175fa INFO: 172.21.0.1:38792 - "POST /node/69e714c360f5826562c175fa HTTP/1.0" 202 Accepted 2026-04-23 06:10:29,081 - lava_callback - INFO - Starting async job submit for node 69e714c360f5826562c175fa 2026-04-23 06:10:29,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,097 - lava_callback - DEBUG - Processing node 69e714c360f5826562c175fa: baseline-arm64-clabbe 2026-04-23 06:10:29,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e714c360f5826562c175fa 2026-04-23 06:10:29,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:10:29,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,153 - lava_callback - ERROR - Error processing callback for node 69e714c360f5826562c175fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:11:49,143 - lava_callback - INFO - Received callback for node 69e7151460f5826562c17620 INFO: 172.21.0.1:60640 - "POST /node/69e7151460f5826562c17620 HTTP/1.0" 202 Accepted 2026-04-23 06:11:49,148 - lava_callback - INFO - Starting async job submit for node 69e7151460f5826562c17620 2026-04-23 06:11:49,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,163 - lava_callback - DEBUG - Processing node 69e7151460f5826562c17620: baseline-arm64-clabbe 2026-04-23 06:11:49,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7151460f5826562c17620 2026-04-23 06:11:49,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:11:49,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,221 - lava_callback - ERROR - Error processing callback for node 69e7151460f5826562c17620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:12:49,228 - lava_callback - INFO - Received callback for node 69e7155560f5826562c1763c INFO: 172.21.0.1:53230 - "POST /node/69e7155560f5826562c1763c HTTP/1.0" 202 Accepted 2026-04-23 06:12:49,233 - lava_callback - INFO - Starting async job submit for node 69e7155560f5826562c1763c 2026-04-23 06:12:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,249 - lava_callback - DEBUG - Processing node 69e7155560f5826562c1763c: baseline-arm-clabbe 2026-04-23 06:12:49,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7155560f5826562c1763c 2026-04-23 06:12:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:12:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,302 - lava_callback - ERROR - Error processing callback for node 69e7155560f5826562c1763c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:13:49,256 - lava_callback - INFO - Received callback for node 69e7158960f5826562c1764f INFO: 172.21.0.1:53170 - "POST /node/69e7158960f5826562c1764f HTTP/1.0" 202 Accepted 2026-04-23 06:13:49,261 - lava_callback - INFO - Starting async job submit for node 69e7158960f5826562c1764f 2026-04-23 06:13:49,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,277 - lava_callback - DEBUG - Processing node 69e7158960f5826562c1764f: baseline-arm64-clabbe 2026-04-23 06:13:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7158960f5826562c1764f 2026-04-23 06:13:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:13:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,330 - lava_callback - ERROR - Error processing callback for node 69e7158960f5826562c1764f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:14:49,257 - lava_callback - INFO - Received callback for node 69e715cb60f5826562c17667 INFO: 172.21.0.1:39030 - "POST /node/69e715cb60f5826562c17667 HTTP/1.0" 202 Accepted 2026-04-23 06:14:49,262 - lava_callback - INFO - Starting async job submit for node 69e715cb60f5826562c17667 2026-04-23 06:14:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,276 - lava_callback - DEBUG - Processing node 69e715cb60f5826562c17667: baseline-arm-clabbe 2026-04-23 06:14:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e715cb60f5826562c17667 2026-04-23 06:14:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:14:49,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,327 - lava_callback - ERROR - Error processing callback for node 69e715cb60f5826562c17667: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:15:29,240 - lava_callback - INFO - Received callback for node 69e715f060f5826562c17672 INFO: 172.21.0.1:40874 - "POST /node/69e715f060f5826562c17672 HTTP/1.0" 202 Accepted 2026-04-23 06:15:29,245 - lava_callback - INFO - Starting async job submit for node 69e715f060f5826562c17672 2026-04-23 06:15:29,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,305 - lava_callback - DEBUG - Processing node 69e715f060f5826562c17672: baseline-arm-clabbe 2026-04-23 06:15:29,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e715f060f5826562c17672 2026-04-23 06:15:29,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:15:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,424 - lava_callback - ERROR - Error processing callback for node 69e715f060f5826562c17672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:16:09,345 - lava_callback - INFO - Received callback for node 69e7161560f5826562c1767d INFO: 172.21.0.1:33934 - "POST /node/69e7161560f5826562c1767d HTTP/1.0" 202 Accepted 2026-04-23 06:16:09,351 - lava_callback - INFO - Starting async job submit for node 69e7161560f5826562c1767d 2026-04-23 06:16:09,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,367 - lava_callback - DEBUG - Processing node 69e7161560f5826562c1767d: baseline-arm-clabbe 2026-04-23 06:16:09,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7161560f5826562c1767d 2026-04-23 06:16:09,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:16:09,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,415 - lava_callback - ERROR - Error processing callback for node 69e7161560f5826562c1767d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:29:09,945 - lava_callback - INFO - Received callback for node 69e7192a60f5826562c176d1 INFO: 172.21.0.1:53346 - "POST /node/69e7192a60f5826562c176d1 HTTP/1.0" 202 Accepted 2026-04-23 06:29:09,951 - lava_callback - INFO - Starting async job submit for node 69e7192a60f5826562c176d1 2026-04-23 06:29:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:09,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:09,966 - lava_callback - DEBUG - Processing node 69e7192a60f5826562c176d1: baseline-arm-clabbe 2026-04-23 06:29:09,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7192a60f5826562c176d1 2026-04-23 06:29:09,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:09,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:09,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:10,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:29:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:10,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:10,035 - lava_callback - ERROR - Error processing callback for node 69e7192a60f5826562c176d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:29:49,916 - lava_callback - INFO - Received callback for node 69e7194f60f5826562c176df INFO: 172.21.0.1:53778 - "POST /node/69e7194f60f5826562c176df HTTP/1.0" 202 Accepted 2026-04-23 06:29:49,921 - lava_callback - INFO - Starting async job submit for node 69e7194f60f5826562c176df 2026-04-23 06:29:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,937 - lava_callback - DEBUG - Processing node 69e7194f60f5826562c176df: baseline-arm-clabbe 2026-04-23 06:29:49,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7194f60f5826562c176df 2026-04-23 06:29:49,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:29:49,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,986 - lava_callback - ERROR - Error processing callback for node 69e7194f60f5826562c176df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:30:29,989 - lava_callback - INFO - Received callback for node 69e7197560f5826562c176ed INFO: 172.21.0.1:45688 - "POST /node/69e7197560f5826562c176ed HTTP/1.0" 202 Accepted 2026-04-23 06:30:29,995 - lava_callback - INFO - Starting async job submit for node 69e7197560f5826562c176ed 2026-04-23 06:30:29,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,013 - lava_callback - DEBUG - Processing node 69e7197560f5826562c176ed: baseline-arm-clabbe 2026-04-23 06:30:30,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7197560f5826562c176ed 2026-04-23 06:30:30,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:30:30,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,073 - lava_callback - ERROR - Error processing callback for node 69e7197560f5826562c176ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:31:09,983 - lava_callback - INFO - Received callback for node 69e7199a60f5826562c176fc INFO: 172.21.0.1:43838 - "POST /node/69e7199a60f5826562c176fc HTTP/1.0" 202 Accepted 2026-04-23 06:31:09,988 - lava_callback - INFO - Starting async job submit for node 69e7199a60f5826562c176fc 2026-04-23 06:31:09,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,005 - lava_callback - DEBUG - Processing node 69e7199a60f5826562c176fc: baseline-arm-clabbe 2026-04-23 06:31:10,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7199a60f5826562c176fc 2026-04-23 06:31:10,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:31:10,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,052 - lava_callback - ERROR - Error processing callback for node 69e7199a60f5826562c176fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:31:50,041 - lava_callback - INFO - Received callback for node 69e719c160f5826562c1770e INFO: 172.21.0.1:46960 - "POST /node/69e719c160f5826562c1770e HTTP/1.0" 202 Accepted 2026-04-23 06:31:50,046 - lava_callback - INFO - Starting async job submit for node 69e719c160f5826562c1770e 2026-04-23 06:31:50,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,067 - lava_callback - DEBUG - Processing node 69e719c160f5826562c1770e: baseline-arm-clabbe 2026-04-23 06:31:50,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e719c160f5826562c1770e 2026-04-23 06:31:50,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:31:50,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,113 - lava_callback - ERROR - Error processing callback for node 69e719c160f5826562c1770e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:32:09,990 - lava_callback - INFO - Received callback for node 69e719e760f5826562c17719 INFO: 172.21.0.1:36140 - "POST /node/69e719e760f5826562c17719 HTTP/1.0" 202 Accepted 2026-04-23 06:32:09,996 - lava_callback - INFO - Starting async job submit for node 69e719e760f5826562c17719 2026-04-23 06:32:09,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,011 - lava_callback - DEBUG - Processing node 69e719e760f5826562c17719: baseline-arm-clabbe 2026-04-23 06:32:10,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e719e760f5826562c17719 2026-04-23 06:32:10,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:32:10,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,073 - lava_callback - ERROR - Error processing callback for node 69e719e760f5826562c17719: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:32:50,101 - lava_callback - INFO - Received callback for node 69e71a0d60f5826562c1772e INFO: 172.21.0.1:44356 - "POST /node/69e71a0d60f5826562c1772e HTTP/1.0" 202 Accepted 2026-04-23 06:32:50,106 - lava_callback - INFO - Starting async job submit for node 69e71a0d60f5826562c1772e 2026-04-23 06:32:50,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,121 - lava_callback - DEBUG - Processing node 69e71a0d60f5826562c1772e: baseline-arm-clabbe 2026-04-23 06:32:50,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a0d60f5826562c1772e 2026-04-23 06:32:50,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:32:50,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,171 - lava_callback - ERROR - Error processing callback for node 69e71a0d60f5826562c1772e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:34:41,037 - lava_callback - INFO - Received callback for node 69e71a7560f5826562c1778c INFO: 172.21.0.1:59800 - "POST /node/69e71a7560f5826562c1778c HTTP/1.0" 202 Accepted 2026-04-23 06:34:41,043 - lava_callback - INFO - Starting async job submit for node 69e71a7560f5826562c1778c 2026-04-23 06:34:41,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,067 - lava_callback - DEBUG - Processing node 69e71a7560f5826562c1778c: baseline-arm-baylibre 2026-04-23 06:34:41,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a7560f5826562c1778c 2026-04-23 06:34:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:34:41,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,144 - lava_callback - ERROR - Error processing callback for node 69e71a7560f5826562c1778c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:35:20,990 - lava_callback - INFO - Received callback for node 69e71a9960f5826562c17798 INFO: 172.21.0.1:53460 - "POST /node/69e71a9960f5826562c17798 HTTP/1.0" 202 Accepted 2026-04-23 06:35:20,995 - lava_callback - INFO - Starting async job submit for node 69e71a9960f5826562c17798 2026-04-23 06:35:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,010 - lava_callback - DEBUG - Processing node 69e71a9960f5826562c17798: baseline-arm-baylibre 2026-04-23 06:35:21,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a9960f5826562c17798 2026-04-23 06:35:21,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:35:21,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,077 - lava_callback - ERROR - Error processing callback for node 69e71a9960f5826562c17798: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:36:01,145 - lava_callback - INFO - Received callback for node 69e71abe60f5826562c177a7 INFO: 172.21.0.1:40518 - "POST /node/69e71abe60f5826562c177a7 HTTP/1.0" 202 Accepted 2026-04-23 06:36:01,150 - lava_callback - INFO - Starting async job submit for node 69e71abe60f5826562c177a7 2026-04-23 06:36:01,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,167 - lava_callback - DEBUG - Processing node 69e71abe60f5826562c177a7: baseline-arm-baylibre 2026-04-23 06:36:01,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71abe60f5826562c177a7 2026-04-23 06:36:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:36:01,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,218 - lava_callback - ERROR - Error processing callback for node 69e71abe60f5826562c177a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:36:30,209 - lava_callback - INFO - Received callback for node 69e71ae760f5826562c177b4 INFO: 172.21.0.1:55788 - "POST /node/69e71ae760f5826562c177b4 HTTP/1.0" 202 Accepted 2026-04-23 06:36:30,214 - lava_callback - INFO - Starting async job submit for node 69e71ae760f5826562c177b4 2026-04-23 06:36:30,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,230 - lava_callback - DEBUG - Processing node 69e71ae760f5826562c177b4: baseline-arm-clabbe 2026-04-23 06:36:30,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ae760f5826562c177b4 2026-04-23 06:36:30,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:36:30,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,287 - lava_callback - ERROR - Error processing callback for node 69e71ae760f5826562c177b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:37:01,099 - lava_callback - INFO - Received callback for node 69e71b0860f5826562c177c1 INFO: 172.21.0.1:43806 - "POST /node/69e71b0860f5826562c177c1 HTTP/1.0" 202 Accepted 2026-04-23 06:37:01,104 - lava_callback - INFO - Starting async job submit for node 69e71b0860f5826562c177c1 2026-04-23 06:37:01,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,120 - lava_callback - DEBUG - Processing node 69e71b0860f5826562c177c1: baseline-arm-baylibre 2026-04-23 06:37:01,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b0860f5826562c177c1 2026-04-23 06:37:01,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:37:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,167 - lava_callback - ERROR - Error processing callback for node 69e71b0860f5826562c177c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:37:41,235 - lava_callback - INFO - Received callback for node 69e71b2e60f5826562c177ca INFO: 172.21.0.1:39584 - "POST /node/69e71b2e60f5826562c177ca HTTP/1.0" 202 Accepted 2026-04-23 06:37:41,241 - lava_callback - INFO - Starting async job submit for node 69e71b2e60f5826562c177ca 2026-04-23 06:37:41,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,278 - lava_callback - DEBUG - Processing node 69e71b2e60f5826562c177ca: baseline-arm-baylibre 2026-04-23 06:37:41,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b2e60f5826562c177ca 2026-04-23 06:37:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:37:41,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,352 - lava_callback - ERROR - Error processing callback for node 69e71b2e60f5826562c177ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:38:21,180 - lava_callback - INFO - Received callback for node 69e71b5260f5826562c177d5 INFO: 172.21.0.1:56592 - "POST /node/69e71b5260f5826562c177d5 HTTP/1.0" 202 Accepted 2026-04-23 06:38:21,185 - lava_callback - INFO - Starting async job submit for node 69e71b5260f5826562c177d5 2026-04-23 06:38:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,201 - lava_callback - DEBUG - Processing node 69e71b5260f5826562c177d5: baseline-arm-baylibre 2026-04-23 06:38:21,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b5260f5826562c177d5 2026-04-23 06:38:21,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:38:21,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,246 - lava_callback - ERROR - Error processing callback for node 69e71b5260f5826562c177d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:39:24,892 - lava_callback - INFO - Received callback for node 69e904bd8327522856daf238 INFO: 172.21.0.1:40342 - "POST /node/69e904bd8327522856daf238 HTTP/1.0" 202 Accepted 2026-04-23 06:39:24,897 - lava_callback - INFO - Starting async job submit for node 69e904bd8327522856daf238 2026-04-23 06:39:24,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:24,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:24,939 - lava_callback - DEBUG - Processing node 69e904bd8327522856daf238: baseline-arm64-broonie 2026-04-23 06:39:25,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/log.txt.gz 2026-04-23 06:39:25,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/lava-logs.yaml 2026-04-23 06:39:25,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/lava_callback.json.gz 2026-04-23 06:39:25,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:25,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:39:25,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:25,791 - lava_callback - INFO - Completed processing callback for node 69e904bd8327522856daf238 2026-04-23 06:39:26,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:26,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:10,361 - lava_callback - INFO - Received callback for node 69e71bc160f5826562c177fd INFO: 172.21.0.1:43816 - "POST /node/69e71bc160f5826562c177fd HTTP/1.0" 202 Accepted 2026-04-23 06:40:10,367 - lava_callback - INFO - Starting async job submit for node 69e71bc160f5826562c177fd 2026-04-23 06:40:10,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,381 - lava_callback - DEBUG - Processing node 69e71bc160f5826562c177fd: baseline-arm-clabbe 2026-04-23 06:40:10,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71bc160f5826562c177fd 2026-04-23 06:40:10,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:40:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,427 - lava_callback - ERROR - Error processing callback for node 69e71bc160f5826562c177fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:24,592 - lava_callback - INFO - Received callback for node 69e95df48327522856db19be INFO: 172.21.0.1:34248 - "POST /node/69e95df48327522856db19be HTTP/1.0" 202 Accepted 2026-04-23 06:40:24,598 - lava_callback - INFO - Starting async job submit for node 69e95df48327522856db19be 2026-04-23 06:40:24,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:24,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:24,636 - lava_callback - DEBUG - Processing node 69e95df48327522856db19be: baseline-arm64-broonie 2026-04-23 06:40:24,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:24,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:24,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/log.txt.gz 2026-04-23 06:40:25,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:25,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:25,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/lava-logs.yaml 2026-04-23 06:40:25,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:25,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:25,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/lava_callback.json.gz 2026-04-23 06:40:25,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:40:25,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:25,466 - lava_callback - INFO - Completed processing callback for node 69e95df48327522856db19be 2026-04-23 06:40:26,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:26,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:50,367 - lava_callback - INFO - Received callback for node 69e71be760f5826562c17809 INFO: 172.21.0.1:54480 - "POST /node/69e71be760f5826562c17809 HTTP/1.0" 202 Accepted 2026-04-23 06:40:50,372 - lava_callback - INFO - Starting async job submit for node 69e71be760f5826562c17809 2026-04-23 06:40:50,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,393 - lava_callback - DEBUG - Processing node 69e71be760f5826562c17809: baseline-arm-clabbe 2026-04-23 06:40:50,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71be760f5826562c17809 2026-04-23 06:40:50,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:40:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,469 - lava_callback - ERROR - Error processing callback for node 69e71be760f5826562c17809: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:04,453 - lava_callback - INFO - Received callback for node 69e985a78137cb226ce20275 INFO: 172.21.0.1:46578 - "POST /node/69e985a78137cb226ce20275 HTTP/1.0" 202 Accepted 2026-04-23 06:41:04,459 - lava_callback - INFO - Starting async job submit for node 69e985a78137cb226ce20275 2026-04-23 06:41:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:04,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:04,496 - lava_callback - DEBUG - Processing node 69e985a78137cb226ce20275: baseline-arm64-broonie 2026-04-23 06:41:04,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:04,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:04,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/log.txt.gz 2026-04-23 06:41:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:05,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:05,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/lava-logs.yaml 2026-04-23 06:41:05,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:05,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:05,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/lava_callback.json.gz 2026-04-23 06:41:05,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:05,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 06:41:05,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:05,395 - lava_callback - INFO - Completed processing callback for node 69e985a78137cb226ce20275 INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:26,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:26,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:30,411 - lava_callback - INFO - Received callback for node 69e71c0d60f5826562c17819 INFO: 172.21.0.1:50452 - "POST /node/69e71c0d60f5826562c17819 HTTP/1.0" 202 Accepted 2026-04-23 06:41:30,416 - lava_callback - INFO - Starting async job submit for node 69e71c0d60f5826562c17819 2026-04-23 06:41:30,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,439 - lava_callback - DEBUG - Processing node 69e71c0d60f5826562c17819: baseline-arm-clabbe 2026-04-23 06:41:30,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c0d60f5826562c17819 2026-04-23 06:41:30,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:41:30,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,495 - lava_callback - ERROR - Error processing callback for node 69e71c0d60f5826562c17819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:44,887 - lava_callback - INFO - Received callback for node 69e9b2a08137cb226ce21734 INFO: 172.21.0.1:51032 - "POST /node/69e9b2a08137cb226ce21734 HTTP/1.0" 202 Accepted 2026-04-23 06:41:44,892 - lava_callback - INFO - Starting async job submit for node 69e9b2a08137cb226ce21734 2026-04-23 06:41:44,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:44,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:44,946 - lava_callback - DEBUG - Processing node 69e9b2a08137cb226ce21734: baseline-arm64-broonie 2026-04-23 06:41:45,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/log.txt.gz 2026-04-23 06:41:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,731 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/lava-logs.yaml 2026-04-23 06:41:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/lava_callback.json.gz 2026-04-23 06:41:45,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:45,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:41:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:45,984 - lava_callback - INFO - Completed processing callback for node 69e9b2a08137cb226ce21734 INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:56,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:42:10,420 - lava_callback - INFO - Received callback for node 69e71c3260f5826562c17826 INFO: 172.21.0.1:40356 - "POST /node/69e71c3260f5826562c17826 HTTP/1.0" 202 Accepted 2026-04-23 06:42:10,425 - lava_callback - INFO - Starting async job submit for node 69e71c3260f5826562c17826 2026-04-23 06:42:10,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,440 - lava_callback - DEBUG - Processing node 69e71c3260f5826562c17826: baseline-arm-clabbe 2026-04-23 06:42:10,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c3260f5826562c17826 2026-04-23 06:42:10,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:42:10,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,491 - lava_callback - ERROR - Error processing callback for node 69e71c3260f5826562c17826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:42:50,479 - lava_callback - INFO - Received callback for node 69e71c5860f5826562c17831 INFO: 172.21.0.1:45590 - "POST /node/69e71c5860f5826562c17831 HTTP/1.0" 202 Accepted 2026-04-23 06:42:50,485 - lava_callback - INFO - Starting async job submit for node 69e71c5860f5826562c17831 2026-04-23 06:42:50,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,504 - lava_callback - DEBUG - Processing node 69e71c5860f5826562c17831: baseline-arm-clabbe 2026-04-23 06:42:50,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c5860f5826562c17831 2026-04-23 06:42:50,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:42:50,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,552 - lava_callback - ERROR - Error processing callback for node 69e71c5860f5826562c17831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:43:30,547 - lava_callback - INFO - Received callback for node 69e71c7f60f5826562c1783e INFO: 172.21.0.1:46314 - "POST /node/69e71c7f60f5826562c1783e HTTP/1.0" 202 Accepted 2026-04-23 06:43:30,552 - lava_callback - INFO - Starting async job submit for node 69e71c7f60f5826562c1783e 2026-04-23 06:43:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,572 - lava_callback - DEBUG - Processing node 69e71c7f60f5826562c1783e: baseline-arm-clabbe 2026-04-23 06:43:30,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c7f60f5826562c1783e 2026-04-23 06:43:30,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:43:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,620 - lava_callback - ERROR - Error processing callback for node 69e71c7f60f5826562c1783e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:44:10,555 - lava_callback - INFO - Received callback for node 69e71ca660f5826562c1784e INFO: 172.21.0.1:51342 - "POST /node/69e71ca660f5826562c1784e HTTP/1.0" 202 Accepted 2026-04-23 06:44:10,561 - lava_callback - INFO - Starting async job submit for node 69e71ca660f5826562c1784e 2026-04-23 06:44:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,576 - lava_callback - DEBUG - Processing node 69e71ca660f5826562c1784e: baseline-arm-clabbe 2026-04-23 06:44:10,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ca660f5826562c1784e 2026-04-23 06:44:10,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:44:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,632 - lava_callback - ERROR - Error processing callback for node 69e71ca660f5826562c1784e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:44:50,534 - lava_callback - INFO - Received callback for node 69e71ccc60f5826562c1785b INFO: 172.21.0.1:42458 - "POST /node/69e71ccc60f5826562c1785b HTTP/1.0" 202 Accepted 2026-04-23 06:44:50,540 - lava_callback - INFO - Starting async job submit for node 69e71ccc60f5826562c1785b 2026-04-23 06:44:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,555 - lava_callback - DEBUG - Processing node 69e71ccc60f5826562c1785b: baseline-arm-clabbe 2026-04-23 06:44:50,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ccc60f5826562c1785b 2026-04-23 06:44:50,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:44:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,614 - lava_callback - ERROR - Error processing callback for node 69e71ccc60f5826562c1785b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:45:10,534 - lava_callback - INFO - Received callback for node 69e71cf160f5826562c17864 INFO: 172.21.0.1:37930 - "POST /node/69e71cf160f5826562c17864 HTTP/1.0" 202 Accepted 2026-04-23 06:45:10,539 - lava_callback - INFO - Starting async job submit for node 69e71cf160f5826562c17864 2026-04-23 06:45:10,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,556 - lava_callback - DEBUG - Processing node 69e71cf160f5826562c17864: baseline-arm-clabbe 2026-04-23 06:45:10,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71cf160f5826562c17864 2026-04-23 06:45:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:45:10,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,615 - lava_callback - ERROR - Error processing callback for node 69e71cf160f5826562c17864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:45:50,572 - lava_callback - INFO - Received callback for node 69e71d1660f5826562c17870 INFO: 172.21.0.1:34806 - "POST /node/69e71d1660f5826562c17870 HTTP/1.0" 202 Accepted 2026-04-23 06:45:50,578 - lava_callback - INFO - Starting async job submit for node 69e71d1660f5826562c17870 2026-04-23 06:45:50,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,617 - lava_callback - DEBUG - Processing node 69e71d1660f5826562c17870: baseline-arm-clabbe 2026-04-23 06:45:50,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71d1660f5826562c17870 2026-04-23 06:45:50,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:45:50,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,664 - lava_callback - ERROR - Error processing callback for node 69e71d1660f5826562c17870: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:04:02,654 - lava_callback - INFO - Received callback for node 69e7215560f5826562c17a32 INFO: 172.21.0.1:52958 - "POST /node/69e7215560f5826562c17a32 HTTP/1.0" 202 Accepted 2026-04-23 07:04:02,659 - lava_callback - INFO - Starting async job submit for node 69e7215560f5826562c17a32 2026-04-23 07:04:02,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,674 - lava_callback - DEBUG - Processing node 69e7215560f5826562c17a32: baseline-arm64-baylibre 2026-04-23 07:04:02,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7215560f5826562c17a32 2026-04-23 07:04:02,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:04:02,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,730 - lava_callback - ERROR - Error processing callback for node 69e7215560f5826562c17a32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:05:22,690 - lava_callback - INFO - Received callback for node 69e721a660f5826562c17a58 INFO: 172.21.0.1:54640 - "POST /node/69e721a660f5826562c17a58 HTTP/1.0" 202 Accepted 2026-04-23 07:05:22,695 - lava_callback - INFO - Starting async job submit for node 69e721a660f5826562c17a58 2026-04-23 07:05:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,712 - lava_callback - DEBUG - Processing node 69e721a660f5826562c17a58: baseline-arm64-baylibre 2026-04-23 07:05:22,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e721a660f5826562c17a58 2026-04-23 07:05:22,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:05:22,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,757 - lava_callback - ERROR - Error processing callback for node 69e721a660f5826562c17a58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:06:42,677 - lava_callback - INFO - Received callback for node 69e721f560f5826562c17a7f INFO: 172.21.0.1:33890 - "POST /node/69e721f560f5826562c17a7f HTTP/1.0" 202 Accepted 2026-04-23 07:06:42,683 - lava_callback - INFO - Starting async job submit for node 69e721f560f5826562c17a7f 2026-04-23 07:06:42,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,698 - lava_callback - DEBUG - Processing node 69e721f560f5826562c17a7f: baseline-arm64-baylibre 2026-04-23 07:06:42,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e721f560f5826562c17a7f 2026-04-23 07:06:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:06:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,751 - lava_callback - ERROR - Error processing callback for node 69e721f560f5826562c17a7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:08:02,864 - lava_callback - INFO - Received callback for node 69e7224860f5826562c17aa2 INFO: 172.21.0.1:39766 - "POST /node/69e7224860f5826562c17aa2 HTTP/1.0" 202 Accepted 2026-04-23 07:08:02,870 - lava_callback - INFO - Starting async job submit for node 69e7224860f5826562c17aa2 2026-04-23 07:08:02,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,885 - lava_callback - DEBUG - Processing node 69e7224860f5826562c17aa2: baseline-arm64-baylibre 2026-04-23 07:08:02,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7224860f5826562c17aa2 2026-04-23 07:08:02,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:08:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,950 - lava_callback - ERROR - Error processing callback for node 69e7224860f5826562c17aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:09:22,957 - lava_callback - INFO - Received callback for node 69e7229a60f5826562c17ac5 INFO: 172.21.0.1:33336 - "POST /node/69e7229a60f5826562c17ac5 HTTP/1.0" 202 Accepted 2026-04-23 07:09:22,963 - lava_callback - INFO - Starting async job submit for node 69e7229a60f5826562c17ac5 2026-04-23 07:09:22,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:22,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:22,977 - lava_callback - DEBUG - Processing node 69e7229a60f5826562c17ac5: baseline-arm64-baylibre 2026-04-23 07:09:22,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7229a60f5826562c17ac5 2026-04-23 07:09:22,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:09:23,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:23,033 - lava_callback - ERROR - Error processing callback for node 69e7229a60f5826562c17ac5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:10:42,992 - lava_callback - INFO - Received callback for node 69e722ec60f5826562c17aec INFO: 172.21.0.1:44004 - "POST /node/69e722ec60f5826562c17aec HTTP/1.0" 202 Accepted 2026-04-23 07:10:42,998 - lava_callback - INFO - Starting async job submit for node 69e722ec60f5826562c17aec 2026-04-23 07:10:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,020 - lava_callback - DEBUG - Processing node 69e722ec60f5826562c17aec: baseline-arm64-baylibre 2026-04-23 07:10:43,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e722ec60f5826562c17aec 2026-04-23 07:10:43,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:10:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,101 - lava_callback - ERROR - Error processing callback for node 69e722ec60f5826562c17aec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:12:11,791 - lava_callback - INFO - Received callback for node 69e7234160f5826562c17b18 INFO: 172.21.0.1:47664 - "POST /node/69e7234160f5826562c17b18 HTTP/1.0" 202 Accepted 2026-04-23 07:12:11,797 - lava_callback - INFO - Starting async job submit for node 69e7234160f5826562c17b18 2026-04-23 07:12:11,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,817 - lava_callback - DEBUG - Processing node 69e7234160f5826562c17b18: baseline-arm64-clabbe 2026-04-23 07:12:11,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7234160f5826562c17b18 2026-04-23 07:12:11,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:12:11,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,867 - lava_callback - ERROR - Error processing callback for node 69e7234160f5826562c17b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:13:31,813 - lava_callback - INFO - Received callback for node 69e7239260f5826562c17b3c INFO: 172.21.0.1:54630 - "POST /node/69e7239260f5826562c17b3c HTTP/1.0" 202 Accepted 2026-04-23 07:13:31,818 - lava_callback - INFO - Starting async job submit for node 69e7239260f5826562c17b3c 2026-04-23 07:13:31,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,834 - lava_callback - DEBUG - Processing node 69e7239260f5826562c17b3c: baseline-arm64-clabbe 2026-04-23 07:13:31,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7239260f5826562c17b3c 2026-04-23 07:13:31,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:13:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,883 - lava_callback - ERROR - Error processing callback for node 69e7239260f5826562c17b3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:14:51,850 - lava_callback - INFO - Received callback for node 69e723e160f5826562c17b5d INFO: 172.21.0.1:44360 - "POST /node/69e723e160f5826562c17b5d HTTP/1.0" 202 Accepted 2026-04-23 07:14:51,856 - lava_callback - INFO - Starting async job submit for node 69e723e160f5826562c17b5d 2026-04-23 07:14:51,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,875 - lava_callback - DEBUG - Processing node 69e723e160f5826562c17b5d: baseline-arm64-clabbe 2026-04-23 07:14:51,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e723e160f5826562c17b5d 2026-04-23 07:14:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:14:51,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,995 - lava_callback - ERROR - Error processing callback for node 69e723e160f5826562c17b5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:16:11,924 - lava_callback - INFO - Received callback for node 69e7243160f5826562c17b81 INFO: 172.21.0.1:51018 - "POST /node/69e7243160f5826562c17b81 HTTP/1.0" 202 Accepted 2026-04-23 07:16:11,930 - lava_callback - INFO - Starting async job submit for node 69e7243160f5826562c17b81 2026-04-23 07:16:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:11,952 - lava_callback - DEBUG - Processing node 69e7243160f5826562c17b81: baseline-arm64-clabbe 2026-04-23 07:16:11,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7243160f5826562c17b81 2026-04-23 07:16:11,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:11,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:16:11,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:12,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:12,003 - lava_callback - ERROR - Error processing callback for node 69e7243160f5826562c17b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:17:51,991 - lava_callback - INFO - Received callback for node 69e7248a60f5826562c17ba1 INFO: 172.21.0.1:55518 - "POST /node/69e7248a60f5826562c17ba1 HTTP/1.0" 202 Accepted 2026-04-23 07:17:51,996 - lava_callback - INFO - Starting async job submit for node 69e7248a60f5826562c17ba1 2026-04-23 07:17:51,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,012 - lava_callback - DEBUG - Processing node 69e7248a60f5826562c17ba1: baseline-arm64-clabbe 2026-04-23 07:17:52,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7248a60f5826562c17ba1 2026-04-23 07:17:52,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:17:52,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,085 - lava_callback - ERROR - Error processing callback for node 69e7248a60f5826562c17ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:19:12,058 - lava_callback - INFO - Received callback for node 69e724de60f5826562c17bb8 INFO: 172.21.0.1:33404 - "POST /node/69e724de60f5826562c17bb8 HTTP/1.0" 202 Accepted 2026-04-23 07:19:12,064 - lava_callback - INFO - Starting async job submit for node 69e724de60f5826562c17bb8 2026-04-23 07:19:12,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,085 - lava_callback - DEBUG - Processing node 69e724de60f5826562c17bb8: baseline-arm64-clabbe 2026-04-23 07:19:12,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e724de60f5826562c17bb8 2026-04-23 07:19:12,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:19:12,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,147 - lava_callback - ERROR - Error processing callback for node 69e724de60f5826562c17bb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:30:03,976 - lava_callback - INFO - Received callback for node 69e72774fbd3a2737e5416b4 INFO: 172.21.0.1:37370 - "POST /node/69e72774fbd3a2737e5416b4 HTTP/1.0" 202 Accepted 2026-04-23 07:30:03,981 - lava_callback - INFO - Starting async job submit for node 69e72774fbd3a2737e5416b4 2026-04-23 07:30:03,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,004 - lava_callback - DEBUG - Processing node 69e72774fbd3a2737e5416b4: baseline-arm64-baylibre 2026-04-23 07:30:04,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72774fbd3a2737e5416b4 2026-04-23 07:30:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:30:04,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,064 - lava_callback - ERROR - Error processing callback for node 69e72774fbd3a2737e5416b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:31:24,123 - lava_callback - INFO - Received callback for node 69e727c2fbd3a2737e5416d8 INFO: 172.21.0.1:38220 - "POST /node/69e727c2fbd3a2737e5416d8 HTTP/1.0" 202 Accepted 2026-04-23 07:31:24,130 - lava_callback - INFO - Starting async job submit for node 69e727c2fbd3a2737e5416d8 2026-04-23 07:31:24,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,151 - lava_callback - DEBUG - Processing node 69e727c2fbd3a2737e5416d8: baseline-arm64-baylibre 2026-04-23 07:31:24,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e727c2fbd3a2737e5416d8 2026-04-23 07:31:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:31:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,205 - lava_callback - ERROR - Error processing callback for node 69e727c2fbd3a2737e5416d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:33:04,221 - lava_callback - INFO - Received callback for node 69e72829fbd3a2737e5416f6 INFO: 172.21.0.1:55388 - "POST /node/69e72829fbd3a2737e5416f6 HTTP/1.0" 202 Accepted 2026-04-23 07:33:04,226 - lava_callback - INFO - Starting async job submit for node 69e72829fbd3a2737e5416f6 2026-04-23 07:33:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,243 - lava_callback - DEBUG - Processing node 69e72829fbd3a2737e5416f6: baseline-arm64-baylibre 2026-04-23 07:33:04,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72829fbd3a2737e5416f6 2026-04-23 07:33:04,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:33:04,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,291 - lava_callback - ERROR - Error processing callback for node 69e72829fbd3a2737e5416f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:34:24,308 - lava_callback - INFO - Received callback for node 69e72876fbd3a2737e54171b INFO: 172.21.0.1:60026 - "POST /node/69e72876fbd3a2737e54171b HTTP/1.0" 202 Accepted 2026-04-23 07:34:24,314 - lava_callback - INFO - Starting async job submit for node 69e72876fbd3a2737e54171b 2026-04-23 07:34:24,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,338 - lava_callback - DEBUG - Processing node 69e72876fbd3a2737e54171b: baseline-arm64-baylibre 2026-04-23 07:34:24,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72876fbd3a2737e54171b 2026-04-23 07:34:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:34:24,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,396 - lava_callback - ERROR - Error processing callback for node 69e72876fbd3a2737e54171b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:35:44,444 - lava_callback - INFO - Received callback for node 69e728c2fbd3a2737e54173c INFO: 172.21.0.1:41056 - "POST /node/69e728c2fbd3a2737e54173c HTTP/1.0" 202 Accepted 2026-04-23 07:35:44,450 - lava_callback - INFO - Starting async job submit for node 69e728c2fbd3a2737e54173c 2026-04-23 07:35:44,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,465 - lava_callback - DEBUG - Processing node 69e728c2fbd3a2737e54173c: baseline-arm64-baylibre 2026-04-23 07:35:44,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e728c2fbd3a2737e54173c 2026-04-23 07:35:44,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:35:44,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,519 - lava_callback - ERROR - Error processing callback for node 69e728c2fbd3a2737e54173c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:37:04,409 - lava_callback - INFO - Received callback for node 69e7291bfbd3a2737e541768 INFO: 172.21.0.1:45048 - "POST /node/69e7291bfbd3a2737e541768 HTTP/1.0" 202 Accepted 2026-04-23 07:37:04,414 - lava_callback - INFO - Starting async job submit for node 69e7291bfbd3a2737e541768 2026-04-23 07:37:04,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,430 - lava_callback - DEBUG - Processing node 69e7291bfbd3a2737e541768: baseline-arm64-baylibre 2026-04-23 07:37:04,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7291bfbd3a2737e541768 2026-04-23 07:37:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:37:04,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,484 - lava_callback - ERROR - Error processing callback for node 69e7291bfbd3a2737e541768: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET /node/6985d74b71989fb14149a761%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47272 - "GET /node/6992678a98a8bdb31c39201d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:42:13,003 - lava_callback - INFO - Received callback for node 69e72a4ffbd3a2737e541794 INFO: 172.21.0.1:58978 - "POST /node/69e72a4ffbd3a2737e541794 HTTP/1.0" 202 Accepted 2026-04-23 07:42:13,012 - lava_callback - INFO - Starting async job submit for node 69e72a4ffbd3a2737e541794 2026-04-23 07:42:13,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,028 - lava_callback - DEBUG - Processing node 69e72a4ffbd3a2737e541794: baseline-arm64-clabbe 2026-04-23 07:42:13,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72a4ffbd3a2737e541794 2026-04-23 07:42:13,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:42:13,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,083 - lava_callback - ERROR - Error processing callback for node 69e72a4ffbd3a2737e541794: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET /node/698956a985773790cd34e72c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /node/6992f8af31166481c8ddd716%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:44:13,063 - lava_callback - INFO - Received callback for node 69e72ac6fbd3a2737e5417b5 INFO: 172.21.0.1:42580 - "POST /node/69e72ac6fbd3a2737e5417b5 HTTP/1.0" 202 Accepted 2026-04-23 07:44:13,071 - lava_callback - INFO - Starting async job submit for node 69e72ac6fbd3a2737e5417b5 2026-04-23 07:44:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,086 - lava_callback - DEBUG - Processing node 69e72ac6fbd3a2737e5417b5: baseline-arm64-clabbe 2026-04-23 07:44:13,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ac6fbd3a2737e5417b5 2026-04-23 07:44:13,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:44:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,141 - lava_callback - ERROR - Error processing callback for node 69e72ac6fbd3a2737e5417b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET /node/6988bdf39fc35f969e1ed49d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:47:13,226 - lava_callback - INFO - Received callback for node 69e72b7afbd3a2737e5417dc INFO: 172.21.0.1:42568 - "POST /node/69e72b7afbd3a2737e5417dc HTTP/1.0" 202 Accepted 2026-04-23 07:47:13,231 - lava_callback - INFO - Starting async job submit for node 69e72b7afbd3a2737e5417dc 2026-04-23 07:47:13,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,246 - lava_callback - DEBUG - Processing node 69e72b7afbd3a2737e5417dc: baseline-arm64-clabbe 2026-04-23 07:47:13,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72b7afbd3a2737e5417dc 2026-04-23 07:47:13,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:47:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,291 - lava_callback - ERROR - Error processing callback for node 69e72b7afbd3a2737e5417dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:49:13,268 - lava_callback - INFO - Received callback for node 69e72bf5fbd3a2737e54180c INFO: 172.21.0.1:38290 - "POST /node/69e72bf5fbd3a2737e54180c HTTP/1.0" 202 Accepted 2026-04-23 07:49:13,273 - lava_callback - INFO - Starting async job submit for node 69e72bf5fbd3a2737e54180c 2026-04-23 07:49:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,289 - lava_callback - DEBUG - Processing node 69e72bf5fbd3a2737e54180c: baseline-arm64-clabbe 2026-04-23 07:49:13,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72bf5fbd3a2737e54180c 2026-04-23 07:49:13,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:49:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,335 - lava_callback - ERROR - Error processing callback for node 69e72bf5fbd3a2737e54180c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET /node/693afd18fee8383e92b6dc52%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:50:33,319 - lava_callback - INFO - Received callback for node 69e72c45fbd3a2737e541825 INFO: 172.21.0.1:41244 - "POST /node/69e72c45fbd3a2737e541825 HTTP/1.0" 202 Accepted 2026-04-23 07:50:33,325 - lava_callback - INFO - Starting async job submit for node 69e72c45fbd3a2737e541825 2026-04-23 07:50:33,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,340 - lava_callback - DEBUG - Processing node 69e72c45fbd3a2737e541825: baseline-arm64-clabbe 2026-04-23 07:50:33,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c45fbd3a2737e541825 2026-04-23 07:50:33,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:50:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,390 - lava_callback - ERROR - Error processing callback for node 69e72c45fbd3a2737e541825: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:51:53,398 - lava_callback - INFO - Received callback for node 69e72c95fbd3a2737e541869 INFO: 172.21.0.1:59902 - "POST /node/69e72c95fbd3a2737e541869 HTTP/1.0" 202 Accepted 2026-04-23 07:51:53,403 - lava_callback - INFO - Starting async job submit for node 69e72c95fbd3a2737e541869 2026-04-23 07:51:53,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,419 - lava_callback - DEBUG - Processing node 69e72c95fbd3a2737e541869: baseline-arm64-clabbe 2026-04-23 07:51:53,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c95fbd3a2737e541869 2026-04-23 07:51:53,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:51:53,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,466 - lava_callback - ERROR - Error processing callback for node 69e72c95fbd3a2737e541869: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:05,463 - lava_callback - INFO - Received callback for node 69e72c93fbd3a2737e541864 INFO: 172.21.0.1:50184 - "POST /node/69e72c93fbd3a2737e541864 HTTP/1.0" 202 Accepted 2026-04-23 07:52:05,471 - lava_callback - INFO - Starting async job submit for node 69e72c93fbd3a2737e541864 2026-04-23 07:52:05,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,488 - lava_callback - DEBUG - Processing node 69e72c93fbd3a2737e541864: baseline-arm-baylibre 2026-04-23 07:52:05,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c93fbd3a2737e541864 2026-04-23 07:52:05,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,538 - lava_callback - ERROR - Error processing callback for node 69e72c93fbd3a2737e541864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:06,158 - lava_callback - INFO - Received callback for node 69e72c94fbd3a2737e541867 INFO: 172.21.0.1:50200 - "POST /node/69e72c94fbd3a2737e541867 HTTP/1.0" 202 Accepted 2026-04-23 07:52:06,163 - lava_callback - INFO - Starting async job submit for node 69e72c94fbd3a2737e541867 2026-04-23 07:52:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,181 - lava_callback - DEBUG - Processing node 69e72c94fbd3a2737e541867: baseline-arm-baylibre 2026-04-23 07:52:06,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c94fbd3a2737e541867 2026-04-23 07:52:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:06,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,231 - lava_callback - ERROR - Error processing callback for node 69e72c94fbd3a2737e541867: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:06,846 - lava_callback - INFO - Received callback for node 69e72c96fbd3a2737e54186c INFO: 172.21.0.1:50218 - "POST /node/69e72c96fbd3a2737e54186c HTTP/1.0" 202 Accepted 2026-04-23 07:52:06,852 - lava_callback - INFO - Starting async job submit for node 69e72c96fbd3a2737e54186c 2026-04-23 07:52:06,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,866 - lava_callback - DEBUG - Processing node 69e72c96fbd3a2737e54186c: baseline-arm-baylibre 2026-04-23 07:52:06,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c96fbd3a2737e54186c 2026-04-23 07:52:06,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:06,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,933 - lava_callback - ERROR - Error processing callback for node 69e72c96fbd3a2737e54186c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:07,515 - lava_callback - INFO - Received callback for node 69e72c97fbd3a2737e541872 INFO: 172.21.0.1:50230 - "POST /node/69e72c97fbd3a2737e541872 HTTP/1.0" 202 Accepted 2026-04-23 07:52:07,524 - lava_callback - INFO - Starting async job submit for node 69e72c97fbd3a2737e541872 2026-04-23 07:52:07,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,540 - lava_callback - DEBUG - Processing node 69e72c97fbd3a2737e541872: baseline-arm-baylibre 2026-04-23 07:52:07,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c97fbd3a2737e541872 2026-04-23 07:52:07,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:07,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,583 - lava_callback - ERROR - Error processing callback for node 69e72c97fbd3a2737e541872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:08,216 - lava_callback - INFO - Received callback for node 69e72c99fbd3a2737e54187d INFO: 172.21.0.1:50238 - "POST /node/69e72c99fbd3a2737e54187d HTTP/1.0" 202 Accepted 2026-04-23 07:52:08,221 - lava_callback - INFO - Starting async job submit for node 69e72c99fbd3a2737e54187d 2026-04-23 07:52:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,237 - lava_callback - DEBUG - Processing node 69e72c99fbd3a2737e54187d: baseline-arm-baylibre 2026-04-23 07:52:08,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c99fbd3a2737e54187d 2026-04-23 07:52:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,294 - lava_callback - ERROR - Error processing callback for node 69e72c99fbd3a2737e54187d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:08,885 - lava_callback - INFO - Received callback for node 69e72c9bfbd3a2737e541880 INFO: 172.21.0.1:50242 - "POST /node/69e72c9bfbd3a2737e541880 HTTP/1.0" 202 Accepted 2026-04-23 07:52:08,893 - lava_callback - INFO - Starting async job submit for node 69e72c9bfbd3a2737e541880 2026-04-23 07:52:08,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,911 - lava_callback - DEBUG - Processing node 69e72c9bfbd3a2737e541880: baseline-arm-baylibre 2026-04-23 07:52:08,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c9bfbd3a2737e541880 2026-04-23 07:52:08,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:08,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,960 - lava_callback - ERROR - Error processing callback for node 69e72c9bfbd3a2737e541880: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:13,393 - lava_callback - INFO - Received callback for node 69e72ca2fbd3a2737e541895 INFO: 172.21.0.1:40520 - "POST /node/69e72ca2fbd3a2737e541895 HTTP/1.0" 202 Accepted 2026-04-23 07:52:13,399 - lava_callback - INFO - Starting async job submit for node 69e72ca2fbd3a2737e541895 2026-04-23 07:52:13,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,414 - lava_callback - DEBUG - Processing node 69e72ca2fbd3a2737e541895: baseline-arm-clabbe 2026-04-23 07:52:13,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca2fbd3a2737e541895 2026-04-23 07:52:13,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:13,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,464 - lava_callback - ERROR - Error processing callback for node 69e72ca2fbd3a2737e541895: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:14,090 - lava_callback - INFO - Received callback for node 69e72ca3fbd3a2737e54189b INFO: 172.21.0.1:40526 - "POST /node/69e72ca3fbd3a2737e54189b HTTP/1.0" 202 Accepted 2026-04-23 07:52:14,097 - lava_callback - INFO - Starting async job submit for node 69e72ca3fbd3a2737e54189b 2026-04-23 07:52:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,112 - lava_callback - DEBUG - Processing node 69e72ca3fbd3a2737e54189b: baseline-arm-clabbe 2026-04-23 07:52:14,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca3fbd3a2737e54189b 2026-04-23 07:52:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:14,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,165 - lava_callback - ERROR - Error processing callback for node 69e72ca3fbd3a2737e54189b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:14,790 - lava_callback - INFO - Received callback for node 69e72ca4fbd3a2737e54189f INFO: 172.21.0.1:40528 - "POST /node/69e72ca4fbd3a2737e54189f HTTP/1.0" 202 Accepted 2026-04-23 07:52:14,796 - lava_callback - INFO - Starting async job submit for node 69e72ca4fbd3a2737e54189f 2026-04-23 07:52:14,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,811 - lava_callback - DEBUG - Processing node 69e72ca4fbd3a2737e54189f: baseline-arm-clabbe 2026-04-23 07:52:14,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca4fbd3a2737e54189f 2026-04-23 07:52:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:14,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,858 - lava_callback - ERROR - Error processing callback for node 69e72ca4fbd3a2737e54189f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 07:52:15,483 - lava_callback - INFO - Received callback for node 69e72ca5fbd3a2737e5418a2 INFO: 172.21.0.1:40544 - "POST /node/69e72ca5fbd3a2737e5418a2 HTTP/1.0" 202 Accepted 2026-04-23 07:52:15,489 - lava_callback - INFO - Starting async job submit for node 69e72ca5fbd3a2737e5418a2 2026-04-23 07:52:15,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,504 - lava_callback - DEBUG - Processing node 69e72ca5fbd3a2737e5418a2: baseline-arm-clabbe 2026-04-23 07:52:15,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca5fbd3a2737e5418a2 2026-04-23 07:52:15,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,549 - lava_callback - ERROR - Error processing callback for node 69e72ca5fbd3a2737e5418a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:16,174 - lava_callback - INFO - Received callback for node 69e72ca5fbd3a2737e5418a5 INFO: 172.21.0.1:40560 - "POST /node/69e72ca5fbd3a2737e5418a5 HTTP/1.0" 202 Accepted 2026-04-23 07:52:16,181 - lava_callback - INFO - Starting async job submit for node 69e72ca5fbd3a2737e5418a5 2026-04-23 07:52:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,199 - lava_callback - DEBUG - Processing node 69e72ca5fbd3a2737e5418a5: baseline-arm-clabbe 2026-04-23 07:52:16,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca5fbd3a2737e5418a5 2026-04-23 07:52:16,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:16,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,243 - lava_callback - ERROR - Error processing callback for node 69e72ca5fbd3a2737e5418a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:16,888 - lava_callback - INFO - Received callback for node 69e72ca6fbd3a2737e5418a8 INFO: 172.21.0.1:40586 - "POST /node/69e72ca6fbd3a2737e5418a8 HTTP/1.0" 202 Accepted 2026-04-23 07:52:16,894 - lava_callback - INFO - Starting async job submit for node 69e72ca6fbd3a2737e5418a8 2026-04-23 07:52:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,911 - lava_callback - DEBUG - Processing node 69e72ca6fbd3a2737e5418a8: baseline-arm-clabbe 2026-04-23 07:52:16,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca6fbd3a2737e5418a8 2026-04-23 07:52:16,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:16,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,972 - lava_callback - ERROR - Error processing callback for node 69e72ca6fbd3a2737e5418a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:17,585 - lava_callback - INFO - Received callback for node 69e72ca7fbd3a2737e5418ab INFO: 172.21.0.1:40590 - "POST /node/69e72ca7fbd3a2737e5418ab HTTP/1.0" 202 Accepted 2026-04-23 07:52:17,593 - lava_callback - INFO - Starting async job submit for node 69e72ca7fbd3a2737e5418ab 2026-04-23 07:52:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,656 - lava_callback - DEBUG - Processing node 69e72ca7fbd3a2737e5418ab: baseline-arm-clabbe 2026-04-23 07:52:17,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca7fbd3a2737e5418ab 2026-04-23 07:52:17,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:17,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,717 - lava_callback - ERROR - Error processing callback for node 69e72ca7fbd3a2737e5418ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:18,262 - lava_callback - INFO - Received callback for node 69e72ca8fbd3a2737e5418ae INFO: 172.21.0.1:40594 - "POST /node/69e72ca8fbd3a2737e5418ae HTTP/1.0" 202 Accepted 2026-04-23 07:52:18,268 - lava_callback - INFO - Starting async job submit for node 69e72ca8fbd3a2737e5418ae 2026-04-23 07:52:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,288 - lava_callback - DEBUG - Processing node 69e72ca8fbd3a2737e5418ae: baseline-arm-clabbe 2026-04-23 07:52:18,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca8fbd3a2737e5418ae 2026-04-23 07:52:18,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:18,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,348 - lava_callback - ERROR - Error processing callback for node 69e72ca8fbd3a2737e5418ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:18,965 - lava_callback - INFO - Received callback for node 69e72ca9fbd3a2737e5418e4 INFO: 172.21.0.1:40604 - "POST /node/69e72ca9fbd3a2737e5418e4 HTTP/1.0" 202 Accepted 2026-04-23 07:52:18,971 - lava_callback - INFO - Starting async job submit for node 69e72ca9fbd3a2737e5418e4 2026-04-23 07:52:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:18,986 - lava_callback - DEBUG - Processing node 69e72ca9fbd3a2737e5418e4: baseline-arm-clabbe 2026-04-23 07:52:18,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca9fbd3a2737e5418e4 2026-04-23 07:52:18,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:19,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:19,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:19,038 - lava_callback - ERROR - Error processing callback for node 69e72ca9fbd3a2737e5418e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET /node/69afb37b275c8d3b7939b467%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:57:53,653 - lava_callback - INFO - Received callback for node 69e72df0fbd3a2737e541a71 INFO: 172.21.0.1:50218 - "POST /node/69e72df0fbd3a2737e541a71 HTTP/1.0" 202 Accepted 2026-04-23 07:57:53,659 - lava_callback - INFO - Starting async job submit for node 69e72df0fbd3a2737e541a71 2026-04-23 07:57:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,688 - lava_callback - DEBUG - Processing node 69e72df0fbd3a2737e541a71: baseline-arm64-clabbe 2026-04-23 07:57:53,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72df0fbd3a2737e541a71 2026-04-23 07:57:53,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:57:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,737 - lava_callback - ERROR - Error processing callback for node 69e72df0fbd3a2737e541a71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK 2026-04-23 08:13:46,619 - lava_callback - INFO - Received callback for node 69e731a5fbd3a2737e5442c3 INFO: 172.21.0.1:45802 - "POST /node/69e731a5fbd3a2737e5442c3 HTTP/1.0" 202 Accepted 2026-04-23 08:13:46,627 - lava_callback - INFO - Starting async job submit for node 69e731a5fbd3a2737e5442c3 2026-04-23 08:13:46,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,650 - lava_callback - DEBUG - Processing node 69e731a5fbd3a2737e5442c3: baseline-arm-baylibre 2026-04-23 08:13:46,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e731a5fbd3a2737e5442c3 2026-04-23 08:13:46,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 08:13:46,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,739 - lava_callback - ERROR - Error processing callback for node 69e731a5fbd3a2737e5442c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /node/691103f8699dbc4cda8e789e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET /node/69934d09523507f3806a5bc5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET /node/6985de0271989fb14149b2b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /node/691054938b15debe9dd4bfc8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49338 - "GET /node/6984d4bb3ff18e47df612645%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:27:54,600 - lava_callback - INFO - Received callback for node 69e6c48760f5826562c151a0 2026-04-23 00:27:54,606 - lava_callback - INFO - Starting async job submit for node 69e6c48760f5826562c151a0 INFO: 172.21.0.1:58356 - "POST /node/69e6c48760f5826562c151a0 HTTP/1.0" 202 Accepted 2026-04-23 00:27:54,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,627 - lava_callback - DEBUG - Processing node 69e6c48760f5826562c151a0: baseline-arm-clabbe 2026-04-23 00:27:54,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c48760f5826562c151a0 2026-04-23 00:27:54,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:27:54,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:27:54,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c48760f5826562c151a0 HTTP/1.1" 200 None 2026-04-23 00:27:54,703 - lava_callback - ERROR - Error processing callback for node 69e6c48760f5826562c151a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:28:34,569 - lava_callback - INFO - Received callback for node 69e6c4ac60f5826562c15761 INFO: 172.21.0.1:57470 - "POST /node/69e6c4ac60f5826562c15761 HTTP/1.0" 202 Accepted 2026-04-23 00:28:34,580 - lava_callback - INFO - Starting async job submit for node 69e6c4ac60f5826562c15761 2026-04-23 00:28:34,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,688 - lava_callback - DEBUG - Processing node 69e6c4ac60f5826562c15761: baseline-arm-clabbe 2026-04-23 00:28:34,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4ac60f5826562c15761 2026-04-23 00:28:34,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:28:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:28:34,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4ac60f5826562c15761 HTTP/1.1" 200 None 2026-04-23 00:28:34,790 - lava_callback - ERROR - Error processing callback for node 69e6c4ac60f5826562c15761: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:29:14,643 - lava_callback - INFO - Received callback for node 69e6c4d460f5826562c15772 INFO: 172.21.0.1:33274 - "POST /node/69e6c4d460f5826562c15772 HTTP/1.0" 202 Accepted 2026-04-23 00:29:14,649 - lava_callback - INFO - Starting async job submit for node 69e6c4d460f5826562c15772 2026-04-23 00:29:14,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,668 - lava_callback - DEBUG - Processing node 69e6c4d460f5826562c15772: baseline-arm-clabbe 2026-04-23 00:29:14,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4d460f5826562c15772 2026-04-23 00:29:14,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:29:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:14,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4d460f5826562c15772 HTTP/1.1" 200 None 2026-04-23 00:29:14,736 - lava_callback - ERROR - Error processing callback for node 69e6c4d460f5826562c15772: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:29:54,660 - lava_callback - INFO - Received callback for node 69e6c4f960f5826562c15786 INFO: 172.21.0.1:41716 - "POST /node/69e6c4f960f5826562c15786 HTTP/1.0" 202 Accepted 2026-04-23 00:29:54,668 - lava_callback - INFO - Starting async job submit for node 69e6c4f960f5826562c15786 2026-04-23 00:29:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,688 - lava_callback - DEBUG - Processing node 69e6c4f960f5826562c15786: baseline-arm-clabbe 2026-04-23 00:29:54,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c4f960f5826562c15786 2026-04-23 00:29:54,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:29:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:29:54,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c4f960f5826562c15786 HTTP/1.1" 200 None 2026-04-23 00:29:54,739 - lava_callback - ERROR - Error processing callback for node 69e6c4f960f5826562c15786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:30:33,246 - lava_callback - INFO - Received callback for node 69e967b58137cb226ce1cb1d INFO: 172.21.0.1:34050 - "POST /node/69e967b58137cb226ce1cb1d HTTP/1.0" 202 Accepted 2026-04-23 00:30:33,254 - lava_callback - INFO - Starting async job submit for node 69e967b58137cb226ce1cb1d 2026-04-23 00:30:33,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:33,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:33,293 - lava_callback - DEBUG - Processing node 69e967b58137cb226ce1cb1d: baseline-arm 2026-04-23 00:30:33,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:33,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:33,895 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/log.txt.gz 2026-04-23 00:30:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:34,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:34,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/lava-logs.yaml 2026-04-23 00:30:34,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:30:34,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:30:34,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e967b58137cb226ce1cb1d/lava_callback.json.gz 2026-04-23 00:30:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:34,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 00:30:34,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e967b58137cb226ce1cb1d HTTP/1.1" 200 None 2026-04-23 00:30:34,541 - lava_callback - INFO - Completed processing callback for node 69e967b58137cb226ce1cb1d 2026-04-23 00:30:34,710 - lava_callback - INFO - Received callback for node 69e6c51f60f5826562c15792 INFO: 172.21.0.1:34058 - "POST /node/69e6c51f60f5826562c15792 HTTP/1.0" 202 Accepted 2026-04-23 00:30:34,719 - lava_callback - INFO - Starting async job submit for node 69e6c51f60f5826562c15792 2026-04-23 00:30:34,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,740 - lava_callback - DEBUG - Processing node 69e6c51f60f5826562c15792: baseline-arm-clabbe 2026-04-23 00:30:34,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c51f60f5826562c15792 2026-04-23 00:30:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:30:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:34,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c51f60f5826562c15792 HTTP/1.1" 200 None 2026-04-23 00:30:34,844 - lava_callback - ERROR - Error processing callback for node 69e6c51f60f5826562c15792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:30:54,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:30:54,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:31:14,722 - lava_callback - INFO - Received callback for node 69e6c54660f5826562c157a3 INFO: 172.21.0.1:33150 - "POST /node/69e6c54660f5826562c157a3 HTTP/1.0" 202 Accepted 2026-04-23 00:31:14,730 - lava_callback - INFO - Starting async job submit for node 69e6c54660f5826562c157a3 2026-04-23 00:31:14,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,744 - lava_callback - DEBUG - Processing node 69e6c54660f5826562c157a3: baseline-arm-clabbe 2026-04-23 00:31:14,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c54660f5826562c157a3 2026-04-23 00:31:14,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:31:14,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:14,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c54660f5826562c157a3 HTTP/1.1" 200 None 2026-04-23 00:31:14,806 - lava_callback - ERROR - Error processing callback for node 69e6c54660f5826562c157a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:31:54,777 - lava_callback - INFO - Received callback for node 69e6c56e60f5826562c157ba INFO: 172.21.0.1:44470 - "POST /node/69e6c56e60f5826562c157ba HTTP/1.0" 202 Accepted 2026-04-23 00:31:54,784 - lava_callback - INFO - Starting async job submit for node 69e6c56e60f5826562c157ba 2026-04-23 00:31:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,801 - lava_callback - DEBUG - Processing node 69e6c56e60f5826562c157ba: baseline-arm-clabbe 2026-04-23 00:31:54,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c56e60f5826562c157ba 2026-04-23 00:31:54,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:31:54,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:31:54,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c56e60f5826562c157ba HTTP/1.1" 200 None 2026-04-23 00:31:54,862 - lava_callback - ERROR - Error processing callback for node 69e6c56e60f5826562c157ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:34,789 - lava_callback - INFO - Received callback for node 69e6c59860f5826562c157e8 INFO: 172.21.0.1:52414 - "POST /node/69e6c59860f5826562c157e8 HTTP/1.0" 202 Accepted 2026-04-23 00:32:34,798 - lava_callback - INFO - Starting async job submit for node 69e6c59860f5826562c157e8 2026-04-23 00:32:34,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,816 - lava_callback - DEBUG - Processing node 69e6c59860f5826562c157e8: baseline-arm-clabbe 2026-04-23 00:32:34,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59860f5826562c157e8 2026-04-23 00:32:34,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:32:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:34,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59860f5826562c157e8 HTTP/1.1" 200 None 2026-04-23 00:32:34,892 - lava_callback - ERROR - Error processing callback for node 69e6c59860f5826562c157e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:40,947 - lava_callback - INFO - Received callback for node 69e6c59460f5826562c157df INFO: 172.21.0.1:56418 - "POST /node/69e6c59460f5826562c157df HTTP/1.0" 202 Accepted 2026-04-23 00:32:40,954 - lava_callback - INFO - Starting async job submit for node 69e6c59460f5826562c157df 2026-04-23 00:32:40,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:40,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:40,971 - lava_callback - DEBUG - Processing node 69e6c59460f5826562c157df: baseline-arm-baylibre 2026-04-23 00:32:40,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59460f5826562c157df 2026-04-23 00:32:40,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:41,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59460f5826562c157df HTTP/1.1" 200 None 2026-04-23 00:32:41,062 - lava_callback - ERROR - Error processing callback for node 69e6c59460f5826562c157df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:41,661 - lava_callback - INFO - Received callback for node 69e6c59560f5826562c157e2 INFO: 172.21.0.1:56428 - "POST /node/69e6c59560f5826562c157e2 HTTP/1.0" 202 Accepted 2026-04-23 00:32:41,668 - lava_callback - INFO - Starting async job submit for node 69e6c59560f5826562c157e2 2026-04-23 00:32:41,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,689 - lava_callback - DEBUG - Processing node 69e6c59560f5826562c157e2: baseline-arm-baylibre 2026-04-23 00:32:41,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59560f5826562c157e2 2026-04-23 00:32:41,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:41,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:41,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59560f5826562c157e2 HTTP/1.1" 200 None 2026-04-23 00:32:41,756 - lava_callback - ERROR - Error processing callback for node 69e6c59560f5826562c157e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:42,363 - lava_callback - INFO - Received callback for node 69e6c59760f5826562c157e5 INFO: 172.21.0.1:56436 - "POST /node/69e6c59760f5826562c157e5 HTTP/1.0" 202 Accepted 2026-04-23 00:32:42,370 - lava_callback - INFO - Starting async job submit for node 69e6c59760f5826562c157e5 2026-04-23 00:32:42,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,389 - lava_callback - DEBUG - Processing node 69e6c59760f5826562c157e5: baseline-arm-baylibre 2026-04-23 00:32:42,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59760f5826562c157e5 2026-04-23 00:32:42,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59760f5826562c157e5 HTTP/1.1" 200 None 2026-04-23 00:32:42,458 - lava_callback - ERROR - Error processing callback for node 69e6c59760f5826562c157e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:43,038 - lava_callback - INFO - Received callback for node 69e6c59860f5826562c157ea INFO: 172.21.0.1:56446 - "POST /node/69e6c59860f5826562c157ea HTTP/1.0" 202 Accepted 2026-04-23 00:32:43,044 - lava_callback - INFO - Starting async job submit for node 69e6c59860f5826562c157ea 2026-04-23 00:32:43,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,063 - lava_callback - DEBUG - Processing node 69e6c59860f5826562c157ea: baseline-arm-baylibre 2026-04-23 00:32:43,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59860f5826562c157ea 2026-04-23 00:32:43,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:43,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59860f5826562c157ea HTTP/1.1" 200 None 2026-04-23 00:32:43,115 - lava_callback - ERROR - Error processing callback for node 69e6c59860f5826562c157ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:43,685 - lava_callback - INFO - Received callback for node 69e6c59b60f5826562c157f6 INFO: 172.21.0.1:56448 - "POST /node/69e6c59b60f5826562c157f6 HTTP/1.0" 202 Accepted 2026-04-23 00:32:43,700 - lava_callback - INFO - Starting async job submit for node 69e6c59b60f5826562c157f6 2026-04-23 00:32:43,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,737 - lava_callback - DEBUG - Processing node 69e6c59b60f5826562c157f6: baseline-arm-baylibre 2026-04-23 00:32:43,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59b60f5826562c157f6 2026-04-23 00:32:43,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:43,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:43,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59b60f5826562c157f6 HTTP/1.1" 200 None 2026-04-23 00:32:43,801 - lava_callback - ERROR - Error processing callback for node 69e6c59b60f5826562c157f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:44,384 - lava_callback - INFO - Received callback for node 69e6c59c60f5826562c157fb INFO: 172.21.0.1:56464 - "POST /node/69e6c59c60f5826562c157fb HTTP/1.0" 202 Accepted 2026-04-23 00:32:44,390 - lava_callback - INFO - Starting async job submit for node 69e6c59c60f5826562c157fb 2026-04-23 00:32:44,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,408 - lava_callback - DEBUG - Processing node 69e6c59c60f5826562c157fb: baseline-arm-baylibre 2026-04-23 00:32:44,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c59c60f5826562c157fb 2026-04-23 00:32:44,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:44,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:44,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c59c60f5826562c157fb HTTP/1.1" 200 None 2026-04-23 00:32:44,482 - lava_callback - ERROR - Error processing callback for node 69e6c59c60f5826562c157fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:54,824 - lava_callback - INFO - Received callback for node 69e6c5a460f5826562c15810 INFO: 172.21.0.1:52684 - "POST /node/69e6c5a460f5826562c15810 HTTP/1.0" 202 Accepted 2026-04-23 00:32:54,831 - lava_callback - INFO - Starting async job submit for node 69e6c5a460f5826562c15810 2026-04-23 00:32:54,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,849 - lava_callback - DEBUG - Processing node 69e6c5a460f5826562c15810: baseline-arm-clabbe 2026-04-23 00:32:54,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a460f5826562c15810 2026-04-23 00:32:54,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:54,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a460f5826562c15810 HTTP/1.1" 200 None 2026-04-23 00:32:54,942 - lava_callback - ERROR - Error processing callback for node 69e6c5a460f5826562c15810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:55,502 - lava_callback - INFO - Received callback for node 69e6c5a560f5826562c15816 INFO: 172.21.0.1:52694 - "POST /node/69e6c5a560f5826562c15816 HTTP/1.0" 202 Accepted 2026-04-23 00:32:55,512 - lava_callback - INFO - Starting async job submit for node 69e6c5a560f5826562c15816 2026-04-23 00:32:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,532 - lava_callback - DEBUG - Processing node 69e6c5a560f5826562c15816: baseline-arm-clabbe 2026-04-23 00:32:55,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a560f5826562c15816 2026-04-23 00:32:55,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:55,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:55,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a560f5826562c15816 HTTP/1.1" 200 None 2026-04-23 00:32:55,592 - lava_callback - ERROR - Error processing callback for node 69e6c5a560f5826562c15816: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:56,194 - lava_callback - INFO - Received callback for node 69e6c5a660f5826562c1581a INFO: 172.21.0.1:52698 - "POST /node/69e6c5a660f5826562c1581a HTTP/1.0" 202 Accepted 2026-04-23 00:32:56,201 - lava_callback - INFO - Starting async job submit for node 69e6c5a660f5826562c1581a 2026-04-23 00:32:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,218 - lava_callback - DEBUG - Processing node 69e6c5a660f5826562c1581a: baseline-arm-clabbe 2026-04-23 00:32:56,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a660f5826562c1581a 2026-04-23 00:32:56,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a660f5826562c1581a HTTP/1.1" 200 None 2026-04-23 00:32:56,278 - lava_callback - ERROR - Error processing callback for node 69e6c5a660f5826562c1581a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:32:56,875 - lava_callback - INFO - Received callback for node 69e6c5a660f5826562c1581d INFO: 172.21.0.1:52722 - "POST /node/69e6c5a660f5826562c1581d HTTP/1.0" 202 Accepted 2026-04-23 00:32:56,882 - lava_callback - INFO - Starting async job submit for node 69e6c5a660f5826562c1581d 2026-04-23 00:32:56,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,906 - lava_callback - DEBUG - Processing node 69e6c5a660f5826562c1581d: baseline-arm-clabbe 2026-04-23 00:32:56,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a660f5826562c1581d 2026-04-23 00:32:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:56,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:56,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a660f5826562c1581d HTTP/1.1" 200 None 2026-04-23 00:32:56,962 - lava_callback - ERROR - Error processing callback for node 69e6c5a660f5826562c1581d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:57,585 - lava_callback - INFO - Received callback for node 69e6c5a760f5826562c15820 INFO: 172.21.0.1:52732 - "POST /node/69e6c5a760f5826562c15820 HTTP/1.0" 202 Accepted 2026-04-23 00:32:57,592 - lava_callback - INFO - Starting async job submit for node 69e6c5a760f5826562c15820 2026-04-23 00:32:57,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,609 - lava_callback - DEBUG - Processing node 69e6c5a760f5826562c15820: baseline-arm-clabbe 2026-04-23 00:32:57,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a760f5826562c15820 2026-04-23 00:32:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:57,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:57,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a760f5826562c15820 HTTP/1.1" 200 None 2026-04-23 00:32:57,669 - lava_callback - ERROR - Error processing callback for node 69e6c5a760f5826562c15820: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:58,284 - lava_callback - INFO - Received callback for node 69e6c5a860f5826562c15823 INFO: 172.21.0.1:52742 - "POST /node/69e6c5a860f5826562c15823 HTTP/1.0" 202 Accepted 2026-04-23 00:32:58,293 - lava_callback - INFO - Starting async job submit for node 69e6c5a860f5826562c15823 2026-04-23 00:32:58,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,325 - lava_callback - DEBUG - Processing node 69e6c5a860f5826562c15823: baseline-arm-clabbe 2026-04-23 00:32:58,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a860f5826562c15823 2026-04-23 00:32:58,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:58,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:58,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a860f5826562c15823 HTTP/1.1" 200 None 2026-04-23 00:32:58,379 - lava_callback - ERROR - Error processing callback for node 69e6c5a860f5826562c15823: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:59,001 - lava_callback - INFO - Received callback for node 69e6c5a960f5826562c15826 INFO: 172.21.0.1:52748 - "POST /node/69e6c5a960f5826562c15826 HTTP/1.0" 202 Accepted 2026-04-23 00:32:59,007 - lava_callback - INFO - Starting async job submit for node 69e6c5a960f5826562c15826 2026-04-23 00:32:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,023 - lava_callback - DEBUG - Processing node 69e6c5a960f5826562c15826: baseline-arm-clabbe 2026-04-23 00:32:59,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5a960f5826562c15826 2026-04-23 00:32:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5a960f5826562c15826 HTTP/1.1" 200 None 2026-04-23 00:32:59,096 - lava_callback - ERROR - Error processing callback for node 69e6c5a960f5826562c15826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:32:59,684 - lava_callback - INFO - Received callback for node 69e6c5aa60f5826562c15829 INFO: 172.21.0.1:52764 - "POST /node/69e6c5aa60f5826562c15829 HTTP/1.0" 202 Accepted 2026-04-23 00:32:59,691 - lava_callback - INFO - Starting async job submit for node 69e6c5aa60f5826562c15829 2026-04-23 00:32:59,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,722 - lava_callback - DEBUG - Processing node 69e6c5aa60f5826562c15829: baseline-arm-clabbe 2026-04-23 00:32:59,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5aa60f5826562c15829 2026-04-23 00:32:59,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:32:59,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:32:59,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5aa60f5826562c15829 HTTP/1.1" 200 None 2026-04-23 00:32:59,789 - lava_callback - ERROR - Error processing callback for node 69e6c5aa60f5826562c15829: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:33:00,401 - lava_callback - INFO - Received callback for node 69e6c5aa60f5826562c15856 INFO: 172.21.0.1:46660 - "POST /node/69e6c5aa60f5826562c15856 HTTP/1.0" 202 Accepted 2026-04-23 00:33:00,408 - lava_callback - INFO - Starting async job submit for node 69e6c5aa60f5826562c15856 2026-04-23 00:33:00,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,437 - lava_callback - DEBUG - Processing node 69e6c5aa60f5826562c15856: baseline-arm-clabbe 2026-04-23 00:33:00,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5aa60f5826562c15856 2026-04-23 00:33:00,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 00:33:00,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:00,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5aa60f5826562c15856 HTTP/1.1" 200 None 2026-04-23 00:33:00,494 - lava_callback - ERROR - Error processing callback for node 69e6c5aa60f5826562c15856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:14,838 - lava_callback - INFO - Received callback for node 69e6c5bf60f5826562c1587c INFO: 172.21.0.1:46972 - "POST /node/69e6c5bf60f5826562c1587c HTTP/1.0" 202 Accepted 2026-04-23 00:33:14,845 - lava_callback - INFO - Starting async job submit for node 69e6c5bf60f5826562c1587c 2026-04-23 00:33:14,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,861 - lava_callback - DEBUG - Processing node 69e6c5bf60f5826562c1587c: baseline-arm-clabbe 2026-04-23 00:33:14,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5bf60f5826562c1587c 2026-04-23 00:33:14,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 00:33:14,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:14,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5bf60f5826562c1587c HTTP/1.1" 200 None 2026-04-23 00:33:14,914 - lava_callback - ERROR - Error processing callback for node 69e6c5bf60f5826562c1587c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:40,953 - lava_callback - INFO - Received callback for node 69e6c5e160f5826562c158dc INFO: 172.21.0.1:38752 - "POST /node/69e6c5e160f5826562c158dc HTTP/1.0" 202 Accepted 2026-04-23 00:33:40,958 - lava_callback - INFO - Starting async job submit for node 69e6c5e160f5826562c158dc 2026-04-23 00:33:40,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:40,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:40,974 - lava_callback - DEBUG - Processing node 69e6c5e160f5826562c158dc: baseline-arm-baylibre 2026-04-23 00:33:40,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c5e160f5826562c158dc 2026-04-23 00:33:40,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:40,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:41,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:33:41,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:41,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c5e160f5826562c158dc HTTP/1.1" 200 None 2026-04-23 00:33:41,028 - lava_callback - ERROR - Error processing callback for node 69e6c5e160f5826562c158dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:33:54,488 - lava_callback - INFO - Received callback for node 69e968de8137cb226ce1f297 INFO: 172.21.0.1:39718 - "POST /node/69e968de8137cb226ce1f297 HTTP/1.0" 202 Accepted 2026-04-23 00:33:54,498 - lava_callback - INFO - Starting async job submit for node 69e968de8137cb226ce1f297 2026-04-23 00:33:54,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,534 - lava_callback - DEBUG - Processing node 69e968de8137cb226ce1f297: baseline-arm 2026-04-23 00:33:54,542 - lava_callback - WARNING - Failed to upload log 2026-04-23 00:33:54,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:33:54,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:33:54,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f297/lava-logs.yaml 2026-04-23 00:33:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:33:54,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:33:54,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f297/lava_callback.json.gz 2026-04-23 00:33:54,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:33:54,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:33:54,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968de8137cb226ce1f297 HTTP/1.1" 200 None 2026-04-23 00:33:54,856 - lava_callback - INFO - Completed processing callback for node 69e968de8137cb226ce1f297 INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:10,615 - lava_callback - INFO - Received callback for node 69e968de8137cb226ce1f29a INFO: 172.21.0.1:52740 - "POST /node/69e968de8137cb226ce1f29a HTTP/1.0" 202 Accepted 2026-04-23 00:34:10,662 - lava_callback - INFO - Starting async job submit for node 69e968de8137cb226ce1f29a 2026-04-23 00:34:10,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:10,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:10,694 - lava_callback - DEBUG - Processing node 69e968de8137cb226ce1f29a: baseline-arm 2026-04-23 00:34:10,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:10,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:10,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/log.txt.gz 2026-04-23 00:34:10,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:11,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:11,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/lava-logs.yaml 2026-04-23 00:34:11,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:11,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:11,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968de8137cb226ce1f29a/lava_callback.json.gz 2026-04-23 00:34:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:11,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:11,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:11,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968de8137cb226ce1f29a HTTP/1.1" 200 None 2026-04-23 00:34:11,272 - lava_callback - INFO - Completed processing callback for node 69e968de8137cb226ce1f29a 2026-04-23 00:34:14,951 - lava_callback - INFO - Received callback for node 69e968e18137cb226ce1f2a3 INFO: 172.21.0.1:52744 - "POST /node/69e968e18137cb226ce1f2a3 HTTP/1.0" 202 Accepted 2026-04-23 00:34:14,997 - lava_callback - INFO - Starting async job submit for node 69e968e18137cb226ce1f2a3 2026-04-23 00:34:15,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,031 - lava_callback - DEBUG - Processing node 69e968e18137cb226ce1f2a3: baseline-arm 2026-04-23 00:34:15,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52750 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:34:15,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/log.txt.gz 2026-04-23 00:34:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:15,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/lava-logs.yaml 2026-04-23 00:34:15,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:15,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:15,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e18137cb226ce1f2a3/lava_callback.json.gz 2026-04-23 00:34:15,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:15,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:15,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968e18137cb226ce1f2a3 HTTP/1.1" 200 None 2026-04-23 00:34:15,629 - lava_callback - INFO - Completed processing callback for node 69e968e18137cb226ce1f2a3 INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:21,030 - lava_callback - INFO - Received callback for node 69e6c60a60f5826562c1591c INFO: 172.21.0.1:52034 - "POST /node/69e6c60a60f5826562c1591c HTTP/1.0" 202 Accepted 2026-04-23 00:34:21,035 - lava_callback - INFO - Starting async job submit for node 69e6c60a60f5826562c1591c 2026-04-23 00:34:21,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,050 - lava_callback - DEBUG - Processing node 69e6c60a60f5826562c1591c: baseline-arm-baylibre 2026-04-23 00:34:21,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c60a60f5826562c1591c 2026-04-23 00:34:21,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:34:21,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:21,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c60a60f5826562c1591c HTTP/1.1" 200 None 2026-04-23 00:34:21,094 - lava_callback - ERROR - Error processing callback for node 69e6c60a60f5826562c1591c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:34:24,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:24,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:50,104 - lava_callback - INFO - Received callback for node 69e968e08137cb226ce1f2a0 INFO: 172.21.0.1:47796 - "POST /node/69e968e08137cb226ce1f2a0 HTTP/1.0" 202 Accepted 2026-04-23 00:34:50,110 - lava_callback - INFO - Starting async job submit for node 69e968e08137cb226ce1f2a0 2026-04-23 00:34:50,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:50,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:50,151 - lava_callback - DEBUG - Processing node 69e968e08137cb226ce1f2a0: baseline-arm 2026-04-23 00:34:50,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/log.txt.gz 2026-04-23 00:34:50,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/lava-logs.yaml 2026-04-23 00:34:50,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:50,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:50,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968e08137cb226ce1f2a0/lava_callback.json.gz 2026-04-23 00:34:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:51,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:51,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:51,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968e08137cb226ce1f2a0 HTTP/1.1" 200 None 2026-04-23 00:34:51,062 - lava_callback - INFO - Completed processing callback for node 69e968e08137cb226ce1f2a0 2026-04-23 00:34:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:54,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:34:57,815 - lava_callback - INFO - Received callback for node 69e968dd8137cb226ce1f294 INFO: 172.21.0.1:47812 - "POST /node/69e968dd8137cb226ce1f294 HTTP/1.0" 202 Accepted 2026-04-23 00:34:57,821 - lava_callback - INFO - Starting async job submit for node 69e968dd8137cb226ce1f294 2026-04-23 00:34:57,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:57,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:57,857 - lava_callback - DEBUG - Processing node 69e968dd8137cb226ce1f294: baseline-arm 2026-04-23 00:34:58,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/log.txt.gz 2026-04-23 00:34:58,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/lava-logs.yaml 2026-04-23 00:34:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:34:58,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:34:58,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968dd8137cb226ce1f294/lava_callback.json.gz 2026-04-23 00:34:58,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:58,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:34:58,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:34:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968dd8137cb226ce1f294 HTTP/1.1" 200 None 2026-04-23 00:34:58,591 - lava_callback - INFO - Completed processing callback for node 69e968dd8137cb226ce1f294 INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:08,467 - lava_callback - INFO - Received callback for node 69e969038137cb226ce1f337 INFO: 172.21.0.1:59508 - "POST /node/69e969038137cb226ce1f337 HTTP/1.0" 202 Accepted 2026-04-23 00:35:08,513 - lava_callback - INFO - Starting async job submit for node 69e969038137cb226ce1f337 2026-04-23 00:35:08,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:08,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:08,551 - lava_callback - DEBUG - Processing node 69e969038137cb226ce1f337: baseline-arm-pengutronix 2026-04-23 00:35:08,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:08,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:08,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/log.txt.gz 2026-04-23 00:35:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:08,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:08,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/lava-logs.yaml 2026-04-23 00:35:08,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:09,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:09,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969038137cb226ce1f337/lava_callback.json.gz 2026-04-23 00:35:09,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:09,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:09,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969038137cb226ce1f337 HTTP/1.1" 200 None 2026-04-23 00:35:09,327 - lava_callback - INFO - Completed processing callback for node 69e969038137cb226ce1f337 2026-04-23 00:35:15,154 - lava_callback - INFO - Received callback for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48966 - "POST /node/69e969018137cb226ce1f32d HTTP/1.0" 202 Accepted 2026-04-23 00:35:15,159 - lava_callback - INFO - Starting async job submit for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:35:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,192 - lava_callback - DEBUG - Processing node 69e969018137cb226ce1f32d: baseline-arm-pengutronix 2026-04-23 00:35:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/log.txt.gz 2026-04-23 00:35:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/lava-logs.yaml 2026-04-23 00:35:15,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:15,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:15,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969018137cb226ce1f32d/lava_callback.json.gz 2026-04-23 00:35:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:15,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:15,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969018137cb226ce1f32d HTTP/1.1" 200 None 2026-04-23 00:35:15,833 - lava_callback - INFO - Completed processing callback for node 69e969018137cb226ce1f32d INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:24,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:42,340 - lava_callback - INFO - Received callback for node 69e968fb8137cb226ce1f31c INFO: 172.21.0.1:44564 - "POST /node/69e968fb8137cb226ce1f31c HTTP/1.0" 202 Accepted 2026-04-23 00:35:42,345 - lava_callback - INFO - Starting async job submit for node 69e968fb8137cb226ce1f31c 2026-04-23 00:35:42,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:42,382 - lava_callback - DEBUG - Processing node 69e968fb8137cb226ce1f31c: baseline-arm-kontron 2026-04-23 00:35:42,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:42,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:42,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/log.txt.gz 2026-04-23 00:35:42,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:42,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:42,889 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/lava-logs.yaml 2026-04-23 00:35:42,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:43,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:43,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fb8137cb226ce1f31c/lava_callback.json.gz 2026-04-23 00:35:43,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:43,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:43,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968fb8137cb226ce1f31c HTTP/1.1" 200 None 2026-04-23 00:35:43,093 - lava_callback - INFO - Completed processing callback for node 69e968fb8137cb226ce1f31c INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:54,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:35:55,680 - lava_callback - INFO - Received callback for node 69e968ff8137cb226ce1f32a INFO: 172.21.0.1:58050 - "POST /node/69e968ff8137cb226ce1f32a HTTP/1.0" 202 Accepted 2026-04-23 00:35:55,685 - lava_callback - INFO - Starting async job submit for node 69e968ff8137cb226ce1f32a 2026-04-23 00:35:55,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:55,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None 2026-04-23 00:35:55,735 - lava_callback - DEBUG - Processing node 69e968ff8137cb226ce1f32a: baseline-arm-pengutronix 2026-04-23 00:35:55,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/log.txt.gz 2026-04-23 00:35:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/lava-logs.yaml 2026-04-23 00:35:56,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:35:56,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:35:56,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e968ff8137cb226ce1f32a/lava_callback.json.gz 2026-04-23 00:35:56,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None 2026-04-23 00:35:56,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:35:56,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:35:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ff8137cb226ce1f32a HTTP/1.1" 200 None INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:35:56,553 - lava_callback - INFO - Completed processing callback for node 69e968ff8137cb226ce1f32a 2026-04-23 00:36:02,363 - lava_callback - INFO - Received callback for node 69e968fc8137cb226ce1f31f INFO: 172.21.0.1:59708 - "POST /node/69e968fc8137cb226ce1f31f HTTP/1.0" 202 Accepted 2026-04-23 00:36:02,369 - lava_callback - INFO - Starting async job submit for node 69e968fc8137cb226ce1f31f 2026-04-23 00:36:02,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:02,405 - lava_callback - DEBUG - Processing node 69e968fc8137cb226ce1f31f: baseline-arm-kontron 2026-04-23 00:36:02,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:02,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:02,710 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/log.txt.gz 2026-04-23 00:36:02,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:02,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:02,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/lava-logs.yaml 2026-04-23 00:36:02,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:03,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:03,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e968fc8137cb226ce1f31f/lava_callback.json.gz 2026-04-23 00:36:03,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:03,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:36:03,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:03,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968fc8137cb226ce1f31f HTTP/1.1" 200 None 2026-04-23 00:36:03,220 - lava_callback - INFO - Completed processing callback for node 69e968fc8137cb226ce1f31f INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:24,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:24,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:27,182 - lava_callback - INFO - Received callback for node 69e9691b8137cb226ce1f36b INFO: 172.21.0.1:37746 - "POST /node/69e9691b8137cb226ce1f36b HTTP/1.0" 202 Accepted 2026-04-23 00:36:27,188 - lava_callback - INFO - Starting async job submit for node 69e9691b8137cb226ce1f36b 2026-04-23 00:36:27,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:27,225 - lava_callback - DEBUG - Processing node 69e9691b8137cb226ce1f36b: ltp-dio 2026-04-23 00:36:27,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:27,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:27,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/log.txt.gz 2026-04-23 00:36:27,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:28,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:28,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/lava-logs.yaml 2026-04-23 00:36:28,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:36:28,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:36:28,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e9691b8137cb226ce1f36b/lava_callback.json.gz 2026-04-23 00:36:28,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:28,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:36:28,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:28,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691b8137cb226ce1f36b HTTP/1.1" 200 None 2026-04-23 00:36:28,328 - lava_callback - INFO - Completed processing callback for node 69e9691b8137cb226ce1f36b INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:36:54,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:36:54,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:37:55,053 - lava_callback - INFO - Received callback for node 69e6c6ce60f5826562c15988 INFO: 172.21.0.1:60074 - "POST /node/69e6c6ce60f5826562c15988 HTTP/1.0" 202 Accepted 2026-04-23 00:37:55,058 - lava_callback - INFO - Starting async job submit for node 69e6c6ce60f5826562c15988 2026-04-23 00:37:55,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,074 - lava_callback - DEBUG - Processing node 69e6c6ce60f5826562c15988: baseline-arm-clabbe 2026-04-23 00:37:55,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c6ce60f5826562c15988 2026-04-23 00:37:55,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:37:55,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:37:55,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c6ce60f5826562c15988 HTTP/1.1" 200 None 2026-04-23 00:37:55,132 - lava_callback - ERROR - Error processing callback for node 69e6c6ce60f5826562c15988: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:38:35,081 - lava_callback - INFO - Received callback for node 69e6c6f760f5826562c159a3 INFO: 172.21.0.1:47820 - "POST /node/69e6c6f760f5826562c159a3 HTTP/1.0" 202 Accepted 2026-04-23 00:38:35,090 - lava_callback - INFO - Starting async job submit for node 69e6c6f760f5826562c159a3 2026-04-23 00:38:35,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,128 - lava_callback - DEBUG - Processing node 69e6c6f760f5826562c159a3: baseline-arm-clabbe 2026-04-23 00:38:35,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c6f760f5826562c159a3 2026-04-23 00:38:35,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:38:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:38:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c6f760f5826562c159a3 HTTP/1.1" 200 None 2026-04-23 00:38:35,221 - lava_callback - ERROR - Error processing callback for node 69e6c6f760f5826562c159a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:39:01,301 - lava_callback - INFO - Received callback for node 69e6c71960f5826562c159b5 INFO: 172.21.0.1:42806 - "POST /node/69e6c71960f5826562c159b5 HTTP/1.0" 202 Accepted 2026-04-23 00:39:01,306 - lava_callback - INFO - Starting async job submit for node 69e6c71960f5826562c159b5 2026-04-23 00:39:01,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,321 - lava_callback - DEBUG - Processing node 69e6c71960f5826562c159b5: baseline-arm-baylibre 2026-04-23 00:39:01,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c71960f5826562c159b5 2026-04-23 00:39:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:39:01,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:01,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c71960f5826562c159b5 HTTP/1.1" 200 None 2026-04-23 00:39:01,366 - lava_callback - ERROR - Error processing callback for node 69e6c71960f5826562c159b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:39:35,162 - lava_callback - INFO - Received callback for node 69e6c74460f5826562c159c3 INFO: 172.21.0.1:35886 - "POST /node/69e6c74460f5826562c159c3 HTTP/1.0" 202 Accepted 2026-04-23 00:39:35,171 - lava_callback - INFO - Starting async job submit for node 69e6c74460f5826562c159c3 2026-04-23 00:39:35,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,200 - lava_callback - DEBUG - Processing node 69e6c74460f5826562c159c3: baseline-arm-clabbe 2026-04-23 00:39:35,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c74460f5826562c159c3 2026-04-23 00:39:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:39:35,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:39:35,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c74460f5826562c159c3 HTTP/1.1" 200 None 2026-04-23 00:39:35,270 - lava_callback - ERROR - Error processing callback for node 69e6c74460f5826562c159c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:40:15,127 - lava_callback - INFO - Received callback for node 69e6c76a60f5826562c159d4 INFO: 172.21.0.1:35856 - "POST /node/69e6c76a60f5826562c159d4 HTTP/1.0" 202 Accepted 2026-04-23 00:40:15,132 - lava_callback - INFO - Starting async job submit for node 69e6c76a60f5826562c159d4 2026-04-23 00:40:15,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,147 - lava_callback - DEBUG - Processing node 69e6c76a60f5826562c159d4: baseline-arm-clabbe 2026-04-23 00:40:15,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c76a60f5826562c159d4 2026-04-23 00:40:15,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:40:15,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:40:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:40:15,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c76a60f5826562c159d4 HTTP/1.1" 200 None 2026-04-23 00:40:15,194 - lava_callback - ERROR - Error processing callback for node 69e6c76a60f5826562c159d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:41:35,240 - lava_callback - INFO - Received callback for node 69e6c7b760f5826562c159ef INFO: 172.21.0.1:36938 - "POST /node/69e6c7b760f5826562c159ef HTTP/1.0" 202 Accepted 2026-04-23 00:41:35,245 - lava_callback - INFO - Starting async job submit for node 69e6c7b760f5826562c159ef 2026-04-23 00:41:35,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,261 - lava_callback - DEBUG - Processing node 69e6c7b760f5826562c159ef: baseline-arm-clabbe 2026-04-23 00:41:35,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c7b760f5826562c159ef 2026-04-23 00:41:35,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:41:35,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:41:35,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c7b760f5826562c159ef HTTP/1.1" 200 None 2026-04-23 00:41:35,318 - lava_callback - ERROR - Error processing callback for node 69e6c7b760f5826562c159ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:42:15,202 - lava_callback - INFO - Received callback for node 69e6c7df60f5826562c15a05 INFO: 172.21.0.1:44988 - "POST /node/69e6c7df60f5826562c15a05 HTTP/1.0" 202 Accepted 2026-04-23 00:42:15,207 - lava_callback - INFO - Starting async job submit for node 69e6c7df60f5826562c15a05 2026-04-23 00:42:15,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,222 - lava_callback - DEBUG - Processing node 69e6c7df60f5826562c15a05: baseline-arm-clabbe 2026-04-23 00:42:15,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c7df60f5826562c15a05 2026-04-23 00:42:15,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:42:15,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:15,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c7df60f5826562c15a05 HTTP/1.1" 200 None 2026-04-23 00:42:15,266 - lava_callback - ERROR - Error processing callback for node 69e6c7df60f5826562c15a05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:42:55,252 - lava_callback - INFO - Received callback for node 69e6c80660f5826562c15a1e INFO: 172.21.0.1:38612 - "POST /node/69e6c80660f5826562c15a1e HTTP/1.0" 202 Accepted 2026-04-23 00:42:55,257 - lava_callback - INFO - Starting async job submit for node 69e6c80660f5826562c15a1e 2026-04-23 00:42:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,272 - lava_callback - DEBUG - Processing node 69e6c80660f5826562c15a1e: baseline-arm-clabbe 2026-04-23 00:42:55,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c80660f5826562c15a1e 2026-04-23 00:42:55,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:42:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:42:55,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c80660f5826562c15a1e HTTP/1.1" 200 None 2026-04-23 00:42:55,348 - lava_callback - ERROR - Error processing callback for node 69e6c80660f5826562c15a1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:10,937 - lava_callback - INFO - Received callback for node 69e968ef8137cb226ce1f2c4 INFO: 172.21.0.1:39494 - "POST /node/69e968ef8137cb226ce1f2c4 HTTP/1.0" 202 Accepted 2026-04-23 00:44:10,943 - lava_callback - INFO - Starting async job submit for node 69e968ef8137cb226ce1f2c4 2026-04-23 00:44:10,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:10,980 - lava_callback - DEBUG - Processing node 69e968ef8137cb226ce1f2c4: baseline-arm-broonie 2026-04-23 00:44:11,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/log.txt.gz 2026-04-23 00:44:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/lava-logs.yaml 2026-04-23 00:44:11,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:11,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:11,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ef8137cb226ce1f2c4/lava_callback.json.gz 2026-04-23 00:44:11,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:11,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:44:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:11,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ef8137cb226ce1f2c4 HTTP/1.1" 200 None 2026-04-23 00:44:11,836 - lava_callback - INFO - Completed processing callback for node 69e968ef8137cb226ce1f2c4 INFO: 172.21.0.1:39500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:24,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:24,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:33,674 - lava_callback - INFO - Received callback for node 69e968ee8137cb226ce1f2c1 INFO: 172.21.0.1:47942 - "POST /node/69e968ee8137cb226ce1f2c1 HTTP/1.0" 202 Accepted 2026-04-23 00:44:33,680 - lava_callback - INFO - Starting async job submit for node 69e968ee8137cb226ce1f2c1 2026-04-23 00:44:33,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:33,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:33,716 - lava_callback - DEBUG - Processing node 69e968ee8137cb226ce1f2c1: baseline-arm-broonie 2026-04-23 00:44:33,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:33,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/log.txt.gz 2026-04-23 00:44:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:34,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/lava-logs.yaml 2026-04-23 00:44:34,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:44:34,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:44:34,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ee8137cb226ce1f2c1/lava_callback.json.gz 2026-04-23 00:44:34,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:44:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:34,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ee8137cb226ce1f2c1 HTTP/1.1" 200 None 2026-04-23 00:44:34,467 - lava_callback - INFO - Completed processing callback for node 69e968ee8137cb226ce1f2c1 INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:44:54,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:44:54,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:07,664 - lava_callback - INFO - Received callback for node 69e96b8c8137cb226ce1f4fa INFO: 172.21.0.1:51166 - "POST /node/69e96b8c8137cb226ce1f4fa HTTP/1.0" 202 Accepted 2026-04-23 00:45:07,670 - lava_callback - INFO - Starting async job submit for node 69e96b8c8137cb226ce1f4fa 2026-04-23 00:45:07,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,691 - lava_callback - DEBUG - Processing node 69e96b8c8137cb226ce1f4fa: baseline-arm 2026-04-23 00:45:07,696 - lava_callback - WARNING - Failed to upload log 2026-04-23 00:45:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:07,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:07,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96b8c8137cb226ce1f4fa/lava-logs.yaml 2026-04-23 00:45:07,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:07,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:07,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96b8c8137cb226ce1f4fa/lava_callback.json.gz 2026-04-23 00:45:07,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:45:07,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:07,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96b8c8137cb226ce1f4fa HTTP/1.1" 200 None 2026-04-23 00:45:07,952 - lava_callback - INFO - Completed processing callback for node 69e96b8c8137cb226ce1f4fa INFO: 172.21.0.1:37436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:24,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:24,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:45:49,287 - lava_callback - INFO - Received callback for node 69e968ec8137cb226ce1f2be INFO: 172.21.0.1:50562 - "POST /node/69e968ec8137cb226ce1f2be HTTP/1.0" 202 Accepted 2026-04-23 00:45:49,293 - lava_callback - INFO - Starting async job submit for node 69e968ec8137cb226ce1f2be 2026-04-23 00:45:49,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:49,329 - lava_callback - DEBUG - Processing node 69e968ec8137cb226ce1f2be: baseline-arm-broonie 2026-04-23 00:45:49,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:49,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:49,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/log.txt.gz 2026-04-23 00:45:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:49,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:49,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/lava-logs.yaml 2026-04-23 00:45:49,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:45:50,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:45:50,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968ec8137cb226ce1f2be/lava_callback.json.gz 2026-04-23 00:45:50,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:50,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:45:50,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:50,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968ec8137cb226ce1f2be HTTP/1.1" 200 None 2026-04-23 00:45:50,321 - lava_callback - INFO - Completed processing callback for node 69e968ec8137cb226ce1f2be 2026-04-23 00:45:54,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:45:54,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:46:01,760 - lava_callback - INFO - Received callback for node 69e6c8c160f5826562c15a78 INFO: 172.21.0.1:44712 - "POST /node/69e6c8c160f5826562c15a78 HTTP/1.0" 202 Accepted 2026-04-23 00:46:01,765 - lava_callback - INFO - Starting async job submit for node 69e6c8c160f5826562c15a78 2026-04-23 00:46:01,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,780 - lava_callback - DEBUG - Processing node 69e6c8c160f5826562c15a78: baseline-arm-baylibre 2026-04-23 00:46:01,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c8c160f5826562c15a78 2026-04-23 00:46:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:46:01,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:01,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c8c160f5826562c15a78 HTTP/1.1" 200 None 2026-04-23 00:46:01,830 - lava_callback - ERROR - Error processing callback for node 69e6c8c160f5826562c15a78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:46:49,873 - lava_callback - INFO - Received callback for node 69e968f08137cb226ce1f2c7 INFO: 172.21.0.1:33772 - "POST /node/69e968f08137cb226ce1f2c7 HTTP/1.0" 202 Accepted 2026-04-23 00:46:49,878 - lava_callback - INFO - Starting async job submit for node 69e968f08137cb226ce1f2c7 2026-04-23 00:46:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:49,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:49,915 - lava_callback - DEBUG - Processing node 69e968f08137cb226ce1f2c7: baseline-arm-broonie 2026-04-23 00:46:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/log.txt.gz 2026-04-23 00:46:50,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/lava-logs.yaml 2026-04-23 00:46:50,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:46:50,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:46:50,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e968f08137cb226ce1f2c7/lava_callback.json.gz 2026-04-23 00:46:50,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:50,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:46:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:50,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968f08137cb226ce1f2c7 HTTP/1.1" 200 None 2026-04-23 00:46:50,796 - lava_callback - INFO - Completed processing callback for node 69e968f08137cb226ce1f2c7 2026-04-23 00:46:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:46:54,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:11,238 - lava_callback - INFO - Received callback for node 69e967b78137cb226ce1cb20 INFO: 172.21.0.1:52820 - "POST /node/69e967b78137cb226ce1cb20 HTTP/1.0" 202 Accepted 2026-04-23 00:48:11,244 - lava_callback - INFO - Starting async job submit for node 69e967b78137cb226ce1cb20 2026-04-23 00:48:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:11,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:11,319 - lava_callback - DEBUG - Processing node 69e967b78137cb226ce1cb20: ltp-smoke 2026-04-23 00:48:11,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:11,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:11,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/log.txt.gz 2026-04-23 00:48:12,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:12,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:12,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/lava-logs.yaml 2026-04-23 00:48:12,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:48:12,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:48:12,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e967b78137cb226ce1cb20/lava_callback.json.gz 2026-04-23 00:48:12,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:12,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 00:48:12,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:12,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e967b78137cb226ce1cb20 HTTP/1.1" 200 None 2026-04-23 00:48:12,958 - lava_callback - INFO - Completed processing callback for node 69e967b78137cb226ce1cb20 INFO: 172.21.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:24,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:24,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:48:41,895 - lava_callback - INFO - Received callback for node 69e6c95a60f5826562c15ab7 INFO: 172.21.0.1:35610 - "POST /node/69e6c95a60f5826562c15ab7 HTTP/1.0" 202 Accepted 2026-04-23 00:48:41,900 - lava_callback - INFO - Starting async job submit for node 69e6c95a60f5826562c15ab7 2026-04-23 00:48:41,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,917 - lava_callback - DEBUG - Processing node 69e6c95a60f5826562c15ab7: baseline-arm-baylibre 2026-04-23 00:48:41,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c95a60f5826562c15ab7 2026-04-23 00:48:41,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:48:41,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:48:41,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c95a60f5826562c15ab7 HTTP/1.1" 200 None 2026-04-23 00:48:41,973 - lava_callback - ERROR - Error processing callback for node 69e6c95a60f5826562c15ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:49:15,505 - lava_callback - INFO - Received callback for node 69e6c98460f5826562c15ad5 INFO: 172.21.0.1:49360 - "POST /node/69e6c98460f5826562c15ad5 HTTP/1.0" 202 Accepted 2026-04-23 00:49:15,511 - lava_callback - INFO - Starting async job submit for node 69e6c98460f5826562c15ad5 2026-04-23 00:49:15,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,533 - lava_callback - DEBUG - Processing node 69e6c98460f5826562c15ad5: baseline-arm-clabbe 2026-04-23 00:49:15,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c98460f5826562c15ad5 2026-04-23 00:49:15,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:49:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:15,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c98460f5826562c15ad5 HTTP/1.1" 200 None 2026-04-23 00:49:15,583 - lava_callback - ERROR - Error processing callback for node 69e6c98460f5826562c15ad5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:49:49,223 - lava_callback - INFO - Received callback for node 69e969148137cb226ce1f34a INFO: 172.21.0.1:46564 - "POST /node/69e969148137cb226ce1f34a HTTP/1.0" 202 Accepted 2026-04-23 00:49:49,234 - lava_callback - INFO - Starting async job submit for node 69e969148137cb226ce1f34a 2026-04-23 00:49:49,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:49,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:49,320 - lava_callback - DEBUG - Processing node 69e969148137cb226ce1f34a: ltp-cap_bounds 2026-04-23 00:49:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:49,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:49,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/log.txt.gz 2026-04-23 00:49:50,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:50,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:50,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/lava-logs.yaml 2026-04-23 00:49:50,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:50,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:50,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e969148137cb226ce1f34a/lava_callback.json.gz 2026-04-23 00:49:50,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:50,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:49:50,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:50,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969148137cb226ce1f34a HTTP/1.1" 200 None 2026-04-23 00:49:50,480 - lava_callback - INFO - Completed processing callback for node 69e969148137cb226ce1f34a 2026-04-23 00:49:53,035 - lava_callback - INFO - Received callback for node 69e96c7d8137cb226ce1f572 INFO: 172.21.0.1:36870 - "POST /node/69e96c7d8137cb226ce1f572 HTTP/1.0" 202 Accepted 2026-04-23 00:49:53,041 - lava_callback - INFO - Starting async job submit for node 69e96c7d8137cb226ce1f572 2026-04-23 00:49:53,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,073 - lava_callback - DEBUG - Processing node 69e96c7d8137cb226ce1f572: baseline-arm-pengutronix 2026-04-23 00:49:53,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/log.txt.gz 2026-04-23 00:49:53,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/lava-logs.yaml 2026-04-23 00:49:53,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:49:53,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:49:53,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96c7d8137cb226ce1f572/lava_callback.json.gz 2026-04-23 00:49:53,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:49:53,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:53,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96c7d8137cb226ce1f572 HTTP/1.1" 200 None 2026-04-23 00:49:53,762 - lava_callback - INFO - Completed processing callback for node 69e96c7d8137cb226ce1f572 2026-04-23 00:49:54,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:54,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:49:55,503 - lava_callback - INFO - Received callback for node 69e6c9ab60f5826562c15ae9 INFO: 172.21.0.1:36874 - "POST /node/69e6c9ab60f5826562c15ae9 HTTP/1.0" 202 Accepted 2026-04-23 00:49:55,508 - lava_callback - INFO - Starting async job submit for node 69e6c9ab60f5826562c15ae9 2026-04-23 00:49:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,525 - lava_callback - DEBUG - Processing node 69e6c9ab60f5826562c15ae9: baseline-arm-clabbe 2026-04-23 00:49:55,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9ab60f5826562c15ae9 2026-04-23 00:49:55,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:49:55,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:49:55,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9ab60f5826562c15ae9 HTTP/1.1" 200 None 2026-04-23 00:49:55,588 - lava_callback - ERROR - Error processing callback for node 69e6c9ab60f5826562c15ae9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:10,496 - lava_callback - INFO - Received callback for node 69e969278137cb226ce1f383 INFO: 172.21.0.1:51790 - "POST /node/69e969278137cb226ce1f383 HTTP/1.0" 202 Accepted 2026-04-23 00:50:10,503 - lava_callback - INFO - Starting async job submit for node 69e969278137cb226ce1f383 2026-04-23 00:50:10,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:10,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:10,542 - lava_callback - DEBUG - Processing node 69e969278137cb226ce1f383: ltp-syscalls 2026-04-23 00:50:11,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:11,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:11,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/log.txt.gz 2026-04-23 00:50:11,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:11,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:11,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/lava-logs.yaml 2026-04-23 00:50:12,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:50:12,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:50:12,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e969278137cb226ce1f383/lava_callback.json.gz 2026-04-23 00:50:12,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:12,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:50:12,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:12,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969278137cb226ce1f383 HTTP/1.1" 200 None 2026-04-23 00:50:12,220 - lava_callback - INFO - Completed processing callback for node 69e969278137cb226ce1f383 INFO: 172.21.0.1:51804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:24,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:24,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:50:41,914 - lava_callback - INFO - Received callback for node 69e6c9cf60f5826562c15af5 INFO: 172.21.0.1:44902 - "POST /node/69e6c9cf60f5826562c15af5 HTTP/1.0" 202 Accepted 2026-04-23 00:50:41,919 - lava_callback - INFO - Starting async job submit for node 69e6c9cf60f5826562c15af5 2026-04-23 00:50:41,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:41,952 - lava_callback - DEBUG - Processing node 69e6c9cf60f5826562c15af5: baseline-arm-baylibre 2026-04-23 00:50:41,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9cf60f5826562c15af5 2026-04-23 00:50:41,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:41,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:50:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:50:42,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9cf60f5826562c15af5 HTTP/1.1" 200 None 2026-04-23 00:50:42,006 - lava_callback - ERROR - Error processing callback for node 69e6c9cf60f5826562c15af5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:51:20,398 - lava_callback - INFO - Received callback for node 69e968df8137cb226ce1f29d INFO: 172.21.0.1:60068 - "POST /node/69e968df8137cb226ce1f29d HTTP/1.0" 202 Accepted 2026-04-23 00:51:20,405 - lava_callback - INFO - Starting async job submit for node 69e968df8137cb226ce1f29d 2026-04-23 00:51:20,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:20,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:20,500 - lava_callback - DEBUG - Processing node 69e968df8137cb226ce1f29d: baseline-arm 2026-04-23 00:51:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/log.txt.gz 2026-04-23 00:51:21,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/lava-logs.yaml 2026-04-23 00:51:21,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:51:21,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:51:21,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e968df8137cb226ce1f29d/lava_callback.json.gz 2026-04-23 00:51:21,991 - lava_callback - INFO - Received callback for node 69e6c9f860f5826562c15b02 2026-04-23 00:51:22,007 - lava_callback - INFO - Starting async job submit for node 69e6c9f860f5826562c15b02 INFO: 172.21.0.1:60070 - "POST /node/69e6c9f860f5826562c15b02 HTTP/1.0" 202 Accepted 2026-04-23 00:51:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 69e968df8137cb226ce1f29d. Transitting job node result: incomplete -> fail 2026-04-23 00:51:22,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:22,055 - lava_callback - DEBUG - Processing node 69e6c9f860f5826562c15b02: baseline-arm-baylibre 2026-04-23 00:51:22,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c9f860f5826562c15b02 2026-04-23 00:51:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:51:22,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:51:22,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:22,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e968df8137cb226ce1f29d HTTP/1.1" 200 None 2026-04-23 00:51:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c9f860f5826562c15b02 HTTP/1.1" 200 None 2026-04-23 00:51:22,168 - lava_callback - ERROR - Error processing callback for node 69e6c9f860f5826562c15b02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:51:22,243 - lava_callback - INFO - Completed processing callback for node 69e968df8137cb226ce1f29d 2026-04-23 00:51:24,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:24,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:51:55,644 - lava_callback - INFO - Received callback for node 69e6ca2160f5826562c15b20 INFO: 172.21.0.1:53708 - "POST /node/69e6ca2160f5826562c15b20 HTTP/1.0" 202 Accepted 2026-04-23 00:51:55,650 - lava_callback - INFO - Starting async job submit for node 69e6ca2160f5826562c15b20 2026-04-23 00:51:55,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,690 - lava_callback - DEBUG - Processing node 69e6ca2160f5826562c15b20: baseline-arm-clabbe 2026-04-23 00:51:55,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca2160f5826562c15b20 2026-04-23 00:51:55,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:51:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:51:55,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca2160f5826562c15b20 HTTP/1.1" 200 None 2026-04-23 00:51:55,742 - lava_callback - ERROR - Error processing callback for node 69e6ca2160f5826562c15b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:52:35,661 - lava_callback - INFO - Received callback for node 69e6ca4760f5826562c15b36 INFO: 172.21.0.1:43864 - "POST /node/69e6ca4760f5826562c15b36 HTTP/1.0" 202 Accepted 2026-04-23 00:52:35,666 - lava_callback - INFO - Starting async job submit for node 69e6ca4760f5826562c15b36 2026-04-23 00:52:35,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,681 - lava_callback - DEBUG - Processing node 69e6ca4760f5826562c15b36: baseline-arm-clabbe 2026-04-23 00:52:35,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca4760f5826562c15b36 2026-04-23 00:52:35,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:52:35,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:52:35,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca4760f5826562c15b36 HTTP/1.1" 200 None 2026-04-23 00:52:35,728 - lava_callback - ERROR - Error processing callback for node 69e6ca4760f5826562c15b36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:53:15,731 - lava_callback - INFO - Received callback for node 69e6ca6e60f5826562c15b4d INFO: 172.21.0.1:55470 - "POST /node/69e6ca6e60f5826562c15b4d HTTP/1.0" 202 Accepted 2026-04-23 00:53:15,736 - lava_callback - INFO - Starting async job submit for node 69e6ca6e60f5826562c15b4d 2026-04-23 00:53:15,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,751 - lava_callback - DEBUG - Processing node 69e6ca6e60f5826562c15b4d: baseline-arm-clabbe 2026-04-23 00:53:15,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca6e60f5826562c15b4d 2026-04-23 00:53:15,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:53:15,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:15,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca6e60f5826562c15b4d HTTP/1.1" 200 None 2026-04-23 00:53:15,804 - lava_callback - ERROR - Error processing callback for node 69e6ca6e60f5826562c15b4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:36,290 - lava_callback - INFO - Received callback for node 69e969028137cb226ce1f330 INFO: 172.21.0.1:55554 - "POST /node/69e969028137cb226ce1f330 HTTP/1.0" 202 Accepted 2026-04-23 00:53:36,337 - lava_callback - INFO - Starting async job submit for node 69e969028137cb226ce1f330 2026-04-23 00:53:36,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:36,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:36,375 - lava_callback - DEBUG - Processing node 69e969028137cb226ce1f330: baseline-arm-pengutronix 2026-04-23 00:53:36,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:36,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:36,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/log.txt.gz 2026-04-23 00:53:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:36,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:36,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/lava-logs.yaml 2026-04-23 00:53:36,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:37,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:37,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e969028137cb226ce1f330/lava_callback.json.gz DEBUG: Setup failed for 69e969028137cb226ce1f330. Transitting job node result: incomplete -> fail 2026-04-23 00:53:37,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:37,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:53:37,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:37,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969028137cb226ce1f330 HTTP/1.1" 200 None 2026-04-23 00:53:37,398 - lava_callback - INFO - Completed processing callback for node 69e969028137cb226ce1f330 INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:53:49,301 - lava_callback - INFO - Received callback for node 69e969168137cb226ce1f34d INFO: 172.21.0.1:48254 - "POST /node/69e969168137cb226ce1f34d HTTP/1.0" 202 Accepted 2026-04-23 00:53:49,307 - lava_callback - INFO - Starting async job submit for node 69e969168137cb226ce1f34d 2026-04-23 00:53:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:49,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:49,369 - lava_callback - DEBUG - Processing node 69e969168137cb226ce1f34d: ltp-containers 2026-04-23 00:53:49,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/log.txt.gz 2026-04-23 00:53:50,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/lava-logs.yaml 2026-04-23 00:53:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:53:50,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:53:50,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e969168137cb226ce1f34d/lava_callback.json.gz 2026-04-23 00:53:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:50,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:53:50,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:50,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969168137cb226ce1f34d HTTP/1.1" 200 None 2026-04-23 00:53:50,683 - lava_callback - INFO - Completed processing callback for node 69e969168137cb226ce1f34d 2026-04-23 00:53:55,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 00:53:55,692 - lava_callback - INFO - Received callback for node 69e6ca9460f5826562c15b58 INFO: 172.21.0.1:44138 - "POST /node/69e6ca9460f5826562c15b58 HTTP/1.0" 202 Accepted 2026-04-23 00:53:55,698 - lava_callback - INFO - Starting async job submit for node 69e6ca9460f5826562c15b58 2026-04-23 00:53:55,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,714 - lava_callback - DEBUG - Processing node 69e6ca9460f5826562c15b58: baseline-arm-clabbe 2026-04-23 00:53:55,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ca9460f5826562c15b58 2026-04-23 00:53:55,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:53:55,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:53:55,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ca9460f5826562c15b58 HTTP/1.1" 200 None 2026-04-23 00:53:55,760 - lava_callback - ERROR - Error processing callback for node 69e6ca9460f5826562c15b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46426 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:08,918 - lava_callback - INFO - Received callback for node 69e969178137cb226ce1f350 INFO: 172.21.0.1:46438 - "POST /node/69e969178137cb226ce1f350 HTTP/1.0" 202 Accepted 2026-04-23 00:54:08,925 - lava_callback - INFO - Starting async job submit for node 69e969178137cb226ce1f350 2026-04-23 00:54:08,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:08,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:08,969 - lava_callback - DEBUG - Processing node 69e969178137cb226ce1f350: ltp-controllers 2026-04-23 00:54:09,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:09,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:09,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/log.txt.gz 2026-04-23 00:54:09,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:09,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:09,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/lava-logs.yaml 2026-04-23 00:54:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:54:10,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:54:10,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e969178137cb226ce1f350/lava_callback.json.gz 2026-04-23 00:54:10,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:10,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:54:10,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:10,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969178137cb226ce1f350 HTTP/1.1" 200 None 2026-04-23 00:54:10,197 - lava_callback - INFO - Completed processing callback for node 69e969178137cb226ce1f350 INFO: 172.21.0.1:48240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:25,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:25,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:54:35,778 - lava_callback - INFO - Received callback for node 69e6cabb60f5826562c15b65 INFO: 172.21.0.1:35726 - "POST /node/69e6cabb60f5826562c15b65 HTTP/1.0" 202 Accepted 2026-04-23 00:54:35,784 - lava_callback - INFO - Starting async job submit for node 69e6cabb60f5826562c15b65 2026-04-23 00:54:35,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,799 - lava_callback - DEBUG - Processing node 69e6cabb60f5826562c15b65: baseline-arm-clabbe 2026-04-23 00:54:35,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cabb60f5826562c15b65 2026-04-23 00:54:35,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:54:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:54:35,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cabb60f5826562c15b65 HTTP/1.1" 200 None 2026-04-23 00:54:35,844 - lava_callback - ERROR - Error processing callback for node 69e6cabb60f5826562c15b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 00:55:15,747 - lava_callback - INFO - Received callback for node 69e6cae260f5826562c15b6f INFO: 172.21.0.1:57730 - "POST /node/69e6cae260f5826562c15b6f HTTP/1.0" 202 Accepted 2026-04-23 00:55:15,753 - lava_callback - INFO - Starting async job submit for node 69e6cae260f5826562c15b6f 2026-04-23 00:55:15,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,768 - lava_callback - DEBUG - Processing node 69e6cae260f5826562c15b6f: baseline-arm-clabbe 2026-04-23 00:55:15,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cae260f5826562c15b6f 2026-04-23 00:55:15,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:55:15,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:55:15,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cae260f5826562c15b6f HTTP/1.1" 200 None 2026-04-23 00:55:15,815 - lava_callback - ERROR - Error processing callback for node 69e6cae260f5826562c15b6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:56:31,298 - lava_callback - INFO - Received callback for node 69e969198137cb226ce1f365 INFO: 172.21.0.1:54234 - "POST /node/69e969198137cb226ce1f365 HTTP/1.0" 202 Accepted 2026-04-23 00:56:31,305 - lava_callback - INFO - Starting async job submit for node 69e969198137cb226ce1f365 2026-04-23 00:56:31,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:31,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:31,343 - lava_callback - DEBUG - Processing node 69e969198137cb226ce1f365: ltp-cve 2026-04-23 00:56:31,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/log.txt.gz 2026-04-23 00:56:32,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/lava-logs.yaml 2026-04-23 00:56:32,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:56:32,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:56:32,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e969198137cb226ce1f365/lava_callback.json.gz 2026-04-23 00:56:32,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:32,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:32,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:32,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:56:32,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969198137cb226ce1f365 HTTP/1.1" 200 None 2026-04-23 00:56:33,010 - lava_callback - INFO - Completed processing callback for node 69e969198137cb226ce1f365 2026-04-23 00:56:35,851 - lava_callback - INFO - Received callback for node 69e6cb2f60f5826562c15b98 INFO: 172.21.0.1:54244 - "POST /node/69e6cb2f60f5826562c15b98 HTTP/1.0" 202 Accepted 2026-04-23 00:56:35,856 - lava_callback - INFO - Starting async job submit for node 69e6cb2f60f5826562c15b98 2026-04-23 00:56:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,871 - lava_callback - DEBUG - Processing node 69e6cb2f60f5826562c15b98: baseline-arm-clabbe 2026-04-23 00:56:35,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb2f60f5826562c15b98 2026-04-23 00:56:35,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 00:56:35,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:35,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb2f60f5826562c15b98 HTTP/1.1" 200 None 2026-04-23 00:56:35,932 - lava_callback - ERROR - Error processing callback for node 69e6cb2f60f5826562c15b98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:56:55,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:56:55,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:57:42,278 - lava_callback - INFO - Received callback for node 69e6cb7560f5826562c15be1 INFO: 172.21.0.1:43794 - "POST /node/69e6cb7560f5826562c15be1 HTTP/1.0" 202 Accepted 2026-04-23 00:57:42,283 - lava_callback - INFO - Starting async job submit for node 69e6cb7560f5826562c15be1 2026-04-23 00:57:42,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,332 - lava_callback - DEBUG - Processing node 69e6cb7560f5826562c15be1: baseline-arm-baylibre 2026-04-23 00:57:42,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb7560f5826562c15be1 2026-04-23 00:57:42,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 00:57:42,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:42,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb7560f5826562c15be1 HTTP/1.1" 200 None 2026-04-23 00:57:42,433 - lava_callback - ERROR - Error processing callback for node 69e6cb7560f5826562c15be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:57:48,727 - lava_callback - INFO - Received callback for node 69e9691c8137cb226ce1f36e INFO: 172.21.0.1:43808 - "POST /node/69e9691c8137cb226ce1f36e HTTP/1.0" 202 Accepted 2026-04-23 00:57:48,733 - lava_callback - INFO - Starting async job submit for node 69e9691c8137cb226ce1f36e 2026-04-23 00:57:48,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:48,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:48,801 - lava_callback - DEBUG - Processing node 69e9691c8137cb226ce1f36e: ltp-fs_bind 2026-04-23 00:57:49,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/log.txt.gz 2026-04-23 00:57:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/lava-logs.yaml 2026-04-23 00:57:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:57:49,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:57:49,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e9691c8137cb226ce1f36e/lava_callback.json.gz 2026-04-23 00:57:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:49,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:57:49,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691c8137cb226ce1f36e HTTP/1.1" 200 None 2026-04-23 00:57:49,924 - lava_callback - INFO - Completed processing callback for node 69e9691c8137cb226ce1f36e 2026-04-23 00:57:55,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:57:55,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:02,303 - lava_callback - INFO - Received callback for node 69e6cb8e60f5826562c15c4c INFO: 172.21.0.1:47764 - "POST /node/69e6cb8e60f5826562c15c4c HTTP/1.0" 202 Accepted 2026-04-23 00:58:02,309 - lava_callback - INFO - Starting async job submit for node 69e6cb8e60f5826562c15c4c 2026-04-23 00:58:02,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,325 - lava_callback - DEBUG - Processing node 69e6cb8e60f5826562c15c4c: baseline-arm64-baylibre 2026-04-23 00:58:02,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb8e60f5826562c15c4c 2026-04-23 00:58:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:02,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:02,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb8e60f5826562c15c4c HTTP/1.1" 200 None 2026-04-23 00:58:02,371 - lava_callback - ERROR - Error processing callback for node 69e6cb8e60f5826562c15c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:03,010 - lava_callback - INFO - Received callback for node 69e6cb8f60f5826562c15c4f INFO: 172.21.0.1:47768 - "POST /node/69e6cb8f60f5826562c15c4f HTTP/1.0" 202 Accepted 2026-04-23 00:58:03,016 - lava_callback - INFO - Starting async job submit for node 69e6cb8f60f5826562c15c4f 2026-04-23 00:58:03,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,033 - lava_callback - DEBUG - Processing node 69e6cb8f60f5826562c15c4f: baseline-arm64-baylibre 2026-04-23 00:58:03,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb8f60f5826562c15c4f 2026-04-23 00:58:03,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:03,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb8f60f5826562c15c4f HTTP/1.1" 200 None 2026-04-23 00:58:03,085 - lava_callback - ERROR - Error processing callback for node 69e6cb8f60f5826562c15c4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:03,701 - lava_callback - INFO - Received callback for node 69e6cb9060f5826562c15c52 INFO: 172.21.0.1:47776 - "POST /node/69e6cb9060f5826562c15c52 HTTP/1.0" 202 Accepted 2026-04-23 00:58:03,707 - lava_callback - INFO - Starting async job submit for node 69e6cb9060f5826562c15c52 2026-04-23 00:58:03,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,725 - lava_callback - DEBUG - Processing node 69e6cb9060f5826562c15c52: baseline-arm64-baylibre 2026-04-23 00:58:03,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9060f5826562c15c52 2026-04-23 00:58:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:03,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:03,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9060f5826562c15c52 HTTP/1.1" 200 None 2026-04-23 00:58:03,771 - lava_callback - ERROR - Error processing callback for node 69e6cb9060f5826562c15c52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:04,365 - lava_callback - INFO - Received callback for node 69e6cb9260f5826562c15c59 INFO: 172.21.0.1:47784 - "POST /node/69e6cb9260f5826562c15c59 HTTP/1.0" 202 Accepted 2026-04-23 00:58:04,371 - lava_callback - INFO - Starting async job submit for node 69e6cb9260f5826562c15c59 2026-04-23 00:58:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:04,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,385 - lava_callback - DEBUG - Processing node 69e6cb9260f5826562c15c59: baseline-arm64-baylibre 2026-04-23 00:58:04,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9260f5826562c15c59 2026-04-23 00:58:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:04,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9260f5826562c15c59 HTTP/1.1" 200 None 2026-04-23 00:58:04,430 - lava_callback - ERROR - Error processing callback for node 69e6cb9260f5826562c15c59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:05,012 - lava_callback - INFO - Received callback for node 69e6cb9460f5826562c15c5c INFO: 172.21.0.1:47798 - "POST /node/69e6cb9460f5826562c15c5c HTTP/1.0" 202 Accepted 2026-04-23 00:58:05,018 - lava_callback - INFO - Starting async job submit for node 69e6cb9460f5826562c15c5c 2026-04-23 00:58:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,041 - lava_callback - DEBUG - Processing node 69e6cb9460f5826562c15c5c: baseline-arm64-baylibre 2026-04-23 00:58:05,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9460f5826562c15c5c 2026-04-23 00:58:05,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:05,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9460f5826562c15c5c HTTP/1.1" 200 None 2026-04-23 00:58:05,089 - lava_callback - ERROR - Error processing callback for node 69e6cb9460f5826562c15c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:05,693 - lava_callback - INFO - Received callback for node 69e6cb9560f5826562c15c5f INFO: 172.21.0.1:47812 - "POST /node/69e6cb9560f5826562c15c5f HTTP/1.0" 202 Accepted 2026-04-23 00:58:05,699 - lava_callback - INFO - Starting async job submit for node 69e6cb9560f5826562c15c5f 2026-04-23 00:58:05,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,715 - lava_callback - DEBUG - Processing node 69e6cb9560f5826562c15c5f: baseline-arm64-baylibre 2026-04-23 00:58:05,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cb9560f5826562c15c5f 2026-04-23 00:58:05,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:05,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:05,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cb9560f5826562c15c5f HTTP/1.1" 200 None 2026-04-23 00:58:05,793 - lava_callback - ERROR - Error processing callback for node 69e6cb9560f5826562c15c5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:09,164 - lava_callback - INFO - Received callback for node 69e9691e8137cb226ce1f371 INFO: 172.21.0.1:47820 - "POST /node/69e9691e8137cb226ce1f371 HTTP/1.0" 202 Accepted 2026-04-23 00:58:09,171 - lava_callback - INFO - Starting async job submit for node 69e9691e8137cb226ce1f371 2026-04-23 00:58:09,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:09,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:09,211 - lava_callback - DEBUG - Processing node 69e9691e8137cb226ce1f371: ltp-fsx 2026-04-23 00:58:09,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:09,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:09,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/log.txt.gz 2026-04-23 00:58:10,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:10,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:10,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/lava-logs.yaml 2026-04-23 00:58:10,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 00:58:10,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 00:58:10,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e9691e8137cb226ce1f371/lava_callback.json.gz 2026-04-23 00:58:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:10,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 00:58:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:10,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691e8137cb226ce1f371 HTTP/1.1" 200 None 2026-04-23 00:58:10,515 - lava_callback - INFO - Completed processing callback for node 69e9691e8137cb226ce1f371 INFO: 172.21.0.1:60928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:25,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:35,968 - lava_callback - INFO - Received callback for node 69e6cba560f5826562c15c85 INFO: 172.21.0.1:33444 - "POST /node/69e6cba560f5826562c15c85 HTTP/1.0" 202 Accepted 2026-04-23 00:58:35,974 - lava_callback - INFO - Starting async job submit for node 69e6cba560f5826562c15c85 2026-04-23 00:58:35,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:35,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:35,990 - lava_callback - DEBUG - Processing node 69e6cba560f5826562c15c85: baseline-arm64-clabbe 2026-04-23 00:58:35,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba560f5826562c15c85 2026-04-23 00:58:35,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:36,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:36,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba560f5826562c15c85 HTTP/1.1" 200 None 2026-04-23 00:58:36,040 - lava_callback - ERROR - Error processing callback for node 69e6cba560f5826562c15c85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:58:36,655 - lava_callback - INFO - Received callback for node 69e6cba760f5826562c15cad INFO: 172.21.0.1:33472 - "POST /node/69e6cba760f5826562c15cad HTTP/1.0" 202 Accepted 2026-04-23 00:58:36,661 - lava_callback - INFO - Starting async job submit for node 69e6cba760f5826562c15cad 2026-04-23 00:58:36,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,678 - lava_callback - DEBUG - Processing node 69e6cba760f5826562c15cad: baseline-arm64-clabbe 2026-04-23 00:58:36,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba760f5826562c15cad 2026-04-23 00:58:36,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:36,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:36,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba760f5826562c15cad HTTP/1.1" 200 None 2026-04-23 00:58:36,729 - lava_callback - ERROR - Error processing callback for node 69e6cba760f5826562c15cad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:37,325 - lava_callback - INFO - Received callback for node 69e6cba860f5826562c15cb0 INFO: 172.21.0.1:33484 - "POST /node/69e6cba860f5826562c15cb0 HTTP/1.0" 202 Accepted 2026-04-23 00:58:37,331 - lava_callback - INFO - Starting async job submit for node 69e6cba860f5826562c15cb0 2026-04-23 00:58:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,356 - lava_callback - DEBUG - Processing node 69e6cba860f5826562c15cb0: baseline-arm64-clabbe 2026-04-23 00:58:37,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba860f5826562c15cb0 2026-04-23 00:58:37,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:37,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:37,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba860f5826562c15cb0 HTTP/1.1" 200 None 2026-04-23 00:58:37,402 - lava_callback - ERROR - Error processing callback for node 69e6cba860f5826562c15cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:38,010 - lava_callback - INFO - Received callback for node 69e6cba960f5826562c15cb3 INFO: 172.21.0.1:33494 - "POST /node/69e6cba960f5826562c15cb3 HTTP/1.0" 202 Accepted 2026-04-23 00:58:38,020 - lava_callback - INFO - Starting async job submit for node 69e6cba960f5826562c15cb3 2026-04-23 00:58:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,039 - lava_callback - DEBUG - Processing node 69e6cba960f5826562c15cb3: baseline-arm64-clabbe 2026-04-23 00:58:38,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba960f5826562c15cb3 2026-04-23 00:58:38,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:38,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba960f5826562c15cb3 HTTP/1.1" 200 None 2026-04-23 00:58:38,092 - lava_callback - ERROR - Error processing callback for node 69e6cba960f5826562c15cb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:38,693 - lava_callback - INFO - Received callback for node 69e6cba960f5826562c15cb6 INFO: 172.21.0.1:33510 - "POST /node/69e6cba960f5826562c15cb6 HTTP/1.0" 202 Accepted 2026-04-23 00:58:38,699 - lava_callback - INFO - Starting async job submit for node 69e6cba960f5826562c15cb6 2026-04-23 00:58:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,716 - lava_callback - DEBUG - Processing node 69e6cba960f5826562c15cb6: baseline-arm64-clabbe 2026-04-23 00:58:38,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cba960f5826562c15cb6 2026-04-23 00:58:38,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:38,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:38,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cba960f5826562c15cb6 HTTP/1.1" 200 None 2026-04-23 00:58:38,770 - lava_callback - ERROR - Error processing callback for node 69e6cba960f5826562c15cb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:39,371 - lava_callback - INFO - Received callback for node 69e6cbab60f5826562c15cbc INFO: 172.21.0.1:33522 - "POST /node/69e6cbab60f5826562c15cbc HTTP/1.0" 202 Accepted 2026-04-23 00:58:39,377 - lava_callback - INFO - Starting async job submit for node 69e6cbab60f5826562c15cbc 2026-04-23 00:58:39,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,392 - lava_callback - DEBUG - Processing node 69e6cbab60f5826562c15cbc: baseline-arm64-clabbe 2026-04-23 00:58:39,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbab60f5826562c15cbc 2026-04-23 00:58:39,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:39,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbab60f5826562c15cbc HTTP/1.1" 200 None 2026-04-23 00:58:39,462 - lava_callback - ERROR - Error processing callback for node 69e6cbab60f5826562c15cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:40,062 - lava_callback - INFO - Received callback for node 69e6cbaa60f5826562c15cb9 INFO: 172.21.0.1:49808 - "POST /node/69e6cbaa60f5826562c15cb9 HTTP/1.0" 202 Accepted 2026-04-23 00:58:40,069 - lava_callback - INFO - Starting async job submit for node 69e6cbaa60f5826562c15cb9 2026-04-23 00:58:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,086 - lava_callback - DEBUG - Processing node 69e6cbaa60f5826562c15cb9: baseline-arm64-clabbe 2026-04-23 00:58:40,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbaa60f5826562c15cb9 2026-04-23 00:58:40,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 00:58:40,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:40,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbaa60f5826562c15cb9 HTTP/1.1" 200 None 2026-04-23 00:58:40,135 - lava_callback - ERROR - Error processing callback for node 69e6cbaa60f5826562c15cb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 00:58:42,306 - lava_callback - INFO - Received callback for node 69e6cbc060f5826562c15ceb INFO: 172.21.0.1:49824 - "POST /node/69e6cbc060f5826562c15ceb HTTP/1.0" 202 Accepted 2026-04-23 00:58:42,313 - lava_callback - INFO - Starting async job submit for node 69e6cbc060f5826562c15ceb 2026-04-23 00:58:42,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,331 - lava_callback - DEBUG - Processing node 69e6cbc060f5826562c15ceb: baseline-arm-baylibre 2026-04-23 00:58:42,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cbc060f5826562c15ceb 2026-04-23 00:58:42,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 00:58:42,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:58:42,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cbc060f5826562c15ceb HTTP/1.1" 200 None 2026-04-23 00:58:42,383 - lava_callback - ERROR - Error processing callback for node 69e6cbc060f5826562c15ceb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:02,426 - lava_callback - INFO - Received callback for node 69e6cc0a60f5826562c15dbf INFO: 172.21.0.1:40974 - "POST /node/69e6cc0a60f5826562c15dbf HTTP/1.0" 202 Accepted 2026-04-23 01:00:02,431 - lava_callback - INFO - Starting async job submit for node 69e6cc0a60f5826562c15dbf 2026-04-23 01:00:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,451 - lava_callback - DEBUG - Processing node 69e6cc0a60f5826562c15dbf: baseline-arm-baylibre 2026-04-23 01:00:02,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc0a60f5826562c15dbf 2026-04-23 01:00:02,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:00:02,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:02,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc0a60f5826562c15dbf HTTP/1.1" 200 None 2026-04-23 01:00:02,515 - lava_callback - ERROR - Error processing callback for node 69e6cc0a60f5826562c15dbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:00:15,457 - lava_callback - INFO - Received callback for node 69e96f088137cb226ce1f6e9 INFO: 172.21.0.1:45838 - "POST /node/69e96f088137cb226ce1f6e9 HTTP/1.0" 202 Accepted 2026-04-23 01:00:15,467 - lava_callback - INFO - Starting async job submit for node 69e96f088137cb226ce1f6e9 2026-04-23 01:00:15,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:15,508 - lava_callback - DEBUG - Processing node 69e96f088137cb226ce1f6e9: baseline-arm 2026-04-23 01:00:15,517 - lava_callback - WARNING - Failed to upload log 2026-04-23 01:00:15,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:15,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:15,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96f088137cb226ce1f6e9/lava-logs.yaml 2026-04-23 01:00:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:15,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:15,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96f088137cb226ce1f6e9/lava_callback.json.gz 2026-04-23 01:00:15,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:15,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:15,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:00:15,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:16,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96f088137cb226ce1f6e9 HTTP/1.1" 200 None 2026-04-23 01:00:16,066 - lava_callback - INFO - Completed processing callback for node 69e96f088137cb226ce1f6e9 INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:25,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:25,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:33,309 - lava_callback - INFO - Received callback for node 69e9691f8137cb226ce1f374 INFO: 172.21.0.1:40540 - "POST /node/69e9691f8137cb226ce1f374 HTTP/1.0" 202 Accepted 2026-04-23 01:00:33,320 - lava_callback - INFO - Starting async job submit for node 69e9691f8137cb226ce1f374 2026-04-23 01:00:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:33,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:33,404 - lava_callback - DEBUG - Processing node 69e9691f8137cb226ce1f374: ltp-input 2026-04-23 01:00:34,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:34,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:34,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/log.txt.gz 2026-04-23 01:00:34,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:34,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:34,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/lava-logs.yaml 2026-04-23 01:00:34,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:00:35,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:00:35,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e9691f8137cb226ce1f374/lava_callback.json.gz 2026-04-23 01:00:35,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:35,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:00:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:35,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9691f8137cb226ce1f374 HTTP/1.1" 200 None 2026-04-23 01:00:35,225 - lava_callback - INFO - Completed processing callback for node 69e9691f8137cb226ce1f374 INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:00:55,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:55,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 01:00:56,027 - lava_callback - INFO - Received callback for node 69e6cc3360f5826562c15dfb INFO: 172.21.0.1:42228 - "POST /node/69e6cc3360f5826562c15dfb HTTP/1.0" 202 Accepted 2026-04-23 01:00:56,032 - lava_callback - INFO - Starting async job submit for node 69e6cc3360f5826562c15dfb 2026-04-23 01:00:56,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,062 - lava_callback - DEBUG - Processing node 69e6cc3360f5826562c15dfb: baseline-arm-clabbe 2026-04-23 01:00:56,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc3360f5826562c15dfb 2026-04-23 01:00:56,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 01:00:56,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:00:56,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc3360f5826562c15dfb HTTP/1.1" 200 None 2026-04-23 01:00:56,145 - lava_callback - ERROR - Error processing callback for node 69e6cc3360f5826562c15dfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:01:15,958 - lava_callback - INFO - Received callback for node 69e6cc5960f5826562c15e13 INFO: 172.21.0.1:57488 - "POST /node/69e6cc5960f5826562c15e13 HTTP/1.0" 202 Accepted 2026-04-23 01:01:15,964 - lava_callback - INFO - Starting async job submit for node 69e6cc5960f5826562c15e13 2026-04-23 01:01:15,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:15,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:15,979 - lava_callback - DEBUG - Processing node 69e6cc5960f5826562c15e13: baseline-arm-clabbe 2026-04-23 01:01:15,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc5960f5826562c15e13 2026-04-23 01:01:15,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:16,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-23 01:01:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:16,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc5960f5826562c15e13 HTTP/1.1" 200 None 2026-04-23 01:01:16,037 - lava_callback - ERROR - Error processing callback for node 69e6cc5960f5826562c15e13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54926 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:01:50,071 - lava_callback - INFO - Received callback for node 69e969218137cb226ce1f377 INFO: 172.21.0.1:59484 - "POST /node/69e969218137cb226ce1f377 HTTP/1.0" 202 Accepted 2026-04-23 01:01:50,077 - lava_callback - INFO - Starting async job submit for node 69e969218137cb226ce1f377 2026-04-23 01:01:50,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:50,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:50,116 - lava_callback - DEBUG - Processing node 69e969218137cb226ce1f377: ltp-ipc 2026-04-23 01:01:50,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:50,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:50,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/log.txt.gz 2026-04-23 01:01:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:51,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:51,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/lava-logs.yaml 2026-04-23 01:01:51,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:01:51,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:01:51,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e969218137cb226ce1f377/lava_callback.json.gz 2026-04-23 01:01:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:51,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:01:51,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969218137cb226ce1f377 HTTP/1.1" 200 None 2026-04-23 01:01:51,441 - lava_callback - INFO - Completed processing callback for node 69e969218137cb226ce1f377 2026-04-23 01:01:55,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:01:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:02,587 - lava_callback - INFO - Received callback for node 69e6cc7a60f5826562c15e22 INFO: 172.21.0.1:50002 - "POST /node/69e6cc7a60f5826562c15e22 HTTP/1.0" 202 Accepted 2026-04-23 01:02:02,592 - lava_callback - INFO - Starting async job submit for node 69e6cc7a60f5826562c15e22 2026-04-23 01:02:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,607 - lava_callback - DEBUG - Processing node 69e6cc7a60f5826562c15e22: baseline-arm-baylibre 2026-04-23 01:02:02,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cc7a60f5826562c15e22 2026-04-23 01:02:02,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:02:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:02,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cc7a60f5826562c15e22 HTTP/1.1" 200 None 2026-04-23 01:02:02,652 - lava_callback - ERROR - Error processing callback for node 69e6cc7a60f5826562c15e22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:10,724 - lava_callback - INFO - Received callback for node 69e969228137cb226ce1f37a INFO: 172.21.0.1:48488 - "POST /node/69e969228137cb226ce1f37a HTTP/1.0" 202 Accepted 2026-04-23 01:02:10,730 - lava_callback - INFO - Starting async job submit for node 69e969228137cb226ce1f37a 2026-04-23 01:02:10,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:10,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:10,769 - lava_callback - DEBUG - Processing node 69e969228137cb226ce1f37a: ltp-pty 2026-04-23 01:02:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/log.txt.gz 2026-04-23 01:02:11,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/lava-logs.yaml 2026-04-23 01:02:11,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:02:11,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:02:11,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e969228137cb226ce1f37a/lava_callback.json.gz 2026-04-23 01:02:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:11,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:02:11,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:11,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969228137cb226ce1f37a HTTP/1.1" 200 None 2026-04-23 01:02:11,956 - lava_callback - INFO - Completed processing callback for node 69e969228137cb226ce1f37a INFO: 172.21.0.1:48502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:02:25,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:02:25,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:03:02,567 - lava_callback - INFO - Received callback for node 69e6ccc460f5826562c15e40 INFO: 172.21.0.1:53464 - "POST /node/69e6ccc460f5826562c15e40 HTTP/1.0" 202 Accepted 2026-04-23 01:03:02,573 - lava_callback - INFO - Starting async job submit for node 69e6ccc460f5826562c15e40 2026-04-23 01:03:02,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,617 - lava_callback - DEBUG - Processing node 69e6ccc460f5826562c15e40: baseline-arm-baylibre 2026-04-23 01:03:02,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ccc460f5826562c15e40 2026-04-23 01:03:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:03:02,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:03:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ccc460f5826562c15e40 HTTP/1.1" 200 None 2026-04-23 01:03:02,688 - lava_callback - ERROR - Error processing callback for node 69e6ccc460f5826562c15e40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:22,668 - lava_callback - INFO - Received callback for node 69e6cd0b60f5826562c15e70 INFO: 172.21.0.1:41456 - "POST /node/69e6cd0b60f5826562c15e70 HTTP/1.0" 202 Accepted 2026-04-23 01:04:22,673 - lava_callback - INFO - Starting async job submit for node 69e6cd0b60f5826562c15e70 2026-04-23 01:04:22,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,689 - lava_callback - DEBUG - Processing node 69e6cd0b60f5826562c15e70: baseline-arm-baylibre 2026-04-23 01:04:22,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd0b60f5826562c15e70 2026-04-23 01:04:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:04:22,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:22,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd0b60f5826562c15e70 HTTP/1.1" 200 None 2026-04-23 01:04:22,742 - lava_callback - ERROR - Error processing callback for node 69e6cd0b60f5826562c15e70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:32,010 - lava_callback - INFO - Received callback for node 69e969258137cb226ce1f380 INFO: 172.21.0.1:39438 - "POST /node/69e969258137cb226ce1f380 HTTP/1.0" 202 Accepted 2026-04-23 01:04:32,016 - lava_callback - INFO - Starting async job submit for node 69e969258137cb226ce1f380 2026-04-23 01:04:32,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:32,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:32,080 - lava_callback - DEBUG - Processing node 69e969258137cb226ce1f380: ltp-smoke 2026-04-23 01:04:32,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/log.txt.gz 2026-04-23 01:04:32,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/lava-logs.yaml 2026-04-23 01:04:32,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:32,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:32,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e969258137cb226ce1f380/lava_callback.json.gz 2026-04-23 01:04:33,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:33,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:04:33,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:33,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969258137cb226ce1f380 HTTP/1.1" 200 None 2026-04-23 01:04:33,075 - lava_callback - INFO - Completed processing callback for node 69e969258137cb226ce1f380 INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:04:49,743 - lava_callback - INFO - Received callback for node 69e969248137cb226ce1f37d INFO: 172.21.0.1:34802 - "POST /node/69e969248137cb226ce1f37d HTTP/1.0" 202 Accepted 2026-04-23 01:04:49,749 - lava_callback - INFO - Starting async job submit for node 69e969248137cb226ce1f37d 2026-04-23 01:04:49,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:49,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:49,789 - lava_callback - DEBUG - Processing node 69e969248137cb226ce1f37d: ltp-sched 2026-04-23 01:04:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/log.txt.gz 2026-04-23 01:04:50,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/lava-logs.yaml 2026-04-23 01:04:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:04:50,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:04:50,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e969248137cb226ce1f37d/lava_callback.json.gz 2026-04-23 01:04:50,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:50,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:04:50,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:50,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969248137cb226ce1f37d HTTP/1.1" 200 None 2026-04-23 01:04:50,930 - lava_callback - INFO - Completed processing callback for node 69e969248137cb226ce1f37d 2026-04-23 01:04:55,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:55,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 01:04:56,146 - lava_callback - INFO - Received callback for node 69e6cd3160f5826562c15e98 INFO: 172.21.0.1:34812 - "POST /node/69e6cd3160f5826562c15e98 HTTP/1.0" 202 Accepted 2026-04-23 01:04:56,151 - lava_callback - INFO - Starting async job submit for node 69e6cd3160f5826562c15e98 2026-04-23 01:04:56,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,167 - lava_callback - DEBUG - Processing node 69e6cd3160f5826562c15e98: baseline-arm-clabbe 2026-04-23 01:04:56,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd3160f5826562c15e98 2026-04-23 01:04:56,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:04:56,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:04:56,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd3160f5826562c15e98 HTTP/1.1" 200 None 2026-04-23 01:04:56,228 - lava_callback - ERROR - Error processing callback for node 69e6cd3160f5826562c15e98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:05:49,083 - lava_callback - INFO - Received callback for node 69e969288137cb226ce1f386 INFO: 172.21.0.1:39942 - "POST /node/69e969288137cb226ce1f386 HTTP/1.0" 202 Accepted 2026-04-23 01:05:49,089 - lava_callback - INFO - Starting async job submit for node 69e969288137cb226ce1f386 2026-04-23 01:05:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:49,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:49,139 - lava_callback - DEBUG - Processing node 69e969288137cb226ce1f386: ltp-syscalls-ipc 2026-04-23 01:05:49,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:49,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:49,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/log.txt.gz 2026-04-23 01:05:49,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:49,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:49,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/lava-logs.yaml 2026-04-23 01:05:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:05:50,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:05:50,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e969288137cb226ce1f386/lava_callback.json.gz 2026-04-23 01:05:50,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:50,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:05:50,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:50,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e969288137cb226ce1f386 HTTP/1.1" 200 None 2026-04-23 01:05:50,225 - lava_callback - INFO - Completed processing callback for node 69e969288137cb226ce1f386 2026-04-23 01:05:55,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:05:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:06:16,187 - lava_callback - INFO - Received callback for node 69e6cd7b60f5826562c15ed1 INFO: 172.21.0.1:45710 - "POST /node/69e6cd7b60f5826562c15ed1 HTTP/1.0" 202 Accepted 2026-04-23 01:06:16,194 - lava_callback - INFO - Starting async job submit for node 69e6cd7b60f5826562c15ed1 2026-04-23 01:06:16,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,215 - lava_callback - DEBUG - Processing node 69e6cd7b60f5826562c15ed1: baseline-arm-clabbe 2026-04-23 01:06:16,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cd7b60f5826562c15ed1 2026-04-23 01:06:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:06:16,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:16,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cd7b60f5826562c15ed1 HTTP/1.1" 200 None 2026-04-23 01:06:16,277 - lava_callback - ERROR - Error processing callback for node 69e6cd7b60f5826562c15ed1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:06:28,925 - lava_callback - INFO - Received callback for node 69e9692a8137cb226ce1f389 INFO: 172.21.0.1:51816 - "POST /node/69e9692a8137cb226ce1f389 HTTP/1.0" 202 Accepted 2026-04-23 01:06:28,938 - lava_callback - INFO - Starting async job submit for node 69e9692a8137cb226ce1f389 2026-04-23 01:06:28,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:28,988 - lava_callback - DEBUG - Processing node 69e9692a8137cb226ce1f389: ltp-timers 2026-04-23 01:06:29,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:29,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:29,616 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/log.txt.gz 2026-04-23 01:06:29,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:30,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:30,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/lava-logs.yaml 2026-04-23 01:06:30,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:06:30,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:06:30,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e9692a8137cb226ce1f389/lava_callback.json.gz 2026-04-23 01:06:30,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:30,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:06:30,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:30,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9692a8137cb226ce1f389 HTTP/1.1" 200 None 2026-04-23 01:06:30,325 - lava_callback - INFO - Completed processing callback for node 69e9692a8137cb226ce1f389 INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:06:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:06:55,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:07:36,247 - lava_callback - INFO - Received callback for node 69e6cdc760f5826562c15efb INFO: 172.21.0.1:43968 - "POST /node/69e6cdc760f5826562c15efb HTTP/1.0" 202 Accepted 2026-04-23 01:07:36,253 - lava_callback - INFO - Starting async job submit for node 69e6cdc760f5826562c15efb 2026-04-23 01:07:36,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,272 - lava_callback - DEBUG - Processing node 69e6cdc760f5826562c15efb: baseline-arm-clabbe 2026-04-23 01:07:36,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cdc760f5826562c15efb 2026-04-23 01:07:36,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:07:36,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:07:36,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cdc760f5826562c15efb HTTP/1.1" 200 None 2026-04-23 01:07:36,318 - lava_callback - ERROR - Error processing callback for node 69e6cdc760f5826562c15efb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:08:16,325 - lava_callback - INFO - Received callback for node 69e6cdec60f5826562c15f05 INFO: 172.21.0.1:54324 - "POST /node/69e6cdec60f5826562c15f05 HTTP/1.0" 202 Accepted 2026-04-23 01:08:16,330 - lava_callback - INFO - Starting async job submit for node 69e6cdec60f5826562c15f05 2026-04-23 01:08:16,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,345 - lava_callback - DEBUG - Processing node 69e6cdec60f5826562c15f05: baseline-arm-clabbe 2026-04-23 01:08:16,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cdec60f5826562c15f05 2026-04-23 01:08:16,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:08:16,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:16,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cdec60f5826562c15f05 HTTP/1.1" 200 None 2026-04-23 01:08:16,411 - lava_callback - ERROR - Error processing callback for node 69e6cdec60f5826562c15f05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:08:36,288 - lava_callback - INFO - Received callback for node 69e6ce1160f5826562c15f11 INFO: 172.21.0.1:46558 - "POST /node/69e6ce1160f5826562c15f11 HTTP/1.0" 202 Accepted 2026-04-23 01:08:36,293 - lava_callback - INFO - Starting async job submit for node 69e6ce1160f5826562c15f11 2026-04-23 01:08:36,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,310 - lava_callback - DEBUG - Processing node 69e6ce1160f5826562c15f11: baseline-arm-clabbe 2026-04-23 01:08:36,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce1160f5826562c15f11 2026-04-23 01:08:36,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:08:36,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:36,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce1160f5826562c15f11 HTTP/1.1" 200 None 2026-04-23 01:08:36,355 - lava_callback - ERROR - Error processing callback for node 69e6ce1160f5826562c15f11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:08:52,265 - lava_callback - INFO - Received callback for node 69e9692c8137cb226ce1f390 INFO: 172.21.0.1:48690 - "POST /node/69e9692c8137cb226ce1f390 HTTP/1.0" 202 Accepted 2026-04-23 01:08:52,273 - lava_callback - INFO - Starting async job submit for node 69e9692c8137cb226ce1f390 2026-04-23 01:08:52,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:52,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:52,312 - lava_callback - DEBUG - Processing node 69e9692c8137cb226ce1f390: ltp-watchqueue 2026-04-23 01:08:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:52,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:52,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/log.txt.gz 2026-04-23 01:08:53,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:53,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:53,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/lava-logs.yaml 2026-04-23 01:08:53,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:08:53,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:08:53,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e9692c8137cb226ce1f390/lava_callback.json.gz 2026-04-23 01:08:53,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:53,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:08:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:53,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9692c8137cb226ce1f390 HTTP/1.1" 200 None 2026-04-23 01:08:53,512 - lava_callback - INFO - Completed processing callback for node 69e9692c8137cb226ce1f390 2026-04-23 01:08:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:08:55,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:09:16,267 - lava_callback - INFO - Received callback for node 69e6ce3760f5826562c15f1c INFO: 172.21.0.1:48230 - "POST /node/69e6ce3760f5826562c15f1c HTTP/1.0" 202 Accepted 2026-04-23 01:09:16,274 - lava_callback - INFO - Starting async job submit for node 69e6ce3760f5826562c15f1c 2026-04-23 01:09:16,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,291 - lava_callback - DEBUG - Processing node 69e6ce3760f5826562c15f1c: baseline-arm-clabbe 2026-04-23 01:09:16,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce3760f5826562c15f1c 2026-04-23 01:09:16,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:09:16,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:16,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce3760f5826562c15f1c HTTP/1.1" 200 None 2026-04-23 01:09:16,343 - lava_callback - ERROR - Error processing callback for node 69e6ce3760f5826562c15f1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:09:56,344 - lava_callback - INFO - Received callback for node 69e6ce5c60f5826562c15f2a INFO: 172.21.0.1:46872 - "POST /node/69e6ce5c60f5826562c15f2a HTTP/1.0" 202 Accepted 2026-04-23 01:09:56,353 - lava_callback - INFO - Starting async job submit for node 69e6ce5c60f5826562c15f2a 2026-04-23 01:09:56,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,372 - lava_callback - DEBUG - Processing node 69e6ce5c60f5826562c15f2a: baseline-arm-clabbe 2026-04-23 01:09:56,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce5c60f5826562c15f2a 2026-04-23 01:09:56,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:09:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:09:56,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce5c60f5826562c15f2a HTTP/1.1" 200 None 2026-04-23 01:09:56,437 - lava_callback - ERROR - Error processing callback for node 69e6ce5c60f5826562c15f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:10:36,312 - lava_callback - INFO - Received callback for node 69e6ce8160f5826562c15f33 INFO: 172.21.0.1:59252 - "POST /node/69e6ce8160f5826562c15f33 HTTP/1.0" 202 Accepted 2026-04-23 01:10:36,318 - lava_callback - INFO - Starting async job submit for node 69e6ce8160f5826562c15f33 2026-04-23 01:10:36,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,342 - lava_callback - DEBUG - Processing node 69e6ce8160f5826562c15f33: baseline-arm-clabbe 2026-04-23 01:10:36,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ce8160f5826562c15f33 2026-04-23 01:10:36,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:10:36,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:10:36,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ce8160f5826562c15f33 HTTP/1.1" 200 None 2026-04-23 01:10:36,387 - lava_callback - ERROR - Error processing callback for node 69e6ce8160f5826562c15f33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 01:11:16,385 - lava_callback - INFO - Received callback for node 69e6cea760f5826562c15f3f INFO: 172.21.0.1:53236 - "POST /node/69e6cea760f5826562c15f3f HTTP/1.0" 202 Accepted 2026-04-23 01:11:16,390 - lava_callback - INFO - Starting async job submit for node 69e6cea760f5826562c15f3f 2026-04-23 01:11:16,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,405 - lava_callback - DEBUG - Processing node 69e6cea760f5826562c15f3f: baseline-arm-clabbe 2026-04-23 01:11:16,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6cea760f5826562c15f3f 2026-04-23 01:11:16,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded936f490930782fb6e1e HTTP/1.1" 200 None 2026-04-23 01:11:16,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:11:16,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6cea760f5826562c15f3f HTTP/1.1" 200 None 2026-04-23 01:11:16,450 - lava_callback - ERROR - Error processing callback for node 69e6cea760f5826562c15f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:19:20,887 - lava_callback - INFO - Received callback for node 69e96fc68137cb226ce1f75b INFO: 172.21.0.1:51700 - "POST /node/69e96fc68137cb226ce1f75b HTTP/1.0" 202 Accepted 2026-04-23 01:19:20,894 - lava_callback - INFO - Starting async job submit for node 69e96fc68137cb226ce1f75b 2026-04-23 01:19:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:20,960 - lava_callback - DEBUG - Processing node 69e96fc68137cb226ce1f75b: baseline-arm 2026-04-23 01:19:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:21,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:21,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/log.txt.gz 2026-04-23 01:19:22,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:22,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:22,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/lava-logs.yaml 2026-04-23 01:19:22,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:19:22,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:19:22,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e96fc68137cb226ce1f75b/lava_callback.json.gz DEBUG: Setup failed for 69e96fc68137cb226ce1f75b. Transitting job node result: incomplete -> fail 2026-04-23 01:19:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:22,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:19:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:22,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96fc68137cb226ce1f75b HTTP/1.1" 200 None 2026-04-23 01:19:22,768 - lava_callback - INFO - Completed processing callback for node 69e96fc68137cb226ce1f75b 2026-04-23 01:19:25,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:19:25,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:20:53,175 - lava_callback - INFO - Received callback for node 69e96fc48137cb226ce1f757 INFO: 172.21.0.1:41920 - "POST /node/69e96fc48137cb226ce1f757 HTTP/1.0" 202 Accepted 2026-04-23 01:20:53,182 - lava_callback - INFO - Starting async job submit for node 69e96fc48137cb226ce1f757 2026-04-23 01:20:53,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:53,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:53,252 - lava_callback - DEBUG - Processing node 69e96fc48137cb226ce1f757: ltp-smoke 2026-04-23 01:20:53,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:53,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:53,833 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/log.txt.gz 2026-04-23 01:20:54,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:54,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:54,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/lava-logs.yaml 2026-04-23 01:20:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:20:54,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:20:54,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e96fc48137cb226ce1f757/lava_callback.json.gz 2026-04-23 01:20:54,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:54,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 01:20:54,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:54,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96fc48137cb226ce1f757 HTTP/1.1" 200 None 2026-04-23 01:20:54,745 - lava_callback - INFO - Completed processing callback for node 69e96fc48137cb226ce1f757 2026-04-23 01:20:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:20:55,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:22:57,124 - lava_callback - INFO - Received callback for node 69e96ff58137cb226ce1f76a INFO: 172.21.0.1:38504 - "POST /node/69e96ff58137cb226ce1f76a HTTP/1.0" 202 Accepted 2026-04-23 01:22:57,173 - lava_callback - INFO - Starting async job submit for node 69e96ff58137cb226ce1f76a 2026-04-23 01:22:57,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:57,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:57,211 - lava_callback - DEBUG - Processing node 69e96ff58137cb226ce1f76a: baseline-arm-pengutronix 2026-04-23 01:22:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/log.txt.gz 2026-04-23 01:22:57,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/lava-logs.yaml 2026-04-23 01:22:57,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:22:57,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:22:57,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e96ff58137cb226ce1f76a/lava_callback.json.gz DEBUG: Setup failed for 69e96ff58137cb226ce1f76a. Transitting job node result: incomplete -> fail 2026-04-23 01:22:57,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:57,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:57,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:58,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:22:58,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:22:58,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e96ff58137cb226ce1f76a HTTP/1.1" 200 None 2026-04-23 01:22:58,082 - lava_callback - INFO - Completed processing callback for node 69e96ff58137cb226ce1f76a INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:23:25,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:23:25,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:24:29,037 - lava_callback - INFO - Received callback for node 69e974c38137cb226ce1faeb INFO: 172.21.0.1:53660 - "POST /node/69e974c38137cb226ce1faeb HTTP/1.0" 202 Accepted 2026-04-23 01:24:29,043 - lava_callback - INFO - Starting async job submit for node 69e974c38137cb226ce1faeb 2026-04-23 01:24:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,067 - lava_callback - DEBUG - Processing node 69e974c38137cb226ce1faeb: baseline-arm 2026-04-23 01:24:29,072 - lava_callback - WARNING - Failed to upload log 2026-04-23 01:24:29,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:24:29,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:24:29,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e974c38137cb226ce1faeb/lava-logs.yaml 2026-04-23 01:24:29,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:24:29,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:24:29,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e974c38137cb226ce1faeb/lava_callback.json.gz 2026-04-23 01:24:29,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:24:29,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e974c38137cb226ce1faeb HTTP/1.1" 200 None 2026-04-23 01:24:29,331 - lava_callback - INFO - Completed processing callback for node 69e974c38137cb226ce1faeb INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:24:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:24:55,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET /node/69c39e9ebbc022e79264459a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:29:24,037 - lava_callback - INFO - Received callback for node 69e6d2df60f5826562c1615c INFO: 172.21.0.1:44596 - "POST /node/69e6d2df60f5826562c1615c HTTP/1.0" 202 Accepted 2026-04-23 01:29:24,044 - lava_callback - INFO - Starting async job submit for node 69e6d2df60f5826562c1615c 2026-04-23 01:29:24,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,062 - lava_callback - DEBUG - Processing node 69e6d2df60f5826562c1615c: baseline-arm64-baylibre 2026-04-23 01:29:24,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d2df60f5826562c1615c 2026-04-23 01:29:24,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:29:24,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:29:24,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d2df60f5826562c1615c HTTP/1.1" 200 None 2026-04-23 01:29:24,119 - lava_callback - ERROR - Error processing callback for node 69e6d2df60f5826562c1615c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:30:44,142 - lava_callback - INFO - Received callback for node 69e6d33260f5826562c16184 INFO: 172.21.0.1:46584 - "POST /node/69e6d33260f5826562c16184 HTTP/1.0" 202 Accepted 2026-04-23 01:30:44,149 - lava_callback - INFO - Starting async job submit for node 69e6d33260f5826562c16184 2026-04-23 01:30:44,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,185 - lava_callback - DEBUG - Processing node 69e6d33260f5826562c16184: baseline-arm64-baylibre 2026-04-23 01:30:44,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d33260f5826562c16184 2026-04-23 01:30:44,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:30:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:30:44,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d33260f5826562c16184 HTTP/1.1" 200 None 2026-04-23 01:30:44,265 - lava_callback - ERROR - Error processing callback for node 69e6d33260f5826562c16184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET /node/699366aacebe99dd8e06570f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:32:04,159 - lava_callback - INFO - Received callback for node 69e6d38660f5826562c161ab INFO: 172.21.0.1:45274 - "POST /node/69e6d38660f5826562c161ab HTTP/1.0" 202 Accepted 2026-04-23 01:32:04,168 - lava_callback - INFO - Starting async job submit for node 69e6d38660f5826562c161ab 2026-04-23 01:32:04,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,184 - lava_callback - DEBUG - Processing node 69e6d38660f5826562c161ab: baseline-arm64-baylibre 2026-04-23 01:32:04,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d38660f5826562c161ab 2026-04-23 01:32:04,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:32:04,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:32:04,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d38660f5826562c161ab HTTP/1.1" 200 None 2026-04-23 01:32:04,240 - lava_callback - ERROR - Error processing callback for node 69e6d38660f5826562c161ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET /node/699320a731166481c8de72d7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:33:24,256 - lava_callback - INFO - Received callback for node 69e6d3da60f5826562c161c9 INFO: 172.21.0.1:49160 - "POST /node/69e6d3da60f5826562c161c9 HTTP/1.0" 202 Accepted 2026-04-23 01:33:24,264 - lava_callback - INFO - Starting async job submit for node 69e6d3da60f5826562c161c9 2026-04-23 01:33:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,287 - lava_callback - DEBUG - Processing node 69e6d3da60f5826562c161c9: baseline-arm64-baylibre 2026-04-23 01:33:24,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d3da60f5826562c161c9 2026-04-23 01:33:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:33:24,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:33:24,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d3da60f5826562c161c9 HTTP/1.1" 200 None 2026-04-23 01:33:24,382 - lava_callback - ERROR - Error processing callback for node 69e6d3da60f5826562c161c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:34:44,351 - lava_callback - INFO - Received callback for node 69e6d42c60f5826562c161f0 INFO: 172.21.0.1:51096 - "POST /node/69e6d42c60f5826562c161f0 HTTP/1.0" 202 Accepted 2026-04-23 01:34:44,356 - lava_callback - INFO - Starting async job submit for node 69e6d42c60f5826562c161f0 2026-04-23 01:34:44,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,377 - lava_callback - DEBUG - Processing node 69e6d42c60f5826562c161f0: baseline-arm64-baylibre 2026-04-23 01:34:44,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d42c60f5826562c161f0 2026-04-23 01:34:44,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:34:44,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:34:44,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d42c60f5826562c161f0 HTTP/1.1" 200 None 2026-04-23 01:34:44,424 - lava_callback - ERROR - Error processing callback for node 69e6d42c60f5826562c161f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET /node/698a3ea722b4cc0f227b0482%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:36:04,398 - lava_callback - INFO - Received callback for node 69e6d47d60f5826562c16222 INFO: 172.21.0.1:42796 - "POST /node/69e6d47d60f5826562c16222 HTTP/1.0" 202 Accepted 2026-04-23 01:36:04,404 - lava_callback - INFO - Starting async job submit for node 69e6d47d60f5826562c16222 2026-04-23 01:36:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,419 - lava_callback - DEBUG - Processing node 69e6d47d60f5826562c16222: baseline-arm64-baylibre 2026-04-23 01:36:04,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d47d60f5826562c16222 2026-04-23 01:36:04,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:36:04,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:36:04,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d47d60f5826562c16222 HTTP/1.1" 200 None 2026-04-23 01:36:04,484 - lava_callback - ERROR - Error processing callback for node 69e6d47d60f5826562c16222: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET /node/698ef1bcf0e3ffbba67d2b7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50994 - "GET /node/69903be8985e4efca431dedb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:41:37,676 - lava_callback - INFO - Received callback for node 69e6d5cc60f5826562c162d8 INFO: 172.21.0.1:36142 - "POST /node/69e6d5cc60f5826562c162d8 HTTP/1.0" 202 Accepted 2026-04-23 01:41:37,682 - lava_callback - INFO - Starting async job submit for node 69e6d5cc60f5826562c162d8 2026-04-23 01:41:37,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,698 - lava_callback - DEBUG - Processing node 69e6d5cc60f5826562c162d8: baseline-arm64-clabbe 2026-04-23 01:41:37,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d5cc60f5826562c162d8 2026-04-23 01:41:37,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:41:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:41:37,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d5cc60f5826562c162d8 HTTP/1.1" 200 None 2026-04-23 01:41:37,750 - lava_callback - ERROR - Error processing callback for node 69e6d5cc60f5826562c162d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:43:17,663 - lava_callback - INFO - Received callback for node 69e6d61f60f5826562c162fb INFO: 172.21.0.1:52050 - "POST /node/69e6d61f60f5826562c162fb HTTP/1.0" 202 Accepted 2026-04-23 01:43:17,671 - lava_callback - INFO - Starting async job submit for node 69e6d61f60f5826562c162fb 2026-04-23 01:43:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,688 - lava_callback - DEBUG - Processing node 69e6d61f60f5826562c162fb: baseline-arm64-clabbe 2026-04-23 01:43:17,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d61f60f5826562c162fb 2026-04-23 01:43:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:43:17,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:43:17,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d61f60f5826562c162fb HTTP/1.1" 200 None 2026-04-23 01:43:17,736 - lava_callback - ERROR - Error processing callback for node 69e6d61f60f5826562c162fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:44:58,385 - lava_callback - INFO - Received callback for node 69e975798137cb226ce1fb27 INFO: 172.21.0.1:51672 - "POST /node/69e975798137cb226ce1fb27 HTTP/1.0" 202 Accepted 2026-04-23 01:44:58,392 - lava_callback - INFO - Starting async job submit for node 69e975798137cb226ce1fb27 2026-04-23 01:44:58,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:44:58,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:44:58,465 - lava_callback - DEBUG - Processing node 69e975798137cb226ce1fb27: baseline-arm 2026-04-23 01:44:59,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:44:59,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:44:59,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/log.txt.gz 2026-04-23 01:44:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:44:59,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:44:59,931 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/lava-logs.yaml 2026-04-23 01:44:59,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:00,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:00,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e975798137cb226ce1fb27/lava_callback.json.gz DEBUG: Setup failed for 69e975798137cb226ce1fb27. Transitting job node result: incomplete -> fail 2026-04-23 01:45:00,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:45:00,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:45:00,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:00,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e975798137cb226ce1fb27 HTTP/1.1" 200 None 2026-04-23 01:45:00,388 - lava_callback - INFO - Completed processing callback for node 69e975798137cb226ce1fb27 INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:25,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:25,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:35,015 - lava_callback - INFO - Received callback for node 69e9759d8137cb226ce1fb33 INFO: 172.21.0.1:41786 - "POST /node/69e9759d8137cb226ce1fb33 HTTP/1.0" 202 Accepted 2026-04-23 01:45:35,022 - lava_callback - INFO - Starting async job submit for node 69e9759d8137cb226ce1fb33 2026-04-23 01:45:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:35,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None 2026-04-23 01:45:35,109 - lava_callback - DEBUG - Processing node 69e9759d8137cb226ce1fb33: ltp-smoke 2026-04-23 01:45:35,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:35,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:35,716 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/log.txt.gz 2026-04-23 01:45:35,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:36,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:36,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/lava-logs.yaml 2026-04-23 01:45:36,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:45:36,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:45:36,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e9759d8137cb226ce1fb33/lava_callback.json.gz 2026-04-23 01:45:36,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None 2026-04-23 01:45:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 01:45:36,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:36,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9759d8137cb226ce1fb33 HTTP/1.1" 200 None INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:36,612 - lava_callback - INFO - Completed processing callback for node 69e9759d8137cb226ce1fb33 INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:45:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:45:55,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:46:37,892 - lava_callback - INFO - Received callback for node 69e6d6ee60f5826562c1634a INFO: 172.21.0.1:41552 - "POST /node/69e6d6ee60f5826562c1634a HTTP/1.0" 202 Accepted 2026-04-23 01:46:37,898 - lava_callback - INFO - Starting async job submit for node 69e6d6ee60f5826562c1634a 2026-04-23 01:46:37,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,912 - lava_callback - DEBUG - Processing node 69e6d6ee60f5826562c1634a: baseline-arm64-clabbe 2026-04-23 01:46:37,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d6ee60f5826562c1634a 2026-04-23 01:46:37,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:46:37,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:46:37,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d6ee60f5826562c1634a HTTP/1.1" 200 None 2026-04-23 01:46:37,957 - lava_callback - ERROR - Error processing callback for node 69e6d6ee60f5826562c1634a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:47:16,722 - lava_callback - INFO - Received callback for node 69e975aa8137cb226ce1fb3a INFO: 172.21.0.1:49450 - "POST /node/69e975aa8137cb226ce1fb3a HTTP/1.0" 202 Accepted 2026-04-23 01:47:16,769 - lava_callback - INFO - Starting async job submit for node 69e975aa8137cb226ce1fb3a 2026-04-23 01:47:16,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:16,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:16,807 - lava_callback - DEBUG - Processing node 69e975aa8137cb226ce1fb3a: baseline-arm-pengutronix 2026-04-23 01:47:16,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/log.txt.gz 2026-04-23 01:47:17,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/lava-logs.yaml 2026-04-23 01:47:17,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 01:47:17,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 01:47:17,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e975aa8137cb226ce1fb3a/lava_callback.json.gz DEBUG: Setup failed for 69e975aa8137cb226ce1fb3a. Transitting job node result: incomplete -> fail 2026-04-23 01:47:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:17,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 01:47:17,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:17,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e975aa8137cb226ce1fb3a HTTP/1.1" 200 None 2026-04-23 01:47:17,769 - lava_callback - INFO - Completed processing callback for node 69e975aa8137cb226ce1fb3a 2026-04-23 01:47:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:47:57,945 - lava_callback - INFO - Received callback for node 69e6d74260f5826562c1636e INFO: 172.21.0.1:59728 - "POST /node/69e6d74260f5826562c1636e HTTP/1.0" 202 Accepted 2026-04-23 01:47:57,950 - lava_callback - INFO - Starting async job submit for node 69e6d74260f5826562c1636e 2026-04-23 01:47:57,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:57,966 - lava_callback - DEBUG - Processing node 69e6d74260f5826562c1636e: baseline-arm64-clabbe 2026-04-23 01:47:57,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d74260f5826562c1636e 2026-04-23 01:47:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:57,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:57,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:47:57,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:47:58,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d74260f5826562c1636e HTTP/1.1" 200 None 2026-04-23 01:47:58,043 - lava_callback - ERROR - Error processing callback for node 69e6d74260f5826562c1636e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:49:17,997 - lava_callback - INFO - Received callback for node 69e6d79760f5826562c16388 INFO: 172.21.0.1:45188 - "POST /node/69e6d79760f5826562c16388 HTTP/1.0" 202 Accepted 2026-04-23 01:49:18,004 - lava_callback - INFO - Starting async job submit for node 69e6d79760f5826562c16388 2026-04-23 01:49:18,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,018 - lava_callback - DEBUG - Processing node 69e6d79760f5826562c16388: baseline-arm64-clabbe 2026-04-23 01:49:18,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d79760f5826562c16388 2026-04-23 01:49:18,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:49:18,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:49:18,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d79760f5826562c16388 HTTP/1.1" 200 None 2026-04-23 01:49:18,063 - lava_callback - ERROR - Error processing callback for node 69e6d79760f5826562c16388: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:50:58,040 - lava_callback - INFO - Received callback for node 69e6d7ef60f5826562c163ad INFO: 172.21.0.1:46336 - "POST /node/69e6d7ef60f5826562c163ad HTTP/1.0" 202 Accepted 2026-04-23 01:50:58,046 - lava_callback - INFO - Starting async job submit for node 69e6d7ef60f5826562c163ad 2026-04-23 01:50:58,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,097 - lava_callback - DEBUG - Processing node 69e6d7ef60f5826562c163ad: baseline-arm64-clabbe 2026-04-23 01:50:58,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d7ef60f5826562c163ad 2026-04-23 01:50:58,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:50:58,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:50:58,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d7ef60f5826562c163ad HTTP/1.1" 200 None 2026-04-23 01:50:58,142 - lava_callback - ERROR - Error processing callback for node 69e6d7ef60f5826562c163ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK 2026-04-23 01:52:18,096 - lava_callback - INFO - Received callback for node 69e6d84360f5826562c163ce INFO: 172.21.0.1:37186 - "POST /node/69e6d84360f5826562c163ce HTTP/1.0" 202 Accepted 2026-04-23 01:52:18,102 - lava_callback - INFO - Starting async job submit for node 69e6d84360f5826562c163ce 2026-04-23 01:52:18,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,117 - lava_callback - DEBUG - Processing node 69e6d84360f5826562c163ce: baseline-arm64-clabbe 2026-04-23 01:52:18,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6d84360f5826562c163ce 2026-04-23 01:52:18,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 01:52:18,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 01:52:18,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6d84360f5826562c163ce HTTP/1.1" 200 None 2026-04-23 01:52:18,162 - lava_callback - ERROR - Error processing callback for node 69e6d84360f5826562c163ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:12:46,461 - lava_callback - INFO - Received callback for node 69e6dd0e60f5826562c165cc INFO: 172.21.0.1:53564 - "POST /node/69e6dd0e60f5826562c165cc HTTP/1.0" 202 Accepted 2026-04-23 02:12:46,466 - lava_callback - INFO - Starting async job submit for node 69e6dd0e60f5826562c165cc 2026-04-23 02:12:46,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,482 - lava_callback - DEBUG - Processing node 69e6dd0e60f5826562c165cc: baseline-arm-baylibre 2026-04-23 02:12:46,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd0e60f5826562c165cc 2026-04-23 02:12:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:12:46,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:12:46,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:12:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd0e60f5826562c165cc HTTP/1.1" 200 None 2026-04-23 02:12:46,535 - lava_callback - ERROR - Error processing callback for node 69e6dd0e60f5826562c165cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:13:26,501 - lava_callback - INFO - Received callback for node 69e6dd3360f5826562c165d7 INFO: 172.21.0.1:46872 - "POST /node/69e6dd3360f5826562c165d7 HTTP/1.0" 202 Accepted 2026-04-23 02:13:26,507 - lava_callback - INFO - Starting async job submit for node 69e6dd3360f5826562c165d7 2026-04-23 02:13:26,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:13:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,526 - lava_callback - DEBUG - Processing node 69e6dd3360f5826562c165d7: baseline-arm-baylibre 2026-04-23 02:13:26,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd3360f5826562c165d7 2026-04-23 02:13:26,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:13:26,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:13:26,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd3360f5826562c165d7 HTTP/1.1" 200 None 2026-04-23 02:13:26,577 - lava_callback - ERROR - Error processing callback for node 69e6dd3360f5826562c165d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:14:06,578 - lava_callback - INFO - Received callback for node 69e6dd5a60f5826562c165e3 INFO: 172.21.0.1:38822 - "POST /node/69e6dd5a60f5826562c165e3 HTTP/1.0" 202 Accepted 2026-04-23 02:14:06,583 - lava_callback - INFO - Starting async job submit for node 69e6dd5a60f5826562c165e3 2026-04-23 02:14:06,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,641 - lava_callback - DEBUG - Processing node 69e6dd5a60f5826562c165e3: baseline-arm-baylibre 2026-04-23 02:14:06,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dd5a60f5826562c165e3 2026-04-23 02:14:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:14:06,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:14:06,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dd5a60f5826562c165e3 HTTP/1.1" 200 None 2026-04-23 02:14:06,710 - lava_callback - ERROR - Error processing callback for node 69e6dd5a60f5826562c165e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:15:59,181 - lava_callback - INFO - Received callback for node 69e6ddcb60f5826562c1660a INFO: 172.21.0.1:46624 - "POST /node/69e6ddcb60f5826562c1660a HTTP/1.0" 202 Accepted 2026-04-23 02:15:59,186 - lava_callback - INFO - Starting async job submit for node 69e6ddcb60f5826562c1660a 2026-04-23 02:15:59,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,201 - lava_callback - DEBUG - Processing node 69e6ddcb60f5826562c1660a: baseline-arm-clabbe 2026-04-23 02:15:59,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ddcb60f5826562c1660a 2026-04-23 02:15:59,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:15:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:15:59,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ddcb60f5826562c1660a HTTP/1.1" 200 None 2026-04-23 02:15:59,246 - lava_callback - ERROR - Error processing callback for node 69e6ddcb60f5826562c1660a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:16:03,035 - lava_callback - INFO - Received callback for node 69e97cc58137cb226ce1ff57 INFO: 172.21.0.1:52600 - "POST /node/69e97cc58137cb226ce1ff57 HTTP/1.0" 202 Accepted 2026-04-23 02:16:03,043 - lava_callback - INFO - Starting async job submit for node 69e97cc58137cb226ce1ff57 2026-04-23 02:16:03,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:03,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:03,116 - lava_callback - DEBUG - Processing node 69e97cc58137cb226ce1ff57: baseline-arm 2026-04-23 02:16:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:03,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:03,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/log.txt.gz 2026-04-23 02:16:04,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:04,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:04,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/lava-logs.yaml 2026-04-23 02:16:04,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:04,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:04,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e97cc58137cb226ce1ff57/lava_callback.json.gz DEBUG: Setup failed for 69e97cc58137cb226ce1ff57. Transitting job node result: incomplete -> fail 2026-04-23 02:16:04,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:04,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 02:16:04,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:04,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97cc58137cb226ce1ff57 HTTP/1.1" 200 None 2026-04-23 02:16:04,978 - lava_callback - INFO - Completed processing callback for node 69e97cc58137cb226ce1ff57 INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:25,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:39,117 - lava_callback - INFO - Received callback for node 69e6ddf060f5826562c16618 INFO: 172.21.0.1:49012 - "POST /node/69e6ddf060f5826562c16618 HTTP/1.0" 202 Accepted 2026-04-23 02:16:39,122 - lava_callback - INFO - Starting async job submit for node 69e6ddf060f5826562c16618 2026-04-23 02:16:39,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,144 - lava_callback - DEBUG - Processing node 69e6ddf060f5826562c16618: baseline-arm-clabbe 2026-04-23 02:16:39,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ddf060f5826562c16618 2026-04-23 02:16:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:16:39,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:39,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ddf060f5826562c16618 HTTP/1.1" 200 None 2026-04-23 02:16:39,191 - lava_callback - ERROR - Error processing callback for node 69e6ddf060f5826562c16618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:54,364 - lava_callback - INFO - Received callback for node 69e97cea8137cb226ce1ff60 INFO: 172.21.0.1:42156 - "POST /node/69e97cea8137cb226ce1ff60 HTTP/1.0" 202 Accepted 2026-04-23 02:16:54,371 - lava_callback - INFO - Starting async job submit for node 69e97cea8137cb226ce1ff60 2026-04-23 02:16:54,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:54,448 - lava_callback - DEBUG - Processing node 69e97cea8137cb226ce1ff60: ltp-smoke 2026-04-23 02:16:54,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/log.txt.gz 2026-04-23 02:16:55,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/lava-logs.yaml 2026-04-23 02:16:55,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:16:55,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:16:55,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e97cea8137cb226ce1ff60/lava_callback.json.gz 2026-04-23 02:16:55,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:55,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e965038137cb226ce1ca71 HTTP/1.1" 200 None 2026-04-23 02:16:55,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:55,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97cea8137cb226ce1ff60 HTTP/1.1" 200 None 2026-04-23 02:16:55,989 - lava_callback - INFO - Completed processing callback for node 69e97cea8137cb226ce1ff60 INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:16:59,190 - lava_callback - INFO - Received callback for node 69e6de1560f5826562c16627 INFO: 172.21.0.1:42178 - "POST /node/69e6de1560f5826562c16627 HTTP/1.0" 202 Accepted 2026-04-23 02:16:59,197 - lava_callback - INFO - Starting async job submit for node 69e6de1560f5826562c16627 2026-04-23 02:16:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,211 - lava_callback - DEBUG - Processing node 69e6de1560f5826562c16627: baseline-arm-clabbe 2026-04-23 02:16:59,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de1560f5826562c16627 2026-04-23 02:16:59,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:16:59,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:16:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de1560f5826562c16627 HTTP/1.1" 200 None 2026-04-23 02:16:59,265 - lava_callback - ERROR - Error processing callback for node 69e6de1560f5826562c16627: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:17:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:25,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:17:39,173 - lava_callback - INFO - Received callback for node 69e6de3b60f5826562c16632 INFO: 172.21.0.1:42078 - "POST /node/69e6de3b60f5826562c16632 HTTP/1.0" 202 Accepted 2026-04-23 02:17:39,179 - lava_callback - INFO - Starting async job submit for node 69e6de3b60f5826562c16632 2026-04-23 02:17:39,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,194 - lava_callback - DEBUG - Processing node 69e6de3b60f5826562c16632: baseline-arm-clabbe 2026-04-23 02:17:39,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de3b60f5826562c16632 2026-04-23 02:17:39,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:17:39,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:17:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de3b60f5826562c16632 HTTP/1.1" 200 None 2026-04-23 02:17:39,257 - lava_callback - ERROR - Error processing callback for node 69e6de3b60f5826562c16632: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:18:19,243 - lava_callback - INFO - Received callback for node 69e6de6060f5826562c16640 INFO: 172.21.0.1:35008 - "POST /node/69e6de6060f5826562c16640 HTTP/1.0" 202 Accepted 2026-04-23 02:18:19,252 - lava_callback - INFO - Starting async job submit for node 69e6de6060f5826562c16640 2026-04-23 02:18:19,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,269 - lava_callback - DEBUG - Processing node 69e6de6060f5826562c16640: baseline-arm-clabbe 2026-04-23 02:18:19,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de6060f5826562c16640 2026-04-23 02:18:19,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:18:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de6060f5826562c16640 HTTP/1.1" 200 None 2026-04-23 02:18:19,315 - lava_callback - ERROR - Error processing callback for node 69e6de6060f5826562c16640: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:18:59,217 - lava_callback - INFO - Received callback for node 69e6de8660f5826562c1664d INFO: 172.21.0.1:41158 - "POST /node/69e6de8660f5826562c1664d HTTP/1.0" 202 Accepted 2026-04-23 02:18:59,222 - lava_callback - INFO - Starting async job submit for node 69e6de8660f5826562c1664d 2026-04-23 02:18:59,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,245 - lava_callback - DEBUG - Processing node 69e6de8660f5826562c1664d: baseline-arm-clabbe 2026-04-23 02:18:59,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6de8660f5826562c1664d 2026-04-23 02:18:59,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:18:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:18:59,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6de8660f5826562c1664d HTTP/1.1" 200 None 2026-04-23 02:18:59,291 - lava_callback - ERROR - Error processing callback for node 69e6de8660f5826562c1664d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:19:39,256 - lava_callback - INFO - Received callback for node 69e6deac60f5826562c1665d INFO: 172.21.0.1:40888 - "POST /node/69e6deac60f5826562c1665d HTTP/1.0" 202 Accepted 2026-04-23 02:19:39,261 - lava_callback - INFO - Starting async job submit for node 69e6deac60f5826562c1665d 2026-04-23 02:19:39,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,276 - lava_callback - DEBUG - Processing node 69e6deac60f5826562c1665d: baseline-arm-clabbe 2026-04-23 02:19:39,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6deac60f5826562c1665d 2026-04-23 02:19:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:19:39,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:19:39,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6deac60f5826562c1665d HTTP/1.1" 200 None 2026-04-23 02:19:39,322 - lava_callback - ERROR - Error processing callback for node 69e6deac60f5826562c1665d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:20:18,306 - lava_callback - INFO - Received callback for node 69e97d5c8137cb226ce1ffa8 INFO: 172.21.0.1:46590 - "POST /node/69e97d5c8137cb226ce1ffa8 HTTP/1.0" 202 Accepted 2026-04-23 02:20:18,357 - lava_callback - INFO - Starting async job submit for node 69e97d5c8137cb226ce1ffa8 2026-04-23 02:20:18,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:18,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:18,395 - lava_callback - DEBUG - Processing node 69e97d5c8137cb226ce1ffa8: baseline-arm-pengutronix 2026-04-23 02:20:18,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:18,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:18,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/log.txt.gz 2026-04-23 02:20:18,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:19,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:19,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/lava-logs.yaml 2026-04-23 02:20:19,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:20:19,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:20:19,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e97d5c8137cb226ce1ffa8/lava_callback.json.gz DEBUG: Setup failed for 69e97d5c8137cb226ce1ffa8. Transitting job node result: incomplete -> fail 2026-04-23 02:20:19,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:19,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e964fb8137cb226ce1ca54 HTTP/1.1" 200 None 2026-04-23 02:20:19,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e97d5c8137cb226ce1ffa8 HTTP/1.1" 200 None 2026-04-23 02:20:19,273 - lava_callback - INFO - Received callback for node 69e6ded260f5826562c1666f INFO: 172.21.0.1:46604 - "POST /node/69e6ded260f5826562c1666f HTTP/1.0" 202 Accepted 2026-04-23 02:20:19,292 - lava_callback - INFO - Completed processing callback for node 69e97d5c8137cb226ce1ffa8 2026-04-23 02:20:19,292 - lava_callback - INFO - Starting async job submit for node 69e6ded260f5826562c1666f 2026-04-23 02:20:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,308 - lava_callback - DEBUG - Processing node 69e6ded260f5826562c1666f: baseline-arm-clabbe 2026-04-23 02:20:19,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ded260f5826562c1666f 2026-04-23 02:20:19,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:20:19,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:19,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ded260f5826562c1666f HTTP/1.1" 200 None 2026-04-23 02:20:19,357 - lava_callback - ERROR - Error processing callback for node 69e6ded260f5826562c1666f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:20:25,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:25,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:20:59,350 - lava_callback - INFO - Received callback for node 69e6def760f5826562c1667c INFO: 172.21.0.1:37012 - "POST /node/69e6def760f5826562c1667c HTTP/1.0" 202 Accepted 2026-04-23 02:20:59,356 - lava_callback - INFO - Starting async job submit for node 69e6def760f5826562c1667c 2026-04-23 02:20:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,373 - lava_callback - DEBUG - Processing node 69e6def760f5826562c1667c: baseline-arm-clabbe 2026-04-23 02:20:59,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6def760f5826562c1667c 2026-04-23 02:20:59,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 02:20:59,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:20:59,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6def760f5826562c1667c HTTP/1.1" 200 None 2026-04-23 02:20:59,431 - lava_callback - ERROR - Error processing callback for node 69e6def760f5826562c1667c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:21:26,988 - lava_callback - INFO - Received callback for node 69e6df2160f5826562c1668c INFO: 172.21.0.1:49850 - "POST /node/69e6df2160f5826562c1668c HTTP/1.0" 202 Accepted 2026-04-23 02:21:26,995 - lava_callback - INFO - Starting async job submit for node 69e6df2160f5826562c1668c 2026-04-23 02:21:26,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,009 - lava_callback - DEBUG - Processing node 69e6df2160f5826562c1668c: baseline-arm64-baylibre 2026-04-23 02:21:27,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6df2160f5826562c1668c 2026-04-23 02:21:27,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:21:27,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:21:27,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6df2160f5826562c1668c HTTP/1.1" 200 None 2026-04-23 02:21:27,067 - lava_callback - ERROR - Error processing callback for node 69e6df2160f5826562c1668c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:22:47,051 - lava_callback - INFO - Received callback for node 69e6df7560f5826562c166b8 INFO: 172.21.0.1:38728 - "POST /node/69e6df7560f5826562c166b8 HTTP/1.0" 202 Accepted 2026-04-23 02:22:47,056 - lava_callback - INFO - Starting async job submit for node 69e6df7560f5826562c166b8 2026-04-23 02:22:47,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,072 - lava_callback - DEBUG - Processing node 69e6df7560f5826562c166b8: baseline-arm64-baylibre 2026-04-23 02:22:47,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6df7560f5826562c166b8 2026-04-23 02:22:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:22:47,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:22:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6df7560f5826562c166b8 HTTP/1.1" 200 None 2026-04-23 02:22:47,118 - lava_callback - ERROR - Error processing callback for node 69e6df7560f5826562c166b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:24:27,126 - lava_callback - INFO - Received callback for node 69e6dfc960f5826562c166f8 INFO: 172.21.0.1:55852 - "POST /node/69e6dfc960f5826562c166f8 HTTP/1.0" 202 Accepted 2026-04-23 02:24:27,132 - lava_callback - INFO - Starting async job submit for node 69e6dfc960f5826562c166f8 2026-04-23 02:24:27,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,150 - lava_callback - DEBUG - Processing node 69e6dfc960f5826562c166f8: baseline-arm64-baylibre 2026-04-23 02:24:27,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6dfc960f5826562c166f8 2026-04-23 02:24:27,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:24:27,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:24:27,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6dfc960f5826562c166f8 HTTP/1.1" 200 None 2026-04-23 02:24:27,198 - lava_callback - ERROR - Error processing callback for node 69e6dfc960f5826562c166f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:27:07,287 - lava_callback - INFO - Received callback for node 69e6e07160f5826562c16752 INFO: 172.21.0.1:60274 - "POST /node/69e6e07160f5826562c16752 HTTP/1.0" 202 Accepted 2026-04-23 02:27:07,293 - lava_callback - INFO - Starting async job submit for node 69e6e07160f5826562c16752 2026-04-23 02:27:07,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,309 - lava_callback - DEBUG - Processing node 69e6e07160f5826562c16752: baseline-arm64-baylibre 2026-04-23 02:27:07,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e07160f5826562c16752 2026-04-23 02:27:07,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:27:07,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:27:07,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e07160f5826562c16752 HTTP/1.1" 200 None 2026-04-23 02:27:07,354 - lava_callback - ERROR - Error processing callback for node 69e6e07160f5826562c16752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:28:27,381 - lava_callback - INFO - Received callback for node 69e6e0c560f5826562c16797 INFO: 172.21.0.1:57616 - "POST /node/69e6e0c560f5826562c16797 HTTP/1.0" 202 Accepted 2026-04-23 02:28:27,386 - lava_callback - INFO - Starting async job submit for node 69e6e0c560f5826562c16797 2026-04-23 02:28:27,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,403 - lava_callback - DEBUG - Processing node 69e6e0c560f5826562c16797: baseline-arm64-baylibre 2026-04-23 02:28:27,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e0c560f5826562c16797 2026-04-23 02:28:27,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:28:27,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:28:27,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e0c560f5826562c16797 HTTP/1.1" 200 None 2026-04-23 02:28:27,461 - lava_callback - ERROR - Error processing callback for node 69e6e0c560f5826562c16797: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:29:47,458 - lava_callback - INFO - Received callback for node 69e6e11860f5826562c167c1 INFO: 172.21.0.1:46784 - "POST /node/69e6e11860f5826562c167c1 HTTP/1.0" 202 Accepted 2026-04-23 02:29:47,467 - lava_callback - INFO - Starting async job submit for node 69e6e11860f5826562c167c1 2026-04-23 02:29:47,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,486 - lava_callback - DEBUG - Processing node 69e6e11860f5826562c167c1: baseline-arm64-baylibre 2026-04-23 02:29:47,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e11860f5826562c167c1 2026-04-23 02:29:47,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:29:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:29:47,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e11860f5826562c167c1 HTTP/1.1" 200 None 2026-04-23 02:29:47,546 - lava_callback - ERROR - Error processing callback for node 69e6e11860f5826562c167c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:33:39,920 - lava_callback - INFO - Received callback for node 69e6e1ff60f5826562c1682d INFO: 172.21.0.1:39232 - "POST /node/69e6e1ff60f5826562c1682d HTTP/1.0" 202 Accepted 2026-04-23 02:33:39,926 - lava_callback - INFO - Starting async job submit for node 69e6e1ff60f5826562c1682d 2026-04-23 02:33:39,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:39,943 - lava_callback - DEBUG - Processing node 69e6e1ff60f5826562c1682d: baseline-arm64-clabbe 2026-04-23 02:33:39,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e1ff60f5826562c1682d 2026-04-23 02:33:39,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:39,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:39,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:33:39,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:33:40,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e1ff60f5826562c1682d HTTP/1.1" 200 None 2026-04-23 02:33:40,005 - lava_callback - ERROR - Error processing callback for node 69e6e1ff60f5826562c1682d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 02:36:15,428 - lava_callback - INFO - Received callback for node 69e985938137cb226ce2022f INFO: 172.21.0.1:38614 - "POST /node/69e985938137cb226ce2022f HTTP/1.0" 202 Accepted 2026-04-23 02:36:15,436 - lava_callback - INFO - Starting async job submit for node 69e985938137cb226ce2022f 2026-04-23 02:36:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,460 - lava_callback - DEBUG - Processing node 69e985938137cb226ce2022f: baseline-nfs-arm64 2026-04-23 02:36:15,462 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:36:15,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:15,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:15,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985938137cb226ce2022f/lava-logs.yaml 2026-04-23 02:36:15,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:15,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:15,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985938137cb226ce2022f/lava_callback.json.gz 2026-04-23 02:36:15,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:15,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985938137cb226ce2022f HTTP/1.1" 200 None 2026-04-23 02:36:15,789 - lava_callback - INFO - Completed processing callback for node 69e985938137cb226ce2022f INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:25,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:25,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:36:26,130 - lava_callback - INFO - Received callback for node 69e985788137cb226ce201e1 INFO: 172.21.0.1:55420 - "POST /node/69e985788137cb226ce201e1 HTTP/1.0" 202 Accepted 2026-04-23 02:36:26,140 - lava_callback - INFO - Starting async job submit for node 69e985788137cb226ce201e1 2026-04-23 02:36:26,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:26,282 - lava_callback - DEBUG - Processing node 69e985788137cb226ce201e1: baseline-arm64 2026-04-23 02:36:26,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:26,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/log.txt.gz 2026-04-23 02:36:26,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:26,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/lava-logs.yaml 2026-04-23 02:36:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:26,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:26,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985788137cb226ce201e1/lava_callback.json.gz 2026-04-23 02:36:26,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:26,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:27,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:27,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985788137cb226ce201e1 HTTP/1.1" 200 None 2026-04-23 02:36:27,026 - lava_callback - INFO - Completed processing callback for node 69e985788137cb226ce201e1 INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:37,919 - lava_callback - INFO - Received callback for node 69e985aa8137cb226ce2027c INFO: 172.21.0.1:52620 - "POST /node/69e985aa8137cb226ce2027c HTTP/1.0" 202 Accepted 2026-04-23 02:36:37,929 - lava_callback - INFO - Starting async job submit for node 69e985aa8137cb226ce2027c 2026-04-23 02:36:37,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:37,976 - lava_callback - DEBUG - Processing node 69e985aa8137cb226ce2027c: baseline-nfs-arm64 2026-04-23 02:36:37,978 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:36:37,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:38,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:38,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985aa8137cb226ce2027c/lava-logs.yaml 2026-04-23 02:36:38,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:36:38,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:36:38,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985aa8137cb226ce2027c/lava_callback.json.gz 2026-04-23 02:36:38,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:36:38,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:38,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985aa8137cb226ce2027c HTTP/1.1" 200 None 2026-04-23 02:36:38,283 - lava_callback - INFO - Completed processing callback for node 69e985aa8137cb226ce2027c 2026-04-23 02:36:39,991 - lava_callback - INFO - Received callback for node 69e6e2a760f5826562c1687c INFO: 172.21.0.1:55934 - "POST /node/69e6e2a760f5826562c1687c HTTP/1.0" 202 Accepted 2026-04-23 02:36:39,997 - lava_callback - INFO - Starting async job submit for node 69e6e2a760f5826562c1687c 2026-04-23 02:36:39,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,019 - lava_callback - DEBUG - Processing node 69e6e2a760f5826562c1687c: baseline-arm64-clabbe 2026-04-23 02:36:40,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e2a760f5826562c1687c 2026-04-23 02:36:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:36:40,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:40,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e2a760f5826562c1687c HTTP/1.1" 200 None 2026-04-23 02:36:40,070 - lava_callback - ERROR - Error processing callback for node 69e6e2a760f5826562c1687c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:36:55,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:36:55,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:01,275 - lava_callback - INFO - Received callback for node 69e9857a8137cb226ce201ed INFO: 172.21.0.1:34916 - "POST /node/69e9857a8137cb226ce201ed HTTP/1.0" 202 Accepted 2026-04-23 02:37:01,281 - lava_callback - INFO - Starting async job submit for node 69e9857a8137cb226ce201ed 2026-04-23 02:37:01,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:01,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:01,322 - lava_callback - DEBUG - Processing node 69e9857a8137cb226ce201ed: baseline-arm64 2026-04-23 02:37:01,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:01,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:01,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/log.txt.gz 2026-04-23 02:37:01,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:02,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:02,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/lava-logs.yaml 2026-04-23 02:37:02,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:02,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:02,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857a8137cb226ce201ed/lava_callback.json.gz 2026-04-23 02:37:02,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:02,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:02,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857a8137cb226ce201ed HTTP/1.1" 200 None 2026-04-23 02:37:02,330 - lava_callback - INFO - Completed processing callback for node 69e9857a8137cb226ce201ed 2026-04-23 02:37:04,481 - lava_callback - INFO - Received callback for node 69e985848137cb226ce20208 INFO: 172.21.0.1:34924 - "POST /node/69e985848137cb226ce20208 HTTP/1.0" 202 Accepted 2026-04-23 02:37:04,488 - lava_callback - INFO - Starting async job submit for node 69e985848137cb226ce20208 2026-04-23 02:37:04,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:04,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:04,520 - lava_callback - DEBUG - Processing node 69e985848137cb226ce20208: baseline-arm64 2026-04-23 02:37:04,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:04,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:04,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/log.txt.gz 2026-04-23 02:37:04,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:05,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:05,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/lava-logs.yaml 2026-04-23 02:37:05,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:05,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:05,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985848137cb226ce20208/lava_callback.json.gz 2026-04-23 02:37:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:05,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:05,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:05,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985848137cb226ce20208 HTTP/1.1" 200 None 2026-04-23 02:37:05,280 - lava_callback - INFO - Completed processing callback for node 69e985848137cb226ce20208 INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:07,108 - lava_callback - INFO - Received callback for node 69e985818137cb226ce201ff INFO: 172.21.0.1:34940 - "POST /node/69e985818137cb226ce201ff HTTP/1.0" 202 Accepted 2026-04-23 02:37:07,114 - lava_callback - INFO - Starting async job submit for node 69e985818137cb226ce201ff 2026-04-23 02:37:07,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:07,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:07,152 - lava_callback - DEBUG - Processing node 69e985818137cb226ce201ff: baseline-arm64 2026-04-23 02:37:07,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:07,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:07,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/log.txt.gz 2026-04-23 02:37:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:08,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:08,150 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/lava-logs.yaml 2026-04-23 02:37:08,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:08,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:08,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985818137cb226ce201ff/lava_callback.json.gz 2026-04-23 02:37:08,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:08,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:08,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:08,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985818137cb226ce201ff HTTP/1.1" 200 None 2026-04-23 02:37:08,323 - lava_callback - INFO - Completed processing callback for node 69e985818137cb226ce201ff 2026-04-23 02:37:13,350 - lava_callback - INFO - Received callback for node 69e9857d8137cb226ce201f3 INFO: 172.21.0.1:35354 - "POST /node/69e9857d8137cb226ce201f3 HTTP/1.0" 202 Accepted 2026-04-23 02:37:13,356 - lava_callback - INFO - Starting async job submit for node 69e9857d8137cb226ce201f3 2026-04-23 02:37:13,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,400 - lava_callback - DEBUG - Processing node 69e9857d8137cb226ce201f3: baseline-arm64 2026-04-23 02:37:13,580 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:37:13,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:13,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:13,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857d8137cb226ce201f3/lava-logs.yaml 2026-04-23 02:37:13,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:13,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:13,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857d8137cb226ce201f3/lava_callback.json.gz 2026-04-23 02:37:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:13,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:13,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857d8137cb226ce201f3 HTTP/1.1" 200 None 2026-04-23 02:37:13,992 - lava_callback - INFO - Completed processing callback for node 69e9857d8137cb226ce201f3 INFO: 172.21.0.1:35370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:18,917 - lava_callback - INFO - Received callback for node 69e985858137cb226ce2020b INFO: 172.21.0.1:35388 - "POST /node/69e985858137cb226ce2020b HTTP/1.0" 202 Accepted 2026-04-23 02:37:18,923 - lava_callback - INFO - Starting async job submit for node 69e985858137cb226ce2020b 2026-04-23 02:37:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:18,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:18,969 - lava_callback - DEBUG - Processing node 69e985858137cb226ce2020b: baseline-arm64 2026-04-23 02:37:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/log.txt.gz 2026-04-23 02:37:19,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/lava-logs.yaml 2026-04-23 02:37:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:19,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:19,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985858137cb226ce2020b/lava_callback.json.gz 2026-04-23 02:37:19,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:19,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:19,768 - lava_callback - INFO - Received callback for node 69e985798137cb226ce201e4 2026-04-23 02:37:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56190 - "POST /node/69e985798137cb226ce201e4 HTTP/1.0" 202 Accepted 2026-04-23 02:37:19,776 - lava_callback - INFO - Starting async job submit for node 69e985798137cb226ce201e4 2026-04-23 02:37:19,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:19,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985858137cb226ce2020b HTTP/1.1" 200 None 2026-04-23 02:37:19,824 - lava_callback - INFO - Completed processing callback for node 69e985858137cb226ce2020b 2026-04-23 02:37:19,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:19,830 - lava_callback - DEBUG - Processing node 69e985798137cb226ce201e4: baseline-arm64 2026-04-23 02:37:20,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/log.txt.gz 2026-04-23 02:37:20,291 - lava_callback - INFO - Received callback for node 69e985828137cb226ce20202 INFO: 172.21.0.1:56198 - "POST /node/69e985828137cb226ce20202 HTTP/1.0" 202 Accepted 2026-04-23 02:37:20,307 - lava_callback - INFO - Starting async job submit for node 69e985828137cb226ce20202 2026-04-23 02:37:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:20,403 - lava_callback - DEBUG - Processing node 69e985828137cb226ce20202: baseline-arm64 2026-04-23 02:37:20,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/lava-logs.yaml 2026-04-23 02:37:20,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:20,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985798137cb226ce201e4/lava_callback.json.gz 2026-04-23 02:37:20,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:20,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:20,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:20,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:20,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985798137cb226ce201e4 HTTP/1.1" 200 None 2026-04-23 02:37:21,020 - lava_callback - INFO - Completed processing callback for node 69e985798137cb226ce201e4 2026-04-23 02:37:21,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/log.txt.gz 2026-04-23 02:37:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:21,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,532 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/lava-logs.yaml 2026-04-23 02:37:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:21,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:21,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985828137cb226ce20202/lava_callback.json.gz 2026-04-23 02:37:21,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:21,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:21,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:21,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985828137cb226ce20202 HTTP/1.1" 200 None 2026-04-23 02:37:21,758 - lava_callback - INFO - Completed processing callback for node 69e985828137cb226ce20202 2026-04-23 02:37:25,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-23 02:37:26,228 - lava_callback - INFO - Received callback for node 69e9858a8137cb226ce20217 INFO: 172.21.0.1:56214 - "POST /node/69e9858a8137cb226ce20217 HTTP/1.0" 202 Accepted 2026-04-23 02:37:26,234 - lava_callback - INFO - Starting async job submit for node 69e9858a8137cb226ce20217 2026-04-23 02:37:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:26,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:26,270 - lava_callback - DEBUG - Processing node 69e9858a8137cb226ce20217: baseline-arm64 INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:26,570 - lava_callback - INFO - Received callback for node 69e985838137cb226ce20205 INFO: 172.21.0.1:56236 - "POST /node/69e985838137cb226ce20205 HTTP/1.0" 202 Accepted 2026-04-23 02:37:26,607 - lava_callback - INFO - Starting async job submit for node 69e985838137cb226ce20205 2026-04-23 02:37:26,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:26,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:26,669 - lava_callback - DEBUG - Processing node 69e985838137cb226ce20205: baseline-arm64 2026-04-23 02:37:26,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:26,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/log.txt.gz 2026-04-23 02:37:27,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/lava-logs.yaml 2026-04-23 02:37:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/log.txt.gz 2026-04-23 02:37:27,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:27,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858a8137cb226ce20217/lava_callback.json.gz 2026-04-23 02:37:27,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:27,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:27,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:27,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:27,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858a8137cb226ce20217 HTTP/1.1" 200 None 2026-04-23 02:37:27,958 - lava_callback - INFO - Completed processing callback for node 69e9858a8137cb226ce20217 2026-04-23 02:37:28,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:28,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/lava-logs.yaml 2026-04-23 02:37:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:28,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:28,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985838137cb226ce20205/lava_callback.json.gz 2026-04-23 02:37:28,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:28,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:28,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985838137cb226ce20205 HTTP/1.1" 200 None 2026-04-23 02:37:28,416 - lava_callback - INFO - Completed processing callback for node 69e985838137cb226ce20205 2026-04-23 02:37:29,130 - lava_callback - INFO - Received callback for node 69e985878137cb226ce20211 INFO: 172.21.0.1:56238 - "POST /node/69e985878137cb226ce20211 HTTP/1.0" 202 Accepted 2026-04-23 02:37:29,136 - lava_callback - INFO - Starting async job submit for node 69e985878137cb226ce20211 2026-04-23 02:37:29,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:29,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:29,175 - lava_callback - DEBUG - Processing node 69e985878137cb226ce20211: baseline-arm64 2026-04-23 02:37:29,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/log.txt.gz 2026-04-23 02:37:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/lava-logs.yaml 2026-04-23 02:37:29,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:29,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:29,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985878137cb226ce20211/lava_callback.json.gz 2026-04-23 02:37:30,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:30,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985878137cb226ce20211 HTTP/1.1" 200 None 2026-04-23 02:37:30,073 - lava_callback - INFO - Completed processing callback for node 69e985878137cb226ce20211 2026-04-23 02:37:31,575 - lava_callback - INFO - Received callback for node 69e985808137cb226ce201fc INFO: 172.21.0.1:50984 - "POST /node/69e985808137cb226ce201fc HTTP/1.0" 202 Accepted 2026-04-23 02:37:31,581 - lava_callback - INFO - Starting async job submit for node 69e985808137cb226ce201fc 2026-04-23 02:37:31,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:31,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:31,617 - lava_callback - DEBUG - Processing node 69e985808137cb226ce201fc: baseline-arm64 2026-04-23 02:37:31,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:31,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:31,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/log.txt.gz 2026-04-23 02:37:32,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:32,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:32,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/lava-logs.yaml 2026-04-23 02:37:32,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:32,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:32,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985808137cb226ce201fc/lava_callback.json.gz 2026-04-23 02:37:32,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:32,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985808137cb226ce201fc HTTP/1.1" 200 None 2026-04-23 02:37:32,542 - lava_callback - INFO - Completed processing callback for node 69e985808137cb226ce201fc INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:36,855 - lava_callback - INFO - Received callback for node 69e985898137cb226ce20214 INFO: 172.21.0.1:50996 - "POST /node/69e985898137cb226ce20214 HTTP/1.0" 202 Accepted 2026-04-23 02:37:36,865 - lava_callback - INFO - Starting async job submit for node 69e985898137cb226ce20214 2026-04-23 02:37:36,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:36,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:36,908 - lava_callback - DEBUG - Processing node 69e985898137cb226ce20214: baseline-arm64 2026-04-23 02:37:37,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/log.txt.gz 2026-04-23 02:37:37,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/lava-logs.yaml 2026-04-23 02:37:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:37,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:37,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985898137cb226ce20214/lava_callback.json.gz 2026-04-23 02:37:37,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:37,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:37,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:37,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985898137cb226ce20214 HTTP/1.1" 200 None 2026-04-23 02:37:37,973 - lava_callback - INFO - Completed processing callback for node 69e985898137cb226ce20214 2026-04-23 02:37:38,408 - lava_callback - INFO - Received callback for node 69e9857e8137cb226ce201f6 INFO: 172.21.0.1:51006 - "POST /node/69e9857e8137cb226ce201f6 HTTP/1.0" 202 Accepted 2026-04-23 02:37:38,415 - lava_callback - INFO - Starting async job submit for node 69e9857e8137cb226ce201f6 2026-04-23 02:37:38,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:38,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:38,479 - lava_callback - DEBUG - Processing node 69e9857e8137cb226ce201f6: baseline-arm64 2026-04-23 02:37:38,679 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:37:38,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:38,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:38,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857e8137cb226ce201f6/lava-logs.yaml 2026-04-23 02:37:38,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:39,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:39,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857e8137cb226ce201f6/lava_callback.json.gz 2026-04-23 02:37:39,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:39,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:39,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:39,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857e8137cb226ce201f6 HTTP/1.1" 200 None 2026-04-23 02:37:39,157 - lava_callback - INFO - Completed processing callback for node 69e9857e8137cb226ce201f6 2026-04-23 02:37:42,561 - lava_callback - INFO - Received callback for node 69e985918137cb226ce20229 INFO: 172.21.0.1:39174 - "POST /node/69e985918137cb226ce20229 HTTP/1.0" 202 Accepted 2026-04-23 02:37:42,569 - lava_callback - INFO - Starting async job submit for node 69e985918137cb226ce20229 2026-04-23 02:37:42,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:42,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:42,616 - lava_callback - DEBUG - Processing node 69e985918137cb226ce20229: baseline-nfs-arm64 2026-04-23 02:37:43,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:43,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:43,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/log.txt.gz 2026-04-23 02:37:43,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:43,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:43,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/lava-logs.yaml 2026-04-23 02:37:43,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:44,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:44,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985918137cb226ce20229/lava_callback.json.gz 2026-04-23 02:37:44,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:44,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:44,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985918137cb226ce20229 HTTP/1.1" 200 None 2026-04-23 02:37:44,110 - lava_callback - INFO - Completed processing callback for node 69e985918137cb226ce20229 2026-04-23 02:37:45,206 - lava_callback - INFO - Received callback for node 69e985988137cb226ce20257 INFO: 172.21.0.1:39190 - "POST /node/69e985988137cb226ce20257 HTTP/1.0" 202 Accepted 2026-04-23 02:37:45,213 - lava_callback - INFO - Starting async job submit for node 69e985988137cb226ce20257 2026-04-23 02:37:45,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:45,249 - lava_callback - DEBUG - Processing node 69e985988137cb226ce20257: baseline-nfs-arm64 2026-04-23 02:37:45,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:45,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:45,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/log.txt.gz 2026-04-23 02:37:46,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:46,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:46,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/lava-logs.yaml 2026-04-23 02:37:46,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:46,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:46,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985988137cb226ce20257/lava_callback.json.gz 2026-04-23 02:37:46,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:46,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:46,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:46,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985988137cb226ce20257 HTTP/1.1" 200 None 2026-04-23 02:37:46,410 - lava_callback - INFO - Completed processing callback for node 69e985988137cb226ce20257 INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:48,266 - lava_callback - INFO - Received callback for node 69e985bd8137cb226ce202d4 INFO: 172.21.0.1:39198 - "POST /node/69e985bd8137cb226ce202d4 HTTP/1.0" 202 Accepted 2026-04-23 02:37:48,272 - lava_callback - INFO - Starting async job submit for node 69e985bd8137cb226ce202d4 2026-04-23 02:37:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:48,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:48,342 - lava_callback - DEBUG - Processing node 69e985bd8137cb226ce202d4: baseline-arm64-pengutronix 2026-04-23 02:37:48,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:48,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:48,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/log.txt.gz 2026-04-23 02:37:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:48,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:48,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/lava-logs.yaml 2026-04-23 02:37:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:49,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:49,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985bd8137cb226ce202d4/lava_callback.json.gz 2026-04-23 02:37:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:49,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:49,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985bd8137cb226ce202d4 HTTP/1.1" 200 None 2026-04-23 02:37:49,089 - lava_callback - INFO - Completed processing callback for node 69e985bd8137cb226ce202d4 2026-04-23 02:37:52,602 - lava_callback - INFO - Received callback for node 69e9858e8137cb226ce20223 INFO: 172.21.0.1:52476 - "POST /node/69e9858e8137cb226ce20223 HTTP/1.0" 202 Accepted 2026-04-23 02:37:52,611 - lava_callback - INFO - Starting async job submit for node 69e9858e8137cb226ce20223 2026-04-23 02:37:52,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:52,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:52,675 - lava_callback - DEBUG - Processing node 69e9858e8137cb226ce20223: baseline-nfs-arm64 2026-04-23 02:37:53,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/log.txt.gz 2026-04-23 02:37:53,345 - lava_callback - INFO - Received callback for node 69e985c18137cb226ce202dd INFO: 172.21.0.1:52482 - "POST /node/69e985c18137cb226ce202dd HTTP/1.0" 202 Accepted 2026-04-23 02:37:53,364 - lava_callback - INFO - Starting async job submit for node 69e985c18137cb226ce202dd 2026-04-23 02:37:53,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:53,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:53,478 - lava_callback - DEBUG - Processing node 69e985c18137cb226ce202dd: baseline-arm64-foundriesio 2026-04-23 02:37:53,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/lava-logs.yaml 2026-04-23 02:37:53,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:53,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/log.txt.gz 2026-04-23 02:37:53,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:53,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858e8137cb226ce20223/lava_callback.json.gz 2026-04-23 02:37:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:54,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:54,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:54,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858e8137cb226ce20223 HTTP/1.1" 200 None 2026-04-23 02:37:54,101 - lava_callback - INFO - Completed processing callback for node 69e9858e8137cb226ce20223 2026-04-23 02:37:54,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:54,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/lava-logs.yaml 2026-04-23 02:37:54,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:54,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:54,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202dd/lava_callback.json.gz 2026-04-23 02:37:54,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:54,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c18137cb226ce202dd HTTP/1.1" 200 None 2026-04-23 02:37:54,389 - lava_callback - INFO - Completed processing callback for node 69e985c18137cb226ce202dd 2026-04-23 02:37:54,613 - lava_callback - INFO - Received callback for node 69e985928137cb226ce2022c INFO: 172.21.0.1:52486 - "POST /node/69e985928137cb226ce2022c HTTP/1.0" 202 Accepted 2026-04-23 02:37:54,624 - lava_callback - INFO - Starting async job submit for node 69e985928137cb226ce2022c 2026-04-23 02:37:54,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:54,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:54,664 - lava_callback - DEBUG - Processing node 69e985928137cb226ce2022c: baseline-nfs-arm64 2026-04-23 02:37:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:55,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:55,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/log.txt.gz 2026-04-23 02:37:55,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:55,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-23 02:37:55,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:55,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:55,964 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/lava-logs.yaml 2026-04-23 02:37:55,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,111 - lava_callback - INFO - Received callback for node 69e985be8137cb226ce202d7 INFO: 172.21.0.1:52490 - "POST /node/69e985be8137cb226ce202d7 HTTP/1.0" 202 Accepted 2026-04-23 02:37:56,118 - lava_callback - INFO - Starting async job submit for node 69e985be8137cb226ce202d7 2026-04-23 02:37:56,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985928137cb226ce2022c/lava_callback.json.gz 2026-04-23 02:37:56,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:56,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:56,210 - lava_callback - DEBUG - Processing node 69e985be8137cb226ce202d7: baseline-arm64-pengutronix 2026-04-23 02:37:56,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:56,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985928137cb226ce2022c HTTP/1.1" 200 None 2026-04-23 02:37:56,448 - lava_callback - INFO - Completed processing callback for node 69e985928137cb226ce2022c 2026-04-23 02:37:56,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:37:56,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/log.txt.gz 2026-04-23 02:37:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/lava-logs.yaml 2026-04-23 02:37:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:37:56,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:37:56,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985be8137cb226ce202d7/lava_callback.json.gz 2026-04-23 02:37:56,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:56,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:57,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:57,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:37:57,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:37:57,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985be8137cb226ce202d7 HTTP/1.1" 200 None 2026-04-23 02:37:57,036 - lava_callback - INFO - Completed processing callback for node 69e985be8137cb226ce202d7 INFO: 172.21.0.1:52500 - "GET /node/6950776279dde14bd05ee896%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:07,297 - lava_callback - INFO - Received callback for node 69e985bb8137cb226ce202d1 INFO: 172.21.0.1:60332 - "POST /node/69e985bb8137cb226ce202d1 HTTP/1.0" 202 Accepted 2026-04-23 02:38:07,307 - lava_callback - INFO - Starting async job submit for node 69e985bb8137cb226ce202d1 2026-04-23 02:38:07,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:07,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:07,369 - lava_callback - DEBUG - Processing node 69e985bb8137cb226ce202d1: baseline-arm64-kontron 2026-04-23 02:38:07,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:07,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:07,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/log.txt.gz 2026-04-23 02:38:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:08,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:08,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/lava-logs.yaml 2026-04-23 02:38:08,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:08,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:08,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e985bb8137cb226ce202d1/lava_callback.json.gz 2026-04-23 02:38:08,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:08,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985bb8137cb226ce202d1 HTTP/1.1" 200 None 2026-04-23 02:38:08,306 - lava_callback - INFO - Completed processing callback for node 69e985bb8137cb226ce202d1 2026-04-23 02:38:08,794 - lava_callback - INFO - Received callback for node 69e9859a8137cb226ce2025a INFO: 172.21.0.1:60344 - "POST /node/69e9859a8137cb226ce2025a HTTP/1.0" 202 Accepted 2026-04-23 02:38:08,805 - lava_callback - INFO - Starting async job submit for node 69e9859a8137cb226ce2025a 2026-04-23 02:38:08,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:08,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:08,852 - lava_callback - DEBUG - Processing node 69e9859a8137cb226ce2025a: baseline-nfs-arm64 2026-04-23 02:38:09,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/log.txt.gz 2026-04-23 02:38:09,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/lava-logs.yaml 2026-04-23 02:38:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:09,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:09,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9859a8137cb226ce2025a/lava_callback.json.gz 2026-04-23 02:38:09,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:09,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9859a8137cb226ce2025a HTTP/1.1" 200 None 2026-04-23 02:38:09,985 - lava_callback - INFO - Completed processing callback for node 69e9859a8137cb226ce2025a 2026-04-23 02:38:12,151 - lava_callback - INFO - Received callback for node 69e985c08137cb226ce202da INFO: 172.21.0.1:43430 - "POST /node/69e985c08137cb226ce202da HTTP/1.0" 202 Accepted 2026-04-23 02:38:12,157 - lava_callback - INFO - Starting async job submit for node 69e985c08137cb226ce202da 2026-04-23 02:38:12,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:12,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:12,201 - lava_callback - DEBUG - Processing node 69e985c08137cb226ce202da: baseline-arm64-pengutronix 2026-04-23 02:38:12,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/log.txt.gz 2026-04-23 02:38:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/lava-logs.yaml 2026-04-23 02:38:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:12,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:12,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e985c08137cb226ce202da/lava_callback.json.gz 2026-04-23 02:38:12,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:13,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:13,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c08137cb226ce202da HTTP/1.1" 200 None 2026-04-23 02:38:13,086 - lava_callback - INFO - Completed processing callback for node 69e985c08137cb226ce202da 2026-04-23 02:38:13,288 - lava_callback - INFO - Received callback for node 69e985948137cb226ce20232 INFO: 172.21.0.1:43444 - "POST /node/69e985948137cb226ce20232 HTTP/1.0" 202 Accepted 2026-04-23 02:38:13,295 - lava_callback - INFO - Starting async job submit for node 69e985948137cb226ce20232 2026-04-23 02:38:13,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:13,365 - lava_callback - DEBUG - Processing node 69e985948137cb226ce20232: baseline-nfs-arm64 2026-04-23 02:38:13,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:13,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:13,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/log.txt.gz 2026-04-23 02:38:13,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:14,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:14,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/lava-logs.yaml 2026-04-23 02:38:14,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:14,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:14,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985948137cb226ce20232/lava_callback.json.gz 2026-04-23 02:38:14,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:14,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:14,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:14,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985948137cb226ce20232 HTTP/1.1" 200 None 2026-04-23 02:38:14,752 - lava_callback - INFO - Completed processing callback for node 69e985948137cb226ce20232 INFO: 172.21.0.1:43460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:17,397 - lava_callback - INFO - Received callback for node 69e985af8137cb226ce2028c INFO: 172.21.0.1:43474 - "POST /node/69e985af8137cb226ce2028c HTTP/1.0" 202 Accepted 2026-04-23 02:38:17,404 - lava_callback - INFO - Starting async job submit for node 69e985af8137cb226ce2028c 2026-04-23 02:38:17,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:17,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:17,439 - lava_callback - DEBUG - Processing node 69e985af8137cb226ce2028c: baseline-arm64-broonie 2026-04-23 02:38:17,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:17,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:17,886 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/log.txt.gz 2026-04-23 02:38:18,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:18,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:18,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/lava-logs.yaml 2026-04-23 02:38:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:18,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:18,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985af8137cb226ce2028c/lava_callback.json.gz 2026-04-23 02:38:18,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:18,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:18,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:18,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985af8137cb226ce2028c HTTP/1.1" 200 None 2026-04-23 02:38:18,547 - lava_callback - INFO - Completed processing callback for node 69e985af8137cb226ce2028c 2026-04-23 02:38:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:25,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:32,509 - lava_callback - INFO - Received callback for node 69e985b18137cb226ce2028f INFO: 172.21.0.1:52114 - "POST /node/69e985b18137cb226ce2028f HTTP/1.0" 202 Accepted 2026-04-23 02:38:32,516 - lava_callback - INFO - Starting async job submit for node 69e985b18137cb226ce2028f 2026-04-23 02:38:32,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:32,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:32,558 - lava_callback - DEBUG - Processing node 69e985b18137cb226ce2028f: baseline-arm64-broonie 2026-04-23 02:38:32,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:32,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:32,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/log.txt.gz 2026-04-23 02:38:33,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:33,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:33,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/lava-logs.yaml 2026-04-23 02:38:33,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:33,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:33,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b18137cb226ce2028f/lava_callback.json.gz 2026-04-23 02:38:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:33,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:33,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:33,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985b18137cb226ce2028f HTTP/1.1" 200 None 2026-04-23 02:38:33,467 - lava_callback - INFO - Completed processing callback for node 69e985b18137cb226ce2028f INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:38:52,297 - lava_callback - INFO - Received callback for node 69e985ab8137cb226ce20283 INFO: 172.21.0.1:40874 - "POST /node/69e985ab8137cb226ce20283 HTTP/1.0" 202 Accepted 2026-04-23 02:38:52,303 - lava_callback - INFO - Starting async job submit for node 69e985ab8137cb226ce20283 2026-04-23 02:38:52,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:52,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:52,341 - lava_callback - DEBUG - Processing node 69e985ab8137cb226ce20283: baseline-arm64-broonie 2026-04-23 02:38:52,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:52,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:52,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/log.txt.gz 2026-04-23 02:38:52,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:53,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:53,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/lava-logs.yaml 2026-04-23 02:38:53,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:53,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:53,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ab8137cb226ce20283/lava_callback.json.gz 2026-04-23 02:38:53,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:53,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:53,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ab8137cb226ce20283 HTTP/1.1" 200 None 2026-04-23 02:38:53,282 - lava_callback - INFO - Completed processing callback for node 69e985ab8137cb226ce20283 2026-04-23 02:38:53,789 - lava_callback - INFO - Received callback for node 69e985ac8137cb226ce20286 INFO: 172.21.0.1:40884 - "POST /node/69e985ac8137cb226ce20286 HTTP/1.0" 202 Accepted 2026-04-23 02:38:53,795 - lava_callback - INFO - Starting async job submit for node 69e985ac8137cb226ce20286 2026-04-23 02:38:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:53,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:53,840 - lava_callback - DEBUG - Processing node 69e985ac8137cb226ce20286: baseline-arm64-broonie 2026-04-23 02:38:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/log.txt.gz 2026-04-23 02:38:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/lava-logs.yaml 2026-04-23 02:38:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:54,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:54,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ac8137cb226ce20286/lava_callback.json.gz 2026-04-23 02:38:54,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:54,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:54,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:54,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ac8137cb226ce20286 HTTP/1.1" 200 None 2026-04-23 02:38:54,827 - lava_callback - INFO - Completed processing callback for node 69e985ac8137cb226ce20286 2026-04-23 02:38:55,249 - lava_callback - INFO - Received callback for node 69e985b38137cb226ce20292 INFO: 172.21.0.1:40898 - "POST /node/69e985b38137cb226ce20292 HTTP/1.0" 202 Accepted 2026-04-23 02:38:55,255 - lava_callback - INFO - Starting async job submit for node 69e985b38137cb226ce20292 2026-04-23 02:38:55,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:55,294 - lava_callback - DEBUG - Processing node 69e985b38137cb226ce20292: baseline-arm64-broonie 2026-04-23 02:38:55,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:55,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:55,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:38:55,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:55,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/log.txt.gz 2026-04-23 02:38:55,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:56,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:56,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/lava-logs.yaml 2026-04-23 02:38:56,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:38:56,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:38:56,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985b38137cb226ce20292/lava_callback.json.gz 2026-04-23 02:38:56,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:56,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:38:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:38:56,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985b38137cb226ce20292 HTTP/1.1" 200 None 2026-04-23 02:38:56,226 - lava_callback - INFO - Completed processing callback for node 69e985b38137cb226ce20292 INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:20,143 - lava_callback - INFO - Received callback for node 69e6e34c60f5826562c168dc INFO: 172.21.0.1:56340 - "POST /node/69e6e34c60f5826562c168dc HTTP/1.0" 202 Accepted 2026-04-23 02:39:20,148 - lava_callback - INFO - Starting async job submit for node 69e6e34c60f5826562c168dc 2026-04-23 02:39:20,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,175 - lava_callback - DEBUG - Processing node 69e6e34c60f5826562c168dc: baseline-arm64-clabbe 2026-04-23 02:39:20,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e34c60f5826562c168dc 2026-04-23 02:39:20,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:39:20,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:20,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e34c60f5826562c168dc HTTP/1.1" 200 None 2026-04-23 02:39:20,222 - lava_callback - ERROR - Error processing callback for node 69e6e34c60f5826562c168dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 02:39:25,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:25,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:38,178 - lava_callback - INFO - Received callback for node 69e986528137cb226ce20420 INFO: 172.21.0.1:49166 - "POST /node/69e986528137cb226ce20420 HTTP/1.0" 202 Accepted 2026-04-23 02:39:38,184 - lava_callback - INFO - Starting async job submit for node 69e986528137cb226ce20420 2026-04-23 02:39:38,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,202 - lava_callback - DEBUG - Processing node 69e986528137cb226ce20420: baseline-nfs-arm64 2026-04-23 02:39:38,204 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:39:38,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:38,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:38,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e986528137cb226ce20420/lava-logs.yaml 2026-04-23 02:39:38,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:38,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:38,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e986528137cb226ce20420/lava_callback.json.gz 2026-04-23 02:39:38,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:39:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:38,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e986528137cb226ce20420 HTTP/1.1" 200 None 2026-04-23 02:39:38,676 - lava_callback - INFO - Completed processing callback for node 69e986528137cb226ce20420 2026-04-23 02:39:39,262 - lava_callback - INFO - Received callback for node 69e9857f8137cb226ce201f9 INFO: 172.21.0.1:49180 - "POST /node/69e9857f8137cb226ce201f9 HTTP/1.0" 202 Accepted 2026-04-23 02:39:39,268 - lava_callback - INFO - Starting async job submit for node 69e9857f8137cb226ce201f9 2026-04-23 02:39:39,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:39,300 - lava_callback - DEBUG - Processing node 69e9857f8137cb226ce201f9: baseline-arm64 2026-04-23 02:39:39,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:39,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:39,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/log.txt.gz 2026-04-23 02:39:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:40,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:40,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/lava-logs.yaml 2026-04-23 02:39:40,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:39:40,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:39:40,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857f8137cb226ce201f9/lava_callback.json.gz 2026-04-23 02:39:40,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:39:40,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:40,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857f8137cb226ce201f9 HTTP/1.1" 200 None 2026-04-23 02:39:40,408 - lava_callback - INFO - Completed processing callback for node 69e9857f8137cb226ce201f9 INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:39:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:39:55,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:00,081 - lava_callback - INFO - Received callback for node 69e9858d8137cb226ce20220 INFO: 172.21.0.1:56834 - "POST /node/69e9858d8137cb226ce20220 HTTP/1.0" 202 Accepted 2026-04-23 02:40:00,089 - lava_callback - INFO - Starting async job submit for node 69e9858d8137cb226ce20220 2026-04-23 02:40:00,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:00,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:00,133 - lava_callback - DEBUG - Processing node 69e9858d8137cb226ce20220: baseline-nfs-arm64 2026-04-23 02:40:00,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:00,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:00,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/log.txt.gz 2026-04-23 02:40:01,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:01,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:01,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/lava-logs.yaml 2026-04-23 02:40:01,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:01,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:01,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858d8137cb226ce20220/lava_callback.json.gz 2026-04-23 02:40:01,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:01,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:40:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:01,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858d8137cb226ce20220 HTTP/1.1" 200 None 2026-04-23 02:40:01,355 - lava_callback - INFO - Completed processing callback for node 69e9858d8137cb226ce20220 INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:25,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:35,563 - lava_callback - INFO - Received callback for node 69e985ad8137cb226ce20289 INFO: 172.21.0.1:33598 - "POST /node/69e985ad8137cb226ce20289 HTTP/1.0" 202 Accepted 2026-04-23 02:40:35,569 - lava_callback - INFO - Starting async job submit for node 69e985ad8137cb226ce20289 2026-04-23 02:40:35,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:35,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:35,606 - lava_callback - DEBUG - Processing node 69e985ad8137cb226ce20289: baseline-arm64-broonie 2026-04-23 02:40:35,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/log.txt.gz 2026-04-23 02:40:36,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/lava-logs.yaml 2026-04-23 02:40:36,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:40:36,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:40:36,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985ad8137cb226ce20289/lava_callback.json.gz 2026-04-23 02:40:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:36,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:40:36,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:36,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985ad8137cb226ce20289 HTTP/1.1" 200 None 2026-04-23 02:40:36,513 - lava_callback - INFO - Completed processing callback for node 69e985ad8137cb226ce20289 INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:40,161 - lava_callback - INFO - Received callback for node 69e6e3a160f5826562c168fd INFO: 172.21.0.1:44966 - "POST /node/69e6e3a160f5826562c168fd HTTP/1.0" 202 Accepted 2026-04-23 02:40:40,166 - lava_callback - INFO - Starting async job submit for node 69e6e3a160f5826562c168fd 2026-04-23 02:40:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,181 - lava_callback - DEBUG - Processing node 69e6e3a160f5826562c168fd: baseline-arm64-clabbe 2026-04-23 02:40:40,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e3a160f5826562c168fd 2026-04-23 02:40:40,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:40:40,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:40,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e3a160f5826562c168fd HTTP/1.1" 200 None 2026-04-23 02:40:40,236 - lava_callback - ERROR - Error processing callback for node 69e6e3a160f5826562c168fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:40:55,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:40:55,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:36,656 - lava_callback - INFO - Received callback for node 69e9869e8137cb226ce2045d INFO: 172.21.0.1:46176 - "POST /node/69e9869e8137cb226ce2045d HTTP/1.0" 202 Accepted 2026-04-23 02:41:36,662 - lava_callback - INFO - Starting async job submit for node 69e9869e8137cb226ce2045d 2026-04-23 02:41:36,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:36,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:36,708 - lava_callback - DEBUG - Processing node 69e9869e8137cb226ce2045d: baseline-arm64 2026-04-23 02:41:36,841 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:41:36,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:37,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:37,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9869e8137cb226ce2045d/lava-logs.yaml 2026-04-23 02:41:37,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:37,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:37,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9869e8137cb226ce2045d/lava_callback.json.gz 2026-04-23 02:41:37,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:37,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:41:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:37,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9869e8137cb226ce2045d HTTP/1.1" 200 None 2026-04-23 02:41:37,486 - lava_callback - INFO - Completed processing callback for node 69e9869e8137cb226ce2045d INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:55,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:55,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-23 02:41:56,320 - lava_callback - INFO - Received callback for node 69e985c18137cb226ce202e0 INFO: 172.21.0.1:51826 - "POST /node/69e985c18137cb226ce202e0 HTTP/1.0" 202 Accepted 2026-04-23 02:41:56,331 - lava_callback - INFO - Starting async job submit for node 69e985c18137cb226ce202e0 2026-04-23 02:41:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:56,395 - lava_callback - DEBUG - Processing node 69e985c18137cb226ce202e0: baseline-arm64-foundriesio INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:41:57,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:57,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:57,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/log.txt.gz 2026-04-23 02:41:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:58,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:58,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/lava-logs.yaml 2026-04-23 02:41:58,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:41:58,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:41:58,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e985c18137cb226ce202e0/lava_callback.json.gz DEBUG: 69e985c18137cb226ce202e0 Transitting job node result: pass -> incomplete 2026-04-23 02:41:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:58,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:58,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:41:59,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:41:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985c18137cb226ce202e0 HTTP/1.1" 200 None 2026-04-23 02:41:59,023 - lava_callback - INFO - Completed processing callback for node 69e985c18137cb226ce202e0 INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:42:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:42:25,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:25,463 - lava_callback - INFO - Received callback for node 69e986f48137cb226ce20498 INFO: 172.21.0.1:50944 - "POST /node/69e986f48137cb226ce20498 HTTP/1.0" 202 Accepted 2026-04-23 02:43:25,469 - lava_callback - INFO - Starting async job submit for node 69e986f48137cb226ce20498 2026-04-23 02:43:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:25,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:25,505 - lava_callback - DEBUG - Processing node 69e986f48137cb226ce20498: baseline-arm64 2026-04-23 02:43:26,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:26,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/log.txt.gz 2026-04-23 02:43:26,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:26,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/lava-logs.yaml 2026-04-23 02:43:26,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:26,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:26,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e986f48137cb226ce20498/lava_callback.json.gz 2026-04-23 02:43:26,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:26,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:43:26,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:26,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e986f48137cb226ce20498 HTTP/1.1" 200 None 2026-04-23 02:43:26,974 - lava_callback - INFO - Completed processing callback for node 69e986f48137cb226ce20498 INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:40,277 - lava_callback - INFO - Received callback for node 69e6e44760f5826562c1696d INFO: 172.21.0.1:42652 - "POST /node/69e6e44760f5826562c1696d HTTP/1.0" 202 Accepted 2026-04-23 02:43:40,282 - lava_callback - INFO - Starting async job submit for node 69e6e44760f5826562c1696d 2026-04-23 02:43:40,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,297 - lava_callback - DEBUG - Processing node 69e6e44760f5826562c1696d: baseline-arm64-clabbe 2026-04-23 02:43:40,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e44760f5826562c1696d 2026-04-23 02:43:40,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:43:40,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:40,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e44760f5826562c1696d HTTP/1.1" 200 None 2026-04-23 02:43:40,349 - lava_callback - ERROR - Error processing callback for node 69e6e44760f5826562c1696d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:43:53,405 - lava_callback - INFO - Received callback for node 69e9858b8137cb226ce2021a INFO: 172.21.0.1:44730 - "POST /node/69e9858b8137cb226ce2021a HTTP/1.0" 202 Accepted 2026-04-23 02:43:53,414 - lava_callback - INFO - Starting async job submit for node 69e9858b8137cb226ce2021a 2026-04-23 02:43:53,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:53,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:53,467 - lava_callback - DEBUG - Processing node 69e9858b8137cb226ce2021a: baseline-arm64 2026-04-23 02:43:53,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:53,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:53,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/log.txt.gz 2026-04-23 02:43:54,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:54,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:54,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/lava-logs.yaml 2026-04-23 02:43:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:43:54,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:43:54,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9858b8137cb226ce2021a/lava_callback.json.gz DEBUG: Setup failed for 69e9858b8137cb226ce2021a. Transitting job node result: incomplete -> fail 2026-04-23 02:43:54,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:54,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:43:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:54,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858b8137cb226ce2021a HTTP/1.1" 200 None 2026-04-23 02:43:55,048 - lava_callback - INFO - Completed processing callback for node 69e9858b8137cb226ce2021a 2026-04-23 02:43:55,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:43:55,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:44:21,498 - lava_callback - INFO - Received callback for node 69e987468137cb226ce204cc INFO: 172.21.0.1:36396 - "POST /node/69e987468137cb226ce204cc HTTP/1.0" 202 Accepted 2026-04-23 02:44:21,504 - lava_callback - INFO - Starting async job submit for node 69e987468137cb226ce204cc 2026-04-23 02:44:21,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:21,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:21,547 - lava_callback - DEBUG - Processing node 69e987468137cb226ce204cc: baseline-arm64 2026-04-23 02:44:21,685 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:44:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:44:22,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:44:22,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e987468137cb226ce204cc/lava-logs.yaml 2026-04-23 02:44:22,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:44:22,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:44:22,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e987468137cb226ce204cc/lava_callback.json.gz 2026-04-23 02:44:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:44:22,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:22,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e987468137cb226ce204cc HTTP/1.1" 200 None 2026-04-23 02:44:22,365 - lava_callback - INFO - Completed processing callback for node 69e987468137cb226ce204cc 2026-04-23 02:44:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:44:25,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:45:00,354 - lava_callback - INFO - Received callback for node 69e6e49960f5826562c16986 INFO: 172.21.0.1:50654 - "POST /node/69e6e49960f5826562c16986 HTTP/1.0" 202 Accepted 2026-04-23 02:45:00,359 - lava_callback - INFO - Starting async job submit for node 69e6e49960f5826562c16986 2026-04-23 02:45:00,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,376 - lava_callback - DEBUG - Processing node 69e6e49960f5826562c16986: baseline-arm64-clabbe 2026-04-23 02:45:00,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e49960f5826562c16986 2026-04-23 02:45:00,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-23 02:45:00,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:45:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e49960f5826562c16986 HTTP/1.1" 200 None 2026-04-23 02:45:00,437 - lava_callback - ERROR - Error processing callback for node 69e6e49960f5826562c16986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:04,399 - lava_callback - INFO - Received callback for node 69e985868137cb226ce2020e INFO: 172.21.0.1:53842 - "POST /node/69e985868137cb226ce2020e HTTP/1.0" 202 Accepted 2026-04-23 02:47:04,406 - lava_callback - INFO - Starting async job submit for node 69e985868137cb226ce2020e 2026-04-23 02:47:04,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:04,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:04,443 - lava_callback - DEBUG - Processing node 69e985868137cb226ce2020e: baseline-arm64 2026-04-23 02:47:05,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/log.txt.gz 2026-04-23 02:47:05,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/lava-logs.yaml 2026-04-23 02:47:05,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:05,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:05,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e985868137cb226ce2020e/lava_callback.json.gz 2026-04-23 02:47:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:47:05,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:05,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985868137cb226ce2020e HTTP/1.1" 200 None 2026-04-23 02:47:05,808 - lava_callback - INFO - Completed processing callback for node 69e985868137cb226ce2020e INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:25,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:25,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:35,840 - lava_callback - INFO - Received callback for node 69e9883a8137cb226ce20560 INFO: 172.21.0.1:44726 - "POST /node/69e9883a8137cb226ce20560 HTTP/1.0" 202 Accepted 2026-04-23 02:47:35,847 - lava_callback - INFO - Starting async job submit for node 69e9883a8137cb226ce20560 2026-04-23 02:47:35,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:35,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:35,864 - lava_callback - DEBUG - Processing node 69e9883a8137cb226ce20560: baseline-nfs-arm64 2026-04-23 02:47:35,866 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:47:35,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:35,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:35,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9883a8137cb226ce20560/lava-logs.yaml 2026-04-23 02:47:35,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:47:36,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:47:36,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9883a8137cb226ce20560/lava_callback.json.gz 2026-04-23 02:47:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:47:36,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:36,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9883a8137cb226ce20560 HTTP/1.1" 200 None 2026-04-23 02:47:36,122 - lava_callback - INFO - Completed processing callback for node 69e9883a8137cb226ce20560 INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:47:55,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:47:55,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:36,165 - lava_callback - INFO - Received callback for node 69e988fc8137cb226ce205d7 INFO: 172.21.0.1:37082 - "POST /node/69e988fc8137cb226ce205d7 HTTP/1.0" 202 Accepted 2026-04-23 02:51:36,172 - lava_callback - INFO - Starting async job submit for node 69e988fc8137cb226ce205d7 2026-04-23 02:51:36,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:36,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:36,215 - lava_callback - DEBUG - Processing node 69e988fc8137cb226ce205d7: baseline-arm64 2026-04-23 02:51:36,353 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:51:36,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:37,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:51:37,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988fc8137cb226ce205d7/lava-logs.yaml 2026-04-23 02:51:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:51:37,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:51:37,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988fc8137cb226ce205d7/lava_callback.json.gz 2026-04-23 02:51:37,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:37,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:51:37,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e988fc8137cb226ce205d7 HTTP/1.1" 200 None 2026-04-23 02:51:37,512 - lava_callback - INFO - Completed processing callback for node 69e988fc8137cb226ce205d7 INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:51:55,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:51:55,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:52:31,982 - lava_callback - INFO - Received callback for node 69e988868137cb226ce20598 INFO: 172.21.0.1:43058 - "POST /node/69e988868137cb226ce20598 HTTP/1.0" 202 Accepted 2026-04-23 02:52:31,988 - lava_callback - INFO - Starting async job submit for node 69e988868137cb226ce20598 2026-04-23 02:52:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:32,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:32,021 - lava_callback - DEBUG - Processing node 69e988868137cb226ce20598: baseline-arm64 2026-04-23 02:52:32,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:32,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:32,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/log.txt.gz 2026-04-23 02:52:32,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:32,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:32,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/lava-logs.yaml 2026-04-23 02:52:32,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:52:33,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:52:33,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e988868137cb226ce20598/lava_callback.json.gz 2026-04-23 02:52:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:33,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:52:33,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:33,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e988868137cb226ce20598 HTTP/1.1" 200 None 2026-04-23 02:52:33,153 - lava_callback - INFO - Completed processing callback for node 69e988868137cb226ce20598 INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:52:55,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:52:55,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:28,049 - lava_callback - INFO - Received callback for node 69e989a38137cb226ce2063f INFO: 172.21.0.1:52282 - "POST /node/69e989a38137cb226ce2063f HTTP/1.0" 202 Accepted 2026-04-23 02:55:28,056 - lava_callback - INFO - Starting async job submit for node 69e989a38137cb226ce2063f 2026-04-23 02:55:28,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:28,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:28,094 - lava_callback - DEBUG - Processing node 69e989a38137cb226ce2063f: baseline-arm64 2026-04-23 02:55:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:28,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:28,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/log.txt.gz 2026-04-23 02:55:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:29,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:29,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/lava-logs.yaml 2026-04-23 02:55:29,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:29,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:29,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989a38137cb226ce2063f/lava_callback.json.gz 2026-04-23 02:55:29,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:29,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:55:29,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:29,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989a38137cb226ce2063f HTTP/1.1" 200 None 2026-04-23 02:55:29,630 - lava_callback - INFO - Completed processing callback for node 69e989a38137cb226ce2063f INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:37,739 - lava_callback - INFO - Received callback for node 69e989678137cb226ce20610 INFO: 172.21.0.1:43998 - "POST /node/69e989678137cb226ce20610 HTTP/1.0" 202 Accepted 2026-04-23 02:55:37,751 - lava_callback - INFO - Starting async job submit for node 69e989678137cb226ce20610 2026-04-23 02:55:37,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:37,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:37,825 - lava_callback - DEBUG - Processing node 69e989678137cb226ce20610: baseline-arm64-foundriesio 2026-04-23 02:55:38,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:38,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:38,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/log.txt.gz 2026-04-23 02:55:39,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:39,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:39,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/lava-logs.yaml 2026-04-23 02:55:39,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:55:39,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:55:39,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e989678137cb226ce20610/lava_callback.json.gz DEBUG: 69e989678137cb226ce20610 Transitting job node result: pass -> incomplete 2026-04-23 02:55:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:39,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:55:39,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:39,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989678137cb226ce20610 HTTP/1.1" 200 None 2026-04-23 02:55:39,733 - lava_callback - INFO - Completed processing callback for node 69e989678137cb226ce20610 INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:55:55,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:55:55,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:56:19,477 - lava_callback - INFO - Received callback for node 69e985978137cb226ce20238 INFO: 172.21.0.1:39826 - "POST /node/69e985978137cb226ce20238 HTTP/1.0" 202 Accepted 2026-04-23 02:56:19,485 - lava_callback - INFO - Starting async job submit for node 69e985978137cb226ce20238 2026-04-23 02:56:19,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:19,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:19,550 - lava_callback - DEBUG - Processing node 69e985978137cb226ce20238: baseline-nfs-arm64 2026-04-23 02:56:20,482 - lava_callback - INFO - Received callback for node 69e985908137cb226ce20226 INFO: 172.21.0.1:49880 - "POST /node/69e985908137cb226ce20226 HTTP/1.0" 202 Accepted 2026-04-23 02:56:20,491 - lava_callback - INFO - Starting async job submit for node 69e985908137cb226ce20226 2026-04-23 02:56:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:20,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:20,569 - lava_callback - DEBUG - Processing node 69e985908137cb226ce20226: baseline-nfs-arm64 2026-04-23 02:56:20,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:20,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/log.txt.gz 2026-04-23 02:56:22,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/lava-logs.yaml 2026-04-23 02:56:22,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:22,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/log.txt.gz 2026-04-23 02:56:22,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:22,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985978137cb226ce20238/lava_callback.json.gz DEBUG: Setup failed for 69e985978137cb226ce20238. Transitting job node result: incomplete -> fail 2026-04-23 02:56:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:23,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:56:23,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985978137cb226ce20238 HTTP/1.1" 200 None 2026-04-23 02:56:23,364 - lava_callback - INFO - Completed processing callback for node 69e985978137cb226ce20238 2026-04-23 02:56:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:23,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:23,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/lava-logs.yaml 2026-04-23 02:56:23,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:56:23,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:56:23,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985908137cb226ce20226/lava_callback.json.gz DEBUG: Setup failed for 69e985908137cb226ce20226. Transitting job node result: incomplete -> fail 2026-04-23 02:56:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:24,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:56:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:24,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985908137cb226ce20226 HTTP/1.1" 200 None 2026-04-23 02:56:24,261 - lava_callback - INFO - Completed processing callback for node 69e985908137cb226ce20226 2026-04-23 02:56:25,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:56:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET /node/693fc96b575bc060ce149c3e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET /node/693e5f56407f32424eb650bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:57:32,819 - lava_callback - INFO - Received callback for node 69e98a458137cb226ce206a8 INFO: 172.21.0.1:54538 - "POST /node/69e98a458137cb226ce206a8 HTTP/1.0" 202 Accepted 2026-04-23 02:57:32,826 - lava_callback - INFO - Starting async job submit for node 69e98a458137cb226ce206a8 2026-04-23 02:57:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:32,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:32,871 - lava_callback - DEBUG - Processing node 69e98a458137cb226ce206a8: baseline-arm64 2026-04-23 02:57:33,115 - lava_callback - WARNING - Failed to upload log 2026-04-23 02:57:33,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:57:33,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:57:33,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98a458137cb226ce206a8/lava-logs.yaml 2026-04-23 02:57:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:57:33,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:57:33,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98a458137cb226ce206a8/lava_callback.json.gz 2026-04-23 02:57:33,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:57:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:33,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98a458137cb226ce206a8 HTTP/1.1" 200 None 2026-04-23 02:57:33,826 - lava_callback - INFO - Completed processing callback for node 69e98a458137cb226ce206a8 INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:57:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:57:55,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET /node/698ec99fdb401c547d5730c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-23 02:59:51,153 - lava_callback - INFO - Received callback for node 69e985968137cb226ce20235 INFO: 172.21.0.1:37854 - "POST /node/69e985968137cb226ce20235 HTTP/1.0" 202 Accepted 2026-04-23 02:59:51,161 - lava_callback - INFO - Starting async job submit for node 69e985968137cb226ce20235 2026-04-23 02:59:51,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:51,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:51,226 - lava_callback - DEBUG - Processing node 69e985968137cb226ce20235: baseline-nfs-arm64 2026-04-23 02:59:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:51,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:51,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/log.txt.gz 2026-04-23 02:59:52,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:52,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:52,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/lava-logs.yaml 2026-04-23 02:59:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 02:59:52,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 02:59:52,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e985968137cb226ce20235/lava_callback.json.gz 2026-04-23 02:59:52,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:52,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 02:59:52,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:52,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985968137cb226ce20235 HTTP/1.1" 200 None 2026-04-23 02:59:52,814 - lava_callback - INFO - Completed processing callback for node 69e985968137cb226ce20235 2026-04-23 02:59:55,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 02:59:56,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:02:09,683 - lava_callback - INFO - Received callback for node 69e989f78137cb226ce2066e INFO: 172.21.0.1:55130 - "POST /node/69e989f78137cb226ce2066e HTTP/1.0" 202 Accepted 2026-04-23 03:02:09,690 - lava_callback - INFO - Starting async job submit for node 69e989f78137cb226ce2066e 2026-04-23 03:02:09,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:09,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:09,744 - lava_callback - DEBUG - Processing node 69e989f78137cb226ce2066e: baseline-arm64 2026-04-23 03:02:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:10,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:10,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/log.txt.gz 2026-04-23 03:02:10,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:10,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:10,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/lava-logs.yaml 2026-04-23 03:02:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:02:11,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:02:11,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e989f78137cb226ce2066e/lava_callback.json.gz DEBUG: Setup failed for 69e989f78137cb226ce2066e. Transitting job node result: incomplete -> fail 2026-04-23 03:02:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:11,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:02:11,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:11,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e989f78137cb226ce2066e HTTP/1.1" 200 None 2026-04-23 03:02:11,265 - lava_callback - INFO - Completed processing callback for node 69e989f78137cb226ce2066e INFO: 172.21.0.1:60044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:02:26,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:02:26,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:05:29,518 - lava_callback - INFO - Received callback for node 69e6e96c60f5826562c16c17 INFO: 172.21.0.1:40646 - "POST /node/69e6e96c60f5826562c16c17 HTTP/1.0" 202 Accepted 2026-04-23 03:05:29,523 - lava_callback - INFO - Starting async job submit for node 69e6e96c60f5826562c16c17 2026-04-23 03:05:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,543 - lava_callback - DEBUG - Processing node 69e6e96c60f5826562c16c17: baseline-arm64-baylibre 2026-04-23 03:05:29,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e96c60f5826562c16c17 2026-04-23 03:05:29,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:05:29,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:05:29,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e96c60f5826562c16c17 HTTP/1.1" 200 None 2026-04-23 03:05:29,589 - lava_callback - ERROR - Error processing callback for node 69e6e96c60f5826562c16c17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:06:49,504 - lava_callback - INFO - Received callback for node 69e6e9bf60f5826562c16c3b INFO: 172.21.0.1:44082 - "POST /node/69e6e9bf60f5826562c16c3b HTTP/1.0" 202 Accepted 2026-04-23 03:06:49,512 - lava_callback - INFO - Starting async job submit for node 69e6e9bf60f5826562c16c3b 2026-04-23 03:06:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,529 - lava_callback - DEBUG - Processing node 69e6e9bf60f5826562c16c3b: baseline-arm64-baylibre 2026-04-23 03:06:49,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6e9bf60f5826562c16c3b 2026-04-23 03:06:49,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:06:49,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:06:49,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6e9bf60f5826562c16c3b HTTP/1.1" 200 None 2026-04-23 03:06:49,589 - lava_callback - ERROR - Error processing callback for node 69e6e9bf60f5826562c16c3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:07:11,024 - lava_callback - INFO - Received callback for node 69e98ca88137cb226ce207df INFO: 172.21.0.1:33780 - "POST /node/69e98ca88137cb226ce207df HTTP/1.0" 202 Accepted 2026-04-23 03:07:11,031 - lava_callback - INFO - Starting async job submit for node 69e98ca88137cb226ce207df 2026-04-23 03:07:11,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,120 - lava_callback - DEBUG - Processing node 69e98ca88137cb226ce207df: baseline-arm64 2026-04-23 03:07:11,255 - lava_callback - WARNING - Failed to upload log 2026-04-23 03:07:11,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:07:11,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:07:11,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98ca88137cb226ce207df/lava-logs.yaml 2026-04-23 03:07:11,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:07:11,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:07:11,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98ca88137cb226ce207df/lava_callback.json.gz 2026-04-23 03:07:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:07:11,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98ca88137cb226ce207df HTTP/1.1" 200 None 2026-04-23 03:07:11,919 - lava_callback - INFO - Completed processing callback for node 69e98ca88137cb226ce207df INFO: 172.21.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:07:26,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:07:26,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:08:09,554 - lava_callback - INFO - Received callback for node 69e6ea1360f5826562c16c69 INFO: 172.21.0.1:49024 - "POST /node/69e6ea1360f5826562c16c69 HTTP/1.0" 202 Accepted 2026-04-23 03:08:09,559 - lava_callback - INFO - Starting async job submit for node 69e6ea1360f5826562c16c69 2026-04-23 03:08:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,584 - lava_callback - DEBUG - Processing node 69e6ea1360f5826562c16c69: baseline-arm64-baylibre 2026-04-23 03:08:09,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ea1360f5826562c16c69 2026-04-23 03:08:09,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:08:09,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:08:09,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ea1360f5826562c16c69 HTTP/1.1" 200 None 2026-04-23 03:08:09,628 - lava_callback - ERROR - Error processing callback for node 69e6ea1360f5826562c16c69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:09:49,692 - lava_callback - INFO - Received callback for node 69e6ea6860f5826562c16c95 INFO: 172.21.0.1:49416 - "POST /node/69e6ea6860f5826562c16c95 HTTP/1.0" 202 Accepted 2026-04-23 03:09:49,698 - lava_callback - INFO - Starting async job submit for node 69e6ea6860f5826562c16c95 2026-04-23 03:09:49,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,718 - lava_callback - DEBUG - Processing node 69e6ea6860f5826562c16c95: baseline-arm64-baylibre 2026-04-23 03:09:49,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ea6860f5826562c16c95 2026-04-23 03:09:49,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:09:49,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:09:49,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ea6860f5826562c16c95 HTTP/1.1" 200 None 2026-04-23 03:09:49,761 - lava_callback - ERROR - Error processing callback for node 69e6ea6860f5826562c16c95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:11:09,751 - lava_callback - INFO - Received callback for node 69e6eabc60f5826562c16cca INFO: 172.21.0.1:51184 - "POST /node/69e6eabc60f5826562c16cca HTTP/1.0" 202 Accepted 2026-04-23 03:11:09,756 - lava_callback - INFO - Starting async job submit for node 69e6eabc60f5826562c16cca 2026-04-23 03:11:09,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,771 - lava_callback - DEBUG - Processing node 69e6eabc60f5826562c16cca: baseline-arm64-baylibre 2026-04-23 03:11:09,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6eabc60f5826562c16cca 2026-04-23 03:11:09,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:11:09,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:09,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6eabc60f5826562c16cca HTTP/1.1" 200 None 2026-04-23 03:11:09,815 - lava_callback - ERROR - Error processing callback for node 69e6eabc60f5826562c16cca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:11:46,711 - lava_callback - INFO - Received callback for node 69e98d218137cb226ce20820 INFO: 172.21.0.1:46724 - "POST /node/69e98d218137cb226ce20820 HTTP/1.0" 202 Accepted 2026-04-23 03:11:46,717 - lava_callback - INFO - Starting async job submit for node 69e98d218137cb226ce20820 2026-04-23 03:11:46,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:46,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:46,750 - lava_callback - DEBUG - Processing node 69e98d218137cb226ce20820: baseline-arm64 2026-04-23 03:11:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/log.txt.gz 2026-04-23 03:11:47,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/lava-logs.yaml 2026-04-23 03:11:47,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:11:47,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:11:47,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98d218137cb226ce20820/lava_callback.json.gz 2026-04-23 03:11:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:48,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:11:48,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:48,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98d218137cb226ce20820 HTTP/1.1" 200 None 2026-04-23 03:11:48,133 - lava_callback - INFO - Completed processing callback for node 69e98d218137cb226ce20820 2026-04-23 03:11:56,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:11:56,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:10,664 - lava_callback - INFO - Received callback for node 69e98dc68137cb226ce2087a INFO: 172.21.0.1:49132 - "POST /node/69e98dc68137cb226ce2087a HTTP/1.0" 202 Accepted 2026-04-23 03:12:10,671 - lava_callback - INFO - Starting async job submit for node 69e98dc68137cb226ce2087a 2026-04-23 03:12:10,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:10,711 - lava_callback - DEBUG - Processing node 69e98dc68137cb226ce2087a: baseline-arm64 2026-04-23 03:12:11,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/log.txt.gz 2026-04-23 03:12:11,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/lava-logs.yaml 2026-04-23 03:12:11,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:11,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:11,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98dc68137cb226ce2087a/lava_callback.json.gz 2026-04-23 03:12:12,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:12,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:12:12,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:12,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98dc68137cb226ce2087a HTTP/1.1" 200 None 2026-04-23 03:12:12,051 - lava_callback - INFO - Completed processing callback for node 69e98dc68137cb226ce2087a INFO: 172.21.0.1:49138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:20,078 - lava_callback - INFO - Received callback for node 69e9857b8137cb226ce201f0 INFO: 172.21.0.1:33730 - "POST /node/69e9857b8137cb226ce201f0 HTTP/1.0" 202 Accepted 2026-04-23 03:12:20,084 - lava_callback - INFO - Starting async job submit for node 69e9857b8137cb226ce201f0 2026-04-23 03:12:20,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:20,131 - lava_callback - DEBUG - Processing node 69e9857b8137cb226ce201f0: baseline-arm64 2026-04-23 03:12:20,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/log.txt.gz 2026-04-23 03:12:20,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/lava-logs.yaml 2026-04-23 03:12:20,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:12:20,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:12:20,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9857b8137cb226ce201f0/lava_callback.json.gz 2026-04-23 03:12:20,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:20,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:12:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:21,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9857b8137cb226ce201f0 HTTP/1.1" 200 None 2026-04-23 03:12:21,059 - lava_callback - INFO - Completed processing callback for node 69e9857b8137cb226ce201f0 2026-04-23 03:12:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:26,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:12:29,763 - lava_callback - INFO - Received callback for node 69e6eb1060f5826562c16cef INFO: 172.21.0.1:41798 - "POST /node/69e6eb1060f5826562c16cef HTTP/1.0" 202 Accepted 2026-04-23 03:12:29,769 - lava_callback - INFO - Starting async job submit for node 69e6eb1060f5826562c16cef 2026-04-23 03:12:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,784 - lava_callback - DEBUG - Processing node 69e6eb1060f5826562c16cef: baseline-arm64-baylibre 2026-04-23 03:12:29,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6eb1060f5826562c16cef 2026-04-23 03:12:29,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:12:29,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:12:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6eb1060f5826562c16cef HTTP/1.1" 200 None 2026-04-23 03:12:29,836 - lava_callback - ERROR - Error processing callback for node 69e6eb1060f5826562c16cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:13:57,318 - lava_callback - INFO - Received callback for node 69e9858c8137cb226ce2021d INFO: 172.21.0.1:50822 - "POST /node/69e9858c8137cb226ce2021d HTTP/1.0" 202 Accepted 2026-04-23 03:13:57,325 - lava_callback - INFO - Starting async job submit for node 69e9858c8137cb226ce2021d 2026-04-23 03:13:57,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:57,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:57,375 - lava_callback - DEBUG - Processing node 69e9858c8137cb226ce2021d: baseline-nfs-arm64 2026-04-23 03:13:57,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:57,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:57,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/log.txt.gz 2026-04-23 03:13:58,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:58,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:58,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/lava-logs.yaml 2026-04-23 03:13:58,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:13:58,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:13:58,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9858c8137cb226ce2021d/lava_callback.json.gz 2026-04-23 03:13:58,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:13:58,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:13:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9858c8137cb226ce2021d HTTP/1.1" 200 None 2026-04-23 03:13:58,628 - lava_callback - INFO - Completed processing callback for node 69e9858c8137cb226ce2021d INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:14:26,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:14:26,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:16:03,564 - lava_callback - INFO - Received callback for node 69e98e328137cb226ce208cd INFO: 172.21.0.1:50856 - "POST /node/69e98e328137cb226ce208cd HTTP/1.0" 202 Accepted 2026-04-23 03:16:03,572 - lava_callback - INFO - Starting async job submit for node 69e98e328137cb226ce208cd 2026-04-23 03:16:03,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:03,624 - lava_callback - DEBUG - Processing node 69e98e328137cb226ce208cd: baseline-arm64-foundriesio 2026-04-23 03:16:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:04,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:04,781 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/log.txt.gz 2026-04-23 03:16:05,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:05,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:05,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/lava-logs.yaml 2026-04-23 03:16:05,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:16:05,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:16:05,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e98e328137cb226ce208cd/lava_callback.json.gz DEBUG: 69e98e328137cb226ce208cd Transitting job node result: pass -> incomplete 2026-04-23 03:16:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:16:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98e328137cb226ce208cd HTTP/1.1" 200 None 2026-04-23 03:16:05,748 - lava_callback - INFO - Completed processing callback for node 69e98e328137cb226ce208cd INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:16:26,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:16:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:18:01,815 - lava_callback - INFO - Received callback for node 69e6ec6560f5826562c16d99 INFO: 172.21.0.1:38100 - "POST /node/69e6ec6560f5826562c16d99 HTTP/1.0" 202 Accepted 2026-04-23 03:18:01,821 - lava_callback - INFO - Starting async job submit for node 69e6ec6560f5826562c16d99 2026-04-23 03:18:01,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,835 - lava_callback - DEBUG - Processing node 69e6ec6560f5826562c16d99: baseline-arm64-clabbe 2026-04-23 03:18:01,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ec6560f5826562c16d99 2026-04-23 03:18:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:18:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:18:01,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ec6560f5826562c16d99 HTTP/1.1" 200 None 2026-04-23 03:18:01,884 - lava_callback - ERROR - Error processing callback for node 69e6ec6560f5826562c16d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:19:41,925 - lava_callback - INFO - Received callback for node 69e6ecb860f5826562c16dc8 INFO: 172.21.0.1:58534 - "POST /node/69e6ecb860f5826562c16dc8 HTTP/1.0" 202 Accepted 2026-04-23 03:19:41,935 - lava_callback - INFO - Starting async job submit for node 69e6ecb860f5826562c16dc8 2026-04-23 03:19:41,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:41,950 - lava_callback - DEBUG - Processing node 69e6ecb860f5826562c16dc8: baseline-arm64-clabbe 2026-04-23 03:19:41,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ecb860f5826562c16dc8 2026-04-23 03:19:41,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:41,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:41,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:19:41,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:19:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ecb860f5826562c16dc8 HTTP/1.1" 200 None 2026-04-23 03:19:42,005 - lava_callback - ERROR - Error processing callback for node 69e6ecb860f5826562c16dc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:20:34,726 - lava_callback - INFO - Received callback for node 69e98fbe8137cb226ce209a6 INFO: 172.21.0.1:39136 - "POST /node/69e98fbe8137cb226ce209a6 HTTP/1.0" 202 Accepted 2026-04-23 03:20:34,732 - lava_callback - INFO - Starting async job submit for node 69e98fbe8137cb226ce209a6 2026-04-23 03:20:34,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:34,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:34,776 - lava_callback - DEBUG - Processing node 69e98fbe8137cb226ce209a6: baseline-arm64 2026-04-23 03:20:34,976 - lava_callback - WARNING - Failed to upload log 2026-04-23 03:20:35,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:20:35,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:20:35,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98fbe8137cb226ce209a6/lava-logs.yaml 2026-04-23 03:20:35,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:20:35,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:20:35,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e98fbe8137cb226ce209a6/lava_callback.json.gz 2026-04-23 03:20:35,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:35,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:20:35,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:35,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98fbe8137cb226ce209a6 HTTP/1.1" 200 None 2026-04-23 03:20:35,547 - lava_callback - INFO - Completed processing callback for node 69e98fbe8137cb226ce209a6 INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:20:56,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:20:56,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:21:01,953 - lava_callback - INFO - Received callback for node 69e6ed0f60f5826562c16ddf INFO: 172.21.0.1:55464 - "POST /node/69e6ed0f60f5826562c16ddf HTTP/1.0" 202 Accepted 2026-04-23 03:21:01,958 - lava_callback - INFO - Starting async job submit for node 69e6ed0f60f5826562c16ddf 2026-04-23 03:21:01,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:01,973 - lava_callback - DEBUG - Processing node 69e6ed0f60f5826562c16ddf: baseline-arm64-clabbe 2026-04-23 03:21:01,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ed0f60f5826562c16ddf 2026-04-23 03:21:01,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:01,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:01,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:21:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:21:02,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ed0f60f5826562c16ddf HTTP/1.1" 200 None 2026-04-23 03:21:02,019 - lava_callback - ERROR - Error processing callback for node 69e6ed0f60f5826562c16ddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:22:22,035 - lava_callback - INFO - Received callback for node 69e6ed6360f5826562c16e07 INFO: 172.21.0.1:58214 - "POST /node/69e6ed6360f5826562c16e07 HTTP/1.0" 202 Accepted 2026-04-23 03:22:22,040 - lava_callback - INFO - Starting async job submit for node 69e6ed6360f5826562c16e07 2026-04-23 03:22:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,059 - lava_callback - DEBUG - Processing node 69e6ed6360f5826562c16e07: baseline-arm64-clabbe 2026-04-23 03:22:22,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ed6360f5826562c16e07 2026-04-23 03:22:22,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:22:22,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:22:22,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ed6360f5826562c16e07 HTTP/1.1" 200 None 2026-04-23 03:22:22,105 - lava_callback - ERROR - Error processing callback for node 69e6ed6360f5826562c16e07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:23:42,126 - lava_callback - INFO - Received callback for node 69e6edb760f5826562c16e2b INFO: 172.21.0.1:37872 - "POST /node/69e6edb760f5826562c16e2b HTTP/1.0" 202 Accepted 2026-04-23 03:23:42,132 - lava_callback - INFO - Starting async job submit for node 69e6edb760f5826562c16e2b 2026-04-23 03:23:42,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,146 - lava_callback - DEBUG - Processing node 69e6edb760f5826562c16e2b: baseline-arm64-clabbe 2026-04-23 03:23:42,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6edb760f5826562c16e2b 2026-04-23 03:23:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:23:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:23:42,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6edb760f5826562c16e2b HTTP/1.1" 200 None 2026-04-23 03:23:42,195 - lava_callback - ERROR - Error processing callback for node 69e6edb760f5826562c16e2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:25:22,141 - lava_callback - INFO - Received callback for node 69e6ee0c60f5826562c16e50 INFO: 172.21.0.1:33676 - "POST /node/69e6ee0c60f5826562c16e50 HTTP/1.0" 202 Accepted 2026-04-23 03:25:22,146 - lava_callback - INFO - Starting async job submit for node 69e6ee0c60f5826562c16e50 2026-04-23 03:25:22,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,167 - lava_callback - DEBUG - Processing node 69e6ee0c60f5826562c16e50: baseline-arm64-clabbe 2026-04-23 03:25:22,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ee0c60f5826562c16e50 2026-04-23 03:25:22,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:25:22,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:25:22,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ee0c60f5826562c16e50 HTTP/1.1" 200 None 2026-04-23 03:25:22,212 - lava_callback - ERROR - Error processing callback for node 69e6ee0c60f5826562c16e50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:26:42,182 - lava_callback - INFO - Received callback for node 69e6ee5f60f5826562c16e77 INFO: 172.21.0.1:45870 - "POST /node/69e6ee5f60f5826562c16e77 HTTP/1.0" 202 Accepted 2026-04-23 03:26:42,187 - lava_callback - INFO - Starting async job submit for node 69e6ee5f60f5826562c16e77 2026-04-23 03:26:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,203 - lava_callback - DEBUG - Processing node 69e6ee5f60f5826562c16e77: baseline-arm64-clabbe 2026-04-23 03:26:42,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ee5f60f5826562c16e77 2026-04-23 03:26:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-23 03:26:42,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:26:42,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ee5f60f5826562c16e77 HTTP/1.1" 200 None 2026-04-23 03:26:42,248 - lava_callback - ERROR - Error processing callback for node 69e6ee5f60f5826562c16e77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:33:39,395 - lava_callback - INFO - Received callback for node 69e991638137cb226ce20a90 INFO: 172.21.0.1:37232 - "POST /node/69e991638137cb226ce20a90 HTTP/1.0" 202 Accepted 2026-04-23 03:33:39,402 - lava_callback - INFO - Starting async job submit for node 69e991638137cb226ce20a90 2026-04-23 03:33:39,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:39,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:39,476 - lava_callback - DEBUG - Processing node 69e991638137cb226ce20a90: baseline-arm64 2026-04-23 03:33:39,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/log.txt.gz 2026-04-23 03:33:40,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/lava-logs.yaml 2026-04-23 03:33:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:33:40,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:33:40,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e991638137cb226ce20a90/lava_callback.json.gz DEBUG: Setup failed for 69e991638137cb226ce20a90. Transitting job node result: incomplete -> fail 2026-04-23 03:33:40,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:33:40,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:40,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e991638137cb226ce20a90 HTTP/1.1" 200 None 2026-04-23 03:33:40,975 - lava_callback - INFO - Completed processing callback for node 69e991638137cb226ce20a90 INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:33:56,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:33:56,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:34:32,729 - lava_callback - INFO - Received callback for node 69e990bf8137cb226ce20a33 INFO: 172.21.0.1:52738 - "POST /node/69e990bf8137cb226ce20a33 HTTP/1.0" 202 Accepted 2026-04-23 03:34:32,735 - lava_callback - INFO - Starting async job submit for node 69e990bf8137cb226ce20a33 2026-04-23 03:34:32,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:32,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:32,798 - lava_callback - DEBUG - Processing node 69e990bf8137cb226ce20a33: baseline-nfs-arm64 2026-04-23 03:34:33,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:33,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:33,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/log.txt.gz 2026-04-23 03:34:33,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:33,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:33,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/lava-logs.yaml 2026-04-23 03:34:33,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:34:34,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:34:34,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e990bf8137cb226ce20a33/lava_callback.json.gz 2026-04-23 03:34:34,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:34,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:34:34,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:34,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e990bf8137cb226ce20a33 HTTP/1.1" 200 None 2026-04-23 03:34:34,183 - lava_callback - INFO - Completed processing callback for node 69e990bf8137cb226ce20a33 INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:34:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:34:56,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:35:39,763 - lava_callback - INFO - Received callback for node 69e98eca8137cb226ce20920 INFO: 172.21.0.1:42826 - "POST /node/69e98eca8137cb226ce20920 HTTP/1.0" 202 Accepted 2026-04-23 03:35:39,771 - lava_callback - INFO - Starting async job submit for node 69e98eca8137cb226ce20920 2026-04-23 03:35:39,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:39,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:39,827 - lava_callback - DEBUG - Processing node 69e98eca8137cb226ce20920: baseline-nfs-arm64 2026-04-23 03:35:40,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/log.txt.gz 2026-04-23 03:35:41,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/lava-logs.yaml 2026-04-23 03:35:41,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:35:41,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:35:41,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98eca8137cb226ce20920/lava_callback.json.gz DEBUG: Setup failed for 69e98eca8137cb226ce20920. Transitting job node result: incomplete -> fail 2026-04-23 03:35:42,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:42,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:35:42,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98eca8137cb226ce20920 HTTP/1.1" 200 None 2026-04-23 03:35:42,205 - lava_callback - INFO - Completed processing callback for node 69e98eca8137cb226ce20920 INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:35:56,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:35:56,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:36:43,422 - lava_callback - INFO - Received callback for node 69e98f1c8137cb226ce20953 INFO: 172.21.0.1:38442 - "POST /node/69e98f1c8137cb226ce20953 HTTP/1.0" 202 Accepted 2026-04-23 03:36:43,430 - lava_callback - INFO - Starting async job submit for node 69e98f1c8137cb226ce20953 2026-04-23 03:36:43,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:43,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:43,513 - lava_callback - DEBUG - Processing node 69e98f1c8137cb226ce20953: baseline-nfs-arm64 2026-04-23 03:36:44,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:44,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:44,930 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/log.txt.gz 2026-04-23 03:36:45,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:45,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:45,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/lava-logs.yaml 2026-04-23 03:36:45,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:36:46,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:36:46,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e98f1c8137cb226ce20953/lava_callback.json.gz DEBUG: Setup failed for 69e98f1c8137cb226ce20953. Transitting job node result: incomplete -> fail 2026-04-23 03:36:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:46,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:36:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:46,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e98f1c8137cb226ce20953 HTTP/1.1" 200 None 2026-04-23 03:36:46,310 - lava_callback - INFO - Completed processing callback for node 69e98f1c8137cb226ce20953 INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:36:56,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:36:56,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:38:11,408 - lava_callback - INFO - Received callback for node 69e6f11c60f5826562c16f79 INFO: 172.21.0.1:49176 - "POST /node/69e6f11c60f5826562c16f79 HTTP/1.0" 202 Accepted 2026-04-23 03:38:11,413 - lava_callback - INFO - Starting async job submit for node 69e6f11c60f5826562c16f79 2026-04-23 03:38:11,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,428 - lava_callback - DEBUG - Processing node 69e6f11c60f5826562c16f79: baseline-arm-baylibre 2026-04-23 03:38:11,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f11c60f5826562c16f79 2026-04-23 03:38:11,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:38:11,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:38:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f11c60f5826562c16f79 HTTP/1.1" 200 None 2026-04-23 03:38:11,473 - lava_callback - ERROR - Error processing callback for node 69e6f11c60f5826562c16f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:41:11,508 - lava_callback - INFO - Received callback for node 69e6f1d360f5826562c16f8d INFO: 172.21.0.1:33010 - "POST /node/69e6f1d360f5826562c16f8d HTTP/1.0" 202 Accepted 2026-04-23 03:41:11,514 - lava_callback - INFO - Starting async job submit for node 69e6f1d360f5826562c16f8d 2026-04-23 03:41:11,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,531 - lava_callback - DEBUG - Processing node 69e6f1d360f5826562c16f8d: baseline-arm-baylibre 2026-04-23 03:41:11,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f1d360f5826562c16f8d 2026-04-23 03:41:11,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:41:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f1d360f5826562c16f8d HTTP/1.1" 200 None 2026-04-23 03:41:11,583 - lava_callback - ERROR - Error processing callback for node 69e6f1d360f5826562c16f8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:41:51,426 - lava_callback - INFO - Received callback for node 69e6f1fa60f5826562c16f9b INFO: 172.21.0.1:55964 - "POST /node/69e6f1fa60f5826562c16f9b HTTP/1.0" 202 Accepted 2026-04-23 03:41:51,432 - lava_callback - INFO - Starting async job submit for node 69e6f1fa60f5826562c16f9b 2026-04-23 03:41:51,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,446 - lava_callback - DEBUG - Processing node 69e6f1fa60f5826562c16f9b: baseline-arm-baylibre 2026-04-23 03:41:51,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f1fa60f5826562c16f9b 2026-04-23 03:41:51,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:41:51,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:41:51,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f1fa60f5826562c16f9b HTTP/1.1" 200 None 2026-04-23 03:41:51,511 - lava_callback - ERROR - Error processing callback for node 69e6f1fa60f5826562c16f9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:43:11,613 - lava_callback - INFO - Received callback for node 69e6f24a60f5826562c16faa INFO: 172.21.0.1:36856 - "POST /node/69e6f24a60f5826562c16faa HTTP/1.0" 202 Accepted 2026-04-23 03:43:11,618 - lava_callback - INFO - Starting async job submit for node 69e6f24a60f5826562c16faa 2026-04-23 03:43:11,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,634 - lava_callback - DEBUG - Processing node 69e6f24a60f5826562c16faa: baseline-arm-baylibre 2026-04-23 03:43:11,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f24a60f5826562c16faa 2026-04-23 03:43:11,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:43:11,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:43:11,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f24a60f5826562c16faa HTTP/1.1" 200 None 2026-04-23 03:43:11,690 - lava_callback - ERROR - Error processing callback for node 69e6f24a60f5826562c16faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:47:11,783 - lava_callback - INFO - Received callback for node 69e6f33c60f5826562c16fbe INFO: 172.21.0.1:45888 - "POST /node/69e6f33c60f5826562c16fbe HTTP/1.0" 202 Accepted 2026-04-23 03:47:11,789 - lava_callback - INFO - Starting async job submit for node 69e6f33c60f5826562c16fbe 2026-04-23 03:47:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,803 - lava_callback - DEBUG - Processing node 69e6f33c60f5826562c16fbe: baseline-arm-baylibre 2026-04-23 03:47:11,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f33c60f5826562c16fbe 2026-04-23 03:47:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:47:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:11,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f33c60f5826562c16fbe HTTP/1.1" 200 None 2026-04-23 03:47:11,850 - lava_callback - ERROR - Error processing callback for node 69e6f33c60f5826562c16fbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:47:19,537 - lava_callback - INFO - Received callback for node 69e995e98137cb226ce20d34 INFO: 172.21.0.1:45910 - "POST /node/69e995e98137cb226ce20d34 HTTP/1.0" 202 Accepted 2026-04-23 03:47:19,543 - lava_callback - INFO - Starting async job submit for node 69e995e98137cb226ce20d34 2026-04-23 03:47:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:19,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:19,578 - lava_callback - DEBUG - Processing node 69e995e98137cb226ce20d34: baseline-arm64 2026-04-23 03:47:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/log.txt.gz 2026-04-23 03:47:20,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/lava-logs.yaml 2026-04-23 03:47:20,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:47:20,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:47:20,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995e98137cb226ce20d34/lava_callback.json.gz 2026-04-23 03:47:20,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:20,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:47:20,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:20,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e995e98137cb226ce20d34 HTTP/1.1" 200 None 2026-04-23 03:47:20,695 - lava_callback - INFO - Completed processing callback for node 69e995e98137cb226ce20d34 2026-04-23 03:47:26,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:47:26,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:48:11,706 - lava_callback - INFO - Received callback for node 69e6f37860f5826562c16fcd INFO: 172.21.0.1:38254 - "POST /node/69e6f37860f5826562c16fcd HTTP/1.0" 202 Accepted 2026-04-23 03:48:11,715 - lava_callback - INFO - Starting async job submit for node 69e6f37860f5826562c16fcd 2026-04-23 03:48:11,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,734 - lava_callback - DEBUG - Processing node 69e6f37860f5826562c16fcd: baseline-arm-baylibre 2026-04-23 03:48:11,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f37860f5826562c16fcd 2026-04-23 03:48:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:48:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:11,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f37860f5826562c16fcd HTTP/1.1" 200 None 2026-04-23 03:48:11,777 - lava_callback - ERROR - Error processing callback for node 69e6f37860f5826562c16fcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 03:48:14,249 - lava_callback - INFO - Received callback for node 69e995968137cb226ce20d08 INFO: 172.21.0.1:38266 - "POST /node/69e995968137cb226ce20d08 HTTP/1.0" 202 Accepted 2026-04-23 03:48:14,255 - lava_callback - INFO - Starting async job submit for node 69e995968137cb226ce20d08 2026-04-23 03:48:14,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:14,286 - lava_callback - DEBUG - Processing node 69e995968137cb226ce20d08: baseline-arm64 2026-04-23 03:48:14,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:48:14,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:14,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/log.txt.gz 2026-04-23 03:48:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:48:15,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:15,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/lava-logs.yaml 2026-04-23 03:48:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38280 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 03:48:15,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:48:15,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e995968137cb226ce20d08/lava_callback.json.gz 2026-04-23 03:48:15,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:15,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:48:15,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:15,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e995968137cb226ce20d08 HTTP/1.1" 200 None 2026-04-23 03:48:15,334 - lava_callback - INFO - Completed processing callback for node 69e995968137cb226ce20d08 INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:48:26,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:48:26,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:25,483 - lava_callback - INFO - Received callback for node 69e996ea8137cb226ce20da9 INFO: 172.21.0.1:53502 - "POST /node/69e996ea8137cb226ce20da9 HTTP/1.0" 202 Accepted 2026-04-23 03:51:25,490 - lava_callback - INFO - Starting async job submit for node 69e996ea8137cb226ce20da9 2026-04-23 03:51:25,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:25,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:25,532 - lava_callback - DEBUG - Processing node 69e996ea8137cb226ce20da9: baseline-arm64-foundriesio 2026-04-23 03:51:25,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:51:26,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/log.txt.gz 2026-04-23 03:51:26,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 03:51:26,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,528 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/lava-logs.yaml 2026-04-23 03:51:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:26,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 03:51:26,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e996ea8137cb226ce20da9/lava_callback.json.gz 2026-04-23 03:51:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:26,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 03:51:26,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e996ea8137cb226ce20da9 HTTP/1.1" 200 None 2026-04-23 03:51:26,746 - lava_callback - INFO - Completed processing callback for node 69e996ea8137cb226ce20da9 INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:51:56,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:51:56,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:53:03,237 - lava_callback - INFO - Received callback for node 69e6f48d60f5826562c16ffd INFO: 172.21.0.1:49670 - "POST /node/69e6f48d60f5826562c16ffd HTTP/1.0" 202 Accepted 2026-04-23 03:53:03,243 - lava_callback - INFO - Starting async job submit for node 69e6f48d60f5826562c16ffd 2026-04-23 03:53:03,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,258 - lava_callback - DEBUG - Processing node 69e6f48d60f5826562c16ffd: baseline-arm-clabbe 2026-04-23 03:53:03,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f48d60f5826562c16ffd 2026-04-23 03:53:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:53:03,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:03,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f48d60f5826562c16ffd HTTP/1.1" 200 None 2026-04-23 03:53:03,330 - lava_callback - ERROR - Error processing callback for node 69e6f48d60f5826562c16ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:53:43,214 - lava_callback - INFO - Received callback for node 69e6f4b360f5826562c1700d INFO: 172.21.0.1:45622 - "POST /node/69e6f4b360f5826562c1700d HTTP/1.0" 202 Accepted 2026-04-23 03:53:43,219 - lava_callback - INFO - Starting async job submit for node 69e6f4b360f5826562c1700d 2026-04-23 03:53:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,234 - lava_callback - DEBUG - Processing node 69e6f4b360f5826562c1700d: baseline-arm-clabbe 2026-04-23 03:53:43,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f4b360f5826562c1700d 2026-04-23 03:53:43,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:53:43,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:53:43,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f4b360f5826562c1700d HTTP/1.1" 200 None 2026-04-23 03:53:43,281 - lava_callback - ERROR - Error processing callback for node 69e6f4b360f5826562c1700d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:54:23,255 - lava_callback - INFO - Received callback for node 69e6f4e260f5826562c1701b INFO: 172.21.0.1:53540 - "POST /node/69e6f4e260f5826562c1701b HTTP/1.0" 202 Accepted 2026-04-23 03:54:23,260 - lava_callback - INFO - Starting async job submit for node 69e6f4e260f5826562c1701b 2026-04-23 03:54:23,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,275 - lava_callback - DEBUG - Processing node 69e6f4e260f5826562c1701b: baseline-arm-clabbe 2026-04-23 03:54:23,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f4e260f5826562c1701b 2026-04-23 03:54:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:54:23,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:54:23,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f4e260f5826562c1701b HTTP/1.1" 200 None 2026-04-23 03:54:23,320 - lava_callback - ERROR - Error processing callback for node 69e6f4e260f5826562c1701b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:55:03,221 - lava_callback - INFO - Received callback for node 69e6f50860f5826562c17029 INFO: 172.21.0.1:45074 - "POST /node/69e6f50860f5826562c17029 HTTP/1.0" 202 Accepted 2026-04-23 03:55:03,227 - lava_callback - INFO - Starting async job submit for node 69e6f50860f5826562c17029 2026-04-23 03:55:03,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,246 - lava_callback - DEBUG - Processing node 69e6f50860f5826562c17029: baseline-arm-clabbe 2026-04-23 03:55:03,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f50860f5826562c17029 2026-04-23 03:55:03,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:55:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:03,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f50860f5826562c17029 HTTP/1.1" 200 None 2026-04-23 03:55:03,289 - lava_callback - ERROR - Error processing callback for node 69e6f50860f5826562c17029: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:55:43,322 - lava_callback - INFO - Received callback for node 69e6f52d60f5826562c17039 INFO: 172.21.0.1:36922 - "POST /node/69e6f52d60f5826562c17039 HTTP/1.0" 202 Accepted 2026-04-23 03:55:43,327 - lava_callback - INFO - Starting async job submit for node 69e6f52d60f5826562c17039 2026-04-23 03:55:43,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,352 - lava_callback - DEBUG - Processing node 69e6f52d60f5826562c17039: baseline-arm-clabbe 2026-04-23 03:55:43,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f52d60f5826562c17039 2026-04-23 03:55:43,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:55:43,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:55:43,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f52d60f5826562c17039 HTTP/1.1" 200 None 2026-04-23 03:55:43,397 - lava_callback - ERROR - Error processing callback for node 69e6f52d60f5826562c17039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:56:23,318 - lava_callback - INFO - Received callback for node 69e6f55b60f5826562c17047 INFO: 172.21.0.1:46366 - "POST /node/69e6f55b60f5826562c17047 HTTP/1.0" 202 Accepted 2026-04-23 03:56:23,326 - lava_callback - INFO - Starting async job submit for node 69e6f55b60f5826562c17047 2026-04-23 03:56:23,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,350 - lava_callback - DEBUG - Processing node 69e6f55b60f5826562c17047: baseline-arm-clabbe 2026-04-23 03:56:23,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f55b60f5826562c17047 2026-04-23 03:56:23,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:56:23,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:56:23,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f55b60f5826562c17047 HTTP/1.1" 200 None 2026-04-23 03:56:23,398 - lava_callback - ERROR - Error processing callback for node 69e6f55b60f5826562c17047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:57:03,356 - lava_callback - INFO - Received callback for node 69e6f58060f5826562c17054 INFO: 172.21.0.1:43214 - "POST /node/69e6f58060f5826562c17054 HTTP/1.0" 202 Accepted 2026-04-23 03:57:03,362 - lava_callback - INFO - Starting async job submit for node 69e6f58060f5826562c17054 2026-04-23 03:57:03,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,377 - lava_callback - DEBUG - Processing node 69e6f58060f5826562c17054: baseline-arm-clabbe 2026-04-23 03:57:03,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f58060f5826562c17054 2026-04-23 03:57:03,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:57:03,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:03,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f58060f5826562c17054 HTTP/1.1" 200 None 2026-04-23 03:57:03,433 - lava_callback - ERROR - Error processing callback for node 69e6f58060f5826562c17054: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK 2026-04-23 03:57:43,394 - lava_callback - INFO - Received callback for node 69e6f5a560f5826562c17065 INFO: 172.21.0.1:52612 - "POST /node/69e6f5a560f5826562c17065 HTTP/1.0" 202 Accepted 2026-04-23 03:57:43,399 - lava_callback - INFO - Starting async job submit for node 69e6f5a560f5826562c17065 2026-04-23 03:57:43,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,415 - lava_callback - DEBUG - Processing node 69e6f5a560f5826562c17065: baseline-arm-clabbe 2026-04-23 03:57:43,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f5a560f5826562c17065 2026-04-23 03:57:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 03:57:43,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 03:57:43,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f5a560f5826562c17065 HTTP/1.1" 200 None 2026-04-23 03:57:43,470 - lava_callback - ERROR - Error processing callback for node 69e6f5a560f5826562c17065: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:01:23,560 - lava_callback - INFO - Received callback for node 69e6f68860f5826562c17077 INFO: 172.21.0.1:50058 - "POST /node/69e6f68860f5826562c17077 HTTP/1.0" 202 Accepted 2026-04-23 04:01:23,566 - lava_callback - INFO - Starting async job submit for node 69e6f68860f5826562c17077 2026-04-23 04:01:23,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,581 - lava_callback - DEBUG - Processing node 69e6f68860f5826562c17077: baseline-arm-clabbe 2026-04-23 04:01:23,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6f68860f5826562c17077 2026-04-23 04:01:23,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-23 04:01:23,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:01:23,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6f68860f5826562c17077 HTTP/1.1" 200 None 2026-04-23 04:01:23,639 - lava_callback - ERROR - Error processing callback for node 69e6f68860f5826562c17077: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:08:20,909 - lava_callback - INFO - Received callback for node 69e999758137cb226ce20f2a INFO: 172.21.0.1:35636 - "POST /node/69e999758137cb226ce20f2a HTTP/1.0" 202 Accepted 2026-04-23 04:08:20,916 - lava_callback - INFO - Starting async job submit for node 69e999758137cb226ce20f2a 2026-04-23 04:08:20,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:20,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:20,967 - lava_callback - DEBUG - Processing node 69e999758137cb226ce20f2a: baseline-arm64 2026-04-23 04:08:21,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:21,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:21,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/log.txt.gz 2026-04-23 04:08:21,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:21,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:21,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/lava-logs.yaml 2026-04-23 04:08:21,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:08:22,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:08:22,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e999758137cb226ce20f2a/lava_callback.json.gz DEBUG: Setup failed for 69e999758137cb226ce20f2a. Transitting job node result: incomplete -> fail 2026-04-23 04:08:22,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:22,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:08:22,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:22,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e999758137cb226ce20f2a HTTP/1.1" 200 None 2026-04-23 04:08:22,401 - lava_callback - INFO - Completed processing callback for node 69e999758137cb226ce20f2a 2026-04-23 04:08:26,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:08:26,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:13:13,928 - lava_callback - INFO - Received callback for node 69e999cb8137cb226ce20f59 INFO: 172.21.0.1:44582 - "POST /node/69e999cb8137cb226ce20f59 HTTP/1.0" 202 Accepted 2026-04-23 04:13:13,935 - lava_callback - INFO - Starting async job submit for node 69e999cb8137cb226ce20f59 2026-04-23 04:13:13,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:13,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:13,974 - lava_callback - DEBUG - Processing node 69e999cb8137cb226ce20f59: baseline-nfs-arm64 2026-04-23 04:13:14,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:13:14,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:14,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/log.txt.gz 2026-04-23 04:13:14,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44586 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 04:13:15,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:15,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/lava-logs.yaml 2026-04-23 04:13:15,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:13:15,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:13:15,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e999cb8137cb226ce20f59/lava_callback.json.gz 2026-04-23 04:13:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:15,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:13:15,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:15,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e999cb8137cb226ce20f59 HTTP/1.1" 200 None 2026-04-23 04:13:15,593 - lava_callback - INFO - Completed processing callback for node 69e999cb8137cb226ce20f59 INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:13:26,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:13:26,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:23:45,370 - lava_callback - INFO - Received callback for node 69e99a1c8137cb226ce20f80 INFO: 172.21.0.1:49274 - "POST /node/69e99a1c8137cb226ce20f80 HTTP/1.0" 202 Accepted 2026-04-23 04:23:45,378 - lava_callback - INFO - Starting async job submit for node 69e99a1c8137cb226ce20f80 2026-04-23 04:23:45,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:45,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:45,441 - lava_callback - DEBUG - Processing node 69e99a1c8137cb226ce20f80: baseline-nfs-arm64 2026-04-23 04:23:46,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:23:46,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:46,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/log.txt.gz 2026-04-23 04:23:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:23:47,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:47,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/lava-logs.yaml 2026-04-23 04:23:47,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:23:47,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:23:47,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a1c8137cb226ce20f80/lava_callback.json.gz DEBUG: Setup failed for 69e99a1c8137cb226ce20f80. Transitting job node result: incomplete -> fail 2026-04-23 04:23:47,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:47,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:23:47,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:47,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99a1c8137cb226ce20f80 HTTP/1.1" 200 None 2026-04-23 04:23:47,988 - lava_callback - INFO - Completed processing callback for node 69e99a1c8137cb226ce20f80 2026-04-23 04:23:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:23:56,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:04,554 - lava_callback - INFO - Received callback for node 69e99a6e8137cb226ce20fad INFO: 172.21.0.1:60382 - "POST /node/69e99a6e8137cb226ce20fad HTTP/1.0" 202 Accepted 2026-04-23 04:25:04,566 - lava_callback - INFO - Starting async job submit for node 69e99a6e8137cb226ce20fad 2026-04-23 04:25:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:04,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:04,631 - lava_callback - DEBUG - Processing node 69e99a6e8137cb226ce20fad: baseline-nfs-arm64 2026-04-23 04:25:05,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:06,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:06,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/log.txt.gz INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:06,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:07,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:07,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/lava-logs.yaml 2026-04-23 04:25:07,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:25:07,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:25:07,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99a6e8137cb226ce20fad/lava_callback.json.gz DEBUG: Setup failed for 69e99a6e8137cb226ce20fad. Transitting job node result: incomplete -> fail 2026-04-23 04:25:07,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:07,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:25:07,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:07,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99a6e8137cb226ce20fad HTTP/1.1" 200 None 2026-04-23 04:25:07,501 - lava_callback - INFO - Completed processing callback for node 69e99a6e8137cb226ce20fad INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:25:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:25:26,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:44:20,565 - lava_callback - INFO - Received callback for node 69e99ee08137cb226ce21014 INFO: 172.21.0.1:48008 - "POST /node/69e99ee08137cb226ce21014 HTTP/1.0" 202 Accepted 2026-04-23 04:44:20,574 - lava_callback - INFO - Starting async job submit for node 69e99ee08137cb226ce21014 2026-04-23 04:44:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:20,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:20,634 - lava_callback - DEBUG - Processing node 69e99ee08137cb226ce21014: baseline-nfs-arm64 2026-04-23 04:44:21,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:21,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:21,699 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/log.txt.gz 2026-04-23 04:44:22,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:22,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:22,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/lava-logs.yaml 2026-04-23 04:44:22,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:44:22,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:44:22,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99ee08137cb226ce21014/lava_callback.json.gz DEBUG: Setup failed for 69e99ee08137cb226ce21014. Transitting job node result: incomplete -> fail 2026-04-23 04:44:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:22,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:44:22,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:22,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99ee08137cb226ce21014 HTTP/1.1" 200 None 2026-04-23 04:44:22,874 - lava_callback - INFO - Completed processing callback for node 69e99ee08137cb226ce21014 2026-04-23 04:44:26,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:44:26,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:24,870 - lava_callback - INFO - Received callback for node 69e99f348137cb226ce21043 INFO: 172.21.0.1:37848 - "POST /node/69e99f348137cb226ce21043 HTTP/1.0" 202 Accepted 2026-04-23 04:45:24,878 - lava_callback - INFO - Starting async job submit for node 69e99f348137cb226ce21043 2026-04-23 04:45:24,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:24,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:24,951 - lava_callback - DEBUG - Processing node 69e99f348137cb226ce21043: baseline-nfs-arm64 2026-04-23 04:45:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:26,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:26,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/log.txt.gz INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:27,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:27,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/lava-logs.yaml 2026-04-23 04:45:27,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 04:45:27,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 04:45:27,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e99f348137cb226ce21043/lava_callback.json.gz DEBUG: Setup failed for 69e99f348137cb226ce21043. Transitting job node result: incomplete -> fail 2026-04-23 04:45:27,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 04:45:27,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:27,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e99f348137cb226ce21043 HTTP/1.1" 200 None 2026-04-23 04:45:27,689 - lava_callback - INFO - Completed processing callback for node 69e99f348137cb226ce21043 2026-04-23 04:45:35,077 - lava_callback - INFO - Received callback for node 69e700e260f5826562c170e7 INFO: 172.21.0.1:34702 - "POST /node/69e700e260f5826562c170e7 HTTP/1.0" 202 Accepted 2026-04-23 04:45:35,082 - lava_callback - INFO - Starting async job submit for node 69e700e260f5826562c170e7 2026-04-23 04:45:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,097 - lava_callback - DEBUG - Processing node 69e700e260f5826562c170e7: baseline-arm-baylibre 2026-04-23 04:45:35,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e700e260f5826562c170e7 2026-04-23 04:45:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:45:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:35,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e700e260f5826562c170e7 HTTP/1.1" 200 None 2026-04-23 04:45:35,142 - lava_callback - ERROR - Error processing callback for node 69e700e260f5826562c170e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:45:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:45:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:46:14,945 - lava_callback - INFO - Received callback for node 69e7010a60f5826562c170f2 INFO: 172.21.0.1:58806 - "POST /node/69e7010a60f5826562c170f2 HTTP/1.0" 202 Accepted 2026-04-23 04:46:14,951 - lava_callback - INFO - Starting async job submit for node 69e7010a60f5826562c170f2 2026-04-23 04:46:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:14,967 - lava_callback - DEBUG - Processing node 69e7010a60f5826562c170f2: baseline-arm-baylibre 2026-04-23 04:46:14,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7010a60f5826562c170f2 2026-04-23 04:46:14,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:14,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:14,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:46:14,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:46:15,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7010a60f5826562c170f2 HTTP/1.1" 200 None 2026-04-23 04:46:15,012 - lava_callback - ERROR - Error processing callback for node 69e7010a60f5826562c170f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:47:35,068 - lava_callback - INFO - Received callback for node 69e7015b60f5826562c17103 INFO: 172.21.0.1:46542 - "POST /node/69e7015b60f5826562c17103 HTTP/1.0" 202 Accepted 2026-04-23 04:47:35,073 - lava_callback - INFO - Starting async job submit for node 69e7015b60f5826562c17103 2026-04-23 04:47:35,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,089 - lava_callback - DEBUG - Processing node 69e7015b60f5826562c17103: baseline-arm-baylibre 2026-04-23 04:47:35,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7015b60f5826562c17103 2026-04-23 04:47:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:47:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:47:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7015b60f5826562c17103 HTTP/1.1" 200 None 2026-04-23 04:47:35,143 - lava_callback - ERROR - Error processing callback for node 69e7015b60f5826562c17103: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:48:35,084 - lava_callback - INFO - Received callback for node 69e7019860f5826562c17110 INFO: 172.21.0.1:40680 - "POST /node/69e7019860f5826562c17110 HTTP/1.0" 202 Accepted 2026-04-23 04:48:35,090 - lava_callback - INFO - Starting async job submit for node 69e7019860f5826562c17110 2026-04-23 04:48:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,105 - lava_callback - DEBUG - Processing node 69e7019860f5826562c17110: baseline-arm-baylibre 2026-04-23 04:48:35,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7019860f5826562c17110 2026-04-23 04:48:35,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:48:35,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:48:35,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7019860f5826562c17110 HTTP/1.1" 200 None 2026-04-23 04:48:35,159 - lava_callback - ERROR - Error processing callback for node 69e7019860f5826562c17110: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:49:15,154 - lava_callback - INFO - Received callback for node 69e701bd60f5826562c1711b INFO: 172.21.0.1:35838 - "POST /node/69e701bd60f5826562c1711b HTTP/1.0" 202 Accepted 2026-04-23 04:49:15,159 - lava_callback - INFO - Starting async job submit for node 69e701bd60f5826562c1711b 2026-04-23 04:49:15,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 04:49:15,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,175 - lava_callback - DEBUG - Processing node 69e701bd60f5826562c1711b: baseline-arm-baylibre 2026-04-23 04:49:15,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e701bd60f5826562c1711b 2026-04-23 04:49:15,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:49:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:49:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e701bd60f5826562c1711b HTTP/1.1" 200 None 2026-04-23 04:49:15,227 - lava_callback - ERROR - Error processing callback for node 69e701bd60f5826562c1711b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:51:45,721 - lava_callback - INFO - Received callback for node 69e7025460f5826562c17136 INFO: 172.21.0.1:55718 - "POST /node/69e7025460f5826562c17136 HTTP/1.0" 202 Accepted 2026-04-23 04:51:45,726 - lava_callback - INFO - Starting async job submit for node 69e7025460f5826562c17136 2026-04-23 04:51:45,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,746 - lava_callback - DEBUG - Processing node 69e7025460f5826562c17136: baseline-arm-clabbe 2026-04-23 04:51:45,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7025460f5826562c17136 2026-04-23 04:51:45,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:51:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:51:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7025460f5826562c17136 HTTP/1.1" 200 None 2026-04-23 04:51:45,796 - lava_callback - ERROR - Error processing callback for node 69e7025460f5826562c17136: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:52:25,725 - lava_callback - INFO - Received callback for node 69e7027b60f5826562c17144 INFO: 172.21.0.1:41212 - "POST /node/69e7027b60f5826562c17144 HTTP/1.0" 202 Accepted 2026-04-23 04:52:25,731 - lava_callback - INFO - Starting async job submit for node 69e7027b60f5826562c17144 2026-04-23 04:52:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,746 - lava_callback - DEBUG - Processing node 69e7027b60f5826562c17144: baseline-arm-clabbe 2026-04-23 04:52:25,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7027b60f5826562c17144 2026-04-23 04:52:25,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:52:25,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:52:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7027b60f5826562c17144 HTTP/1.1" 200 None 2026-04-23 04:52:25,794 - lava_callback - ERROR - Error processing callback for node 69e7027b60f5826562c17144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:53:05,739 - lava_callback - INFO - Received callback for node 69e702a060f5826562c17152 INFO: 172.21.0.1:59616 - "POST /node/69e702a060f5826562c17152 HTTP/1.0" 202 Accepted 2026-04-23 04:53:05,744 - lava_callback - INFO - Starting async job submit for node 69e702a060f5826562c17152 2026-04-23 04:53:05,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,765 - lava_callback - DEBUG - Processing node 69e702a060f5826562c17152: baseline-arm-clabbe 2026-04-23 04:53:05,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e702a060f5826562c17152 2026-04-23 04:53:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:53:05,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:05,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e702a060f5826562c17152 HTTP/1.1" 200 None 2026-04-23 04:53:05,839 - lava_callback - ERROR - Error processing callback for node 69e702a060f5826562c17152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:53:45,725 - lava_callback - INFO - Received callback for node 69e702cb60f5826562c1715f INFO: 172.21.0.1:46142 - "POST /node/69e702cb60f5826562c1715f HTTP/1.0" 202 Accepted 2026-04-23 04:53:45,730 - lava_callback - INFO - Starting async job submit for node 69e702cb60f5826562c1715f 2026-04-23 04:53:45,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,745 - lava_callback - DEBUG - Processing node 69e702cb60f5826562c1715f: baseline-arm-clabbe 2026-04-23 04:53:45,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e702cb60f5826562c1715f 2026-04-23 04:53:45,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:53:45,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:53:45,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e702cb60f5826562c1715f HTTP/1.1" 200 None 2026-04-23 04:53:45,799 - lava_callback - ERROR - Error processing callback for node 69e702cb60f5826562c1715f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:54:45,827 - lava_callback - INFO - Received callback for node 69e7030760f5826562c1716e INFO: 172.21.0.1:44922 - "POST /node/69e7030760f5826562c1716e HTTP/1.0" 202 Accepted 2026-04-23 04:54:45,833 - lava_callback - INFO - Starting async job submit for node 69e7030760f5826562c1716e 2026-04-23 04:54:45,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,847 - lava_callback - DEBUG - Processing node 69e7030760f5826562c1716e: baseline-arm-clabbe 2026-04-23 04:54:45,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7030760f5826562c1716e 2026-04-23 04:54:45,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:54:45,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:54:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7030760f5826562c1716e HTTP/1.1" 200 None 2026-04-23 04:54:45,904 - lava_callback - ERROR - Error processing callback for node 69e7030760f5826562c1716e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:55:25,819 - lava_callback - INFO - Received callback for node 69e7032b60f5826562c1717b INFO: 172.21.0.1:53102 - "POST /node/69e7032b60f5826562c1717b HTTP/1.0" 202 Accepted 2026-04-23 04:55:25,824 - lava_callback - INFO - Starting async job submit for node 69e7032b60f5826562c1717b 2026-04-23 04:55:25,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,839 - lava_callback - DEBUG - Processing node 69e7032b60f5826562c1717b: baseline-arm-clabbe 2026-04-23 04:55:25,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7032b60f5826562c1717b 2026-04-23 04:55:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:55:25,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:55:25,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7032b60f5826562c1717b HTTP/1.1" 200 None 2026-04-23 04:55:25,919 - lava_callback - ERROR - Error processing callback for node 69e7032b60f5826562c1717b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:56:05,879 - lava_callback - INFO - Received callback for node 69e7035560f5826562c17188 INFO: 172.21.0.1:53266 - "POST /node/69e7035560f5826562c17188 HTTP/1.0" 202 Accepted 2026-04-23 04:56:05,884 - lava_callback - INFO - Starting async job submit for node 69e7035560f5826562c17188 2026-04-23 04:56:05,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,911 - lava_callback - DEBUG - Processing node 69e7035560f5826562c17188: baseline-arm-clabbe 2026-04-23 04:56:05,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7035560f5826562c17188 2026-04-23 04:56:05,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:56:05,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7035560f5826562c17188 HTTP/1.1" 200 None 2026-04-23 04:56:05,989 - lava_callback - ERROR - Error processing callback for node 69e7035560f5826562c17188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:56:45,892 - lava_callback - INFO - Received callback for node 69e7037f60f5826562c17195 INFO: 172.21.0.1:45402 - "POST /node/69e7037f60f5826562c17195 HTTP/1.0" 202 Accepted 2026-04-23 04:56:45,897 - lava_callback - INFO - Starting async job submit for node 69e7037f60f5826562c17195 2026-04-23 04:56:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,913 - lava_callback - DEBUG - Processing node 69e7037f60f5826562c17195: baseline-arm-clabbe 2026-04-23 04:56:45,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7037f60f5826562c17195 2026-04-23 04:56:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:56:45,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:56:45,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7037f60f5826562c17195 HTTP/1.1" 200 None 2026-04-23 04:56:45,964 - lava_callback - ERROR - Error processing callback for node 69e7037f60f5826562c17195: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK 2026-04-23 04:58:46,031 - lava_callback - INFO - Received callback for node 69e703f860f5826562c171b9 INFO: 172.21.0.1:38314 - "POST /node/69e703f860f5826562c171b9 HTTP/1.0" 202 Accepted 2026-04-23 04:58:46,038 - lava_callback - INFO - Starting async job submit for node 69e703f860f5826562c171b9 2026-04-23 04:58:46,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,053 - lava_callback - DEBUG - Processing node 69e703f860f5826562c171b9: baseline-arm-clabbe 2026-04-23 04:58:46,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e703f860f5826562c171b9 2026-04-23 04:58:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 04:58:46,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 04:58:46,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e703f860f5826562c171b9 HTTP/1.1" 200 None 2026-04-23 04:58:46,112 - lava_callback - ERROR - Error processing callback for node 69e703f860f5826562c171b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:20:37,134 - lava_callback - INFO - Received callback for node 69e7091660f5826562c1727f INFO: 172.21.0.1:41052 - "POST /node/69e7091660f5826562c1727f HTTP/1.0" 202 Accepted 2026-04-23 05:20:37,139 - lava_callback - INFO - Starting async job submit for node 69e7091660f5826562c1727f 2026-04-23 05:20:37,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,163 - lava_callback - DEBUG - Processing node 69e7091660f5826562c1727f: baseline-arm64-baylibre 2026-04-23 05:20:37,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7091660f5826562c1727f 2026-04-23 05:20:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:20:37,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:20:37,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7091660f5826562c1727f HTTP/1.1" 200 None 2026-04-23 05:20:37,219 - lava_callback - ERROR - Error processing callback for node 69e7091660f5826562c1727f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:21:57,145 - lava_callback - INFO - Received callback for node 69e7096760f5826562c1729f INFO: 172.21.0.1:58068 - "POST /node/69e7096760f5826562c1729f HTTP/1.0" 202 Accepted 2026-04-23 05:21:57,150 - lava_callback - INFO - Starting async job submit for node 69e7096760f5826562c1729f 2026-04-23 05:21:57,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,172 - lava_callback - DEBUG - Processing node 69e7096760f5826562c1729f: baseline-arm64-baylibre 2026-04-23 05:21:57,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7096760f5826562c1729f 2026-04-23 05:21:57,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:21:57,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:21:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7096760f5826562c1729f HTTP/1.1" 200 None 2026-04-23 05:21:57,219 - lava_callback - ERROR - Error processing callback for node 69e7096760f5826562c1729f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:23:37,040 - lava_callback - INFO - Received callback for node 69e709ca60f5826562c172c5 INFO: 172.21.0.1:43186 - "POST /node/69e709ca60f5826562c172c5 HTTP/1.0" 202 Accepted 2026-04-23 05:23:37,047 - lava_callback - INFO - Starting async job submit for node 69e709ca60f5826562c172c5 2026-04-23 05:23:37,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,062 - lava_callback - DEBUG - Processing node 69e709ca60f5826562c172c5: baseline-arm64-baylibre 2026-04-23 05:23:37,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e709ca60f5826562c172c5 2026-04-23 05:23:37,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:23:37,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:23:37,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e709ca60f5826562c172c5 HTTP/1.1" 200 None 2026-04-23 05:23:37,110 - lava_callback - ERROR - Error processing callback for node 69e709ca60f5826562c172c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:24:57,124 - lava_callback - INFO - Received callback for node 69e70a1b60f5826562c172e3 INFO: 172.21.0.1:49334 - "POST /node/69e70a1b60f5826562c172e3 HTTP/1.0" 202 Accepted 2026-04-23 05:24:57,129 - lava_callback - INFO - Starting async job submit for node 69e70a1b60f5826562c172e3 2026-04-23 05:24:57,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,152 - lava_callback - DEBUG - Processing node 69e70a1b60f5826562c172e3: baseline-arm64-baylibre 2026-04-23 05:24:57,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70a1b60f5826562c172e3 2026-04-23 05:24:57,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:24:57,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:24:57,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70a1b60f5826562c172e3 HTTP/1.1" 200 None 2026-04-23 05:24:57,206 - lava_callback - ERROR - Error processing callback for node 69e70a1b60f5826562c172e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49924 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:26:37,217 - lava_callback - INFO - Received callback for node 69e70a8060f5826562c1730a INFO: 172.21.0.1:49938 - "POST /node/69e70a8060f5826562c1730a HTTP/1.0" 202 Accepted 2026-04-23 05:26:37,222 - lava_callback - INFO - Starting async job submit for node 69e70a8060f5826562c1730a 2026-04-23 05:26:37,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,237 - lava_callback - DEBUG - Processing node 69e70a8060f5826562c1730a: baseline-arm64-baylibre 2026-04-23 05:26:37,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70a8060f5826562c1730a 2026-04-23 05:26:37,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:26:37,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:26:37,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70a8060f5826562c1730a HTTP/1.1" 200 None 2026-04-23 05:26:37,287 - lava_callback - ERROR - Error processing callback for node 69e70a8060f5826562c1730a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:28:37,412 - lava_callback - INFO - Received callback for node 69e70af960f5826562c1732c INFO: 172.21.0.1:34016 - "POST /node/69e70af960f5826562c1732c HTTP/1.0" 202 Accepted 2026-04-23 05:28:37,417 - lava_callback - INFO - Starting async job submit for node 69e70af960f5826562c1732c 2026-04-23 05:28:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,432 - lava_callback - DEBUG - Processing node 69e70af960f5826562c1732c: baseline-arm64-baylibre 2026-04-23 05:28:37,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70af960f5826562c1732c 2026-04-23 05:28:37,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:28:37,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:28:37,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70af960f5826562c1732c HTTP/1.1" 200 None 2026-04-23 05:28:37,477 - lava_callback - ERROR - Error processing callback for node 69e70af960f5826562c1732c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:30:47,345 - lava_callback - INFO - Received callback for node 69e70b7860f5826562c17350 INFO: 172.21.0.1:35168 - "POST /node/69e70b7860f5826562c17350 HTTP/1.0" 202 Accepted 2026-04-23 05:30:47,350 - lava_callback - INFO - Starting async job submit for node 69e70b7860f5826562c17350 2026-04-23 05:30:47,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,366 - lava_callback - DEBUG - Processing node 69e70b7860f5826562c17350: baseline-arm64-clabbe 2026-04-23 05:30:47,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70b7860f5826562c17350 2026-04-23 05:30:47,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:30:47,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:30:47,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70b7860f5826562c17350 HTTP/1.1" 200 None 2026-04-23 05:30:47,411 - lava_callback - ERROR - Error processing callback for node 69e70b7860f5826562c17350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:32:07,440 - lava_callback - INFO - Received callback for node 69e70bca60f5826562c17376 INFO: 172.21.0.1:59570 - "POST /node/69e70bca60f5826562c17376 HTTP/1.0" 202 Accepted 2026-04-23 05:32:07,445 - lava_callback - INFO - Starting async job submit for node 69e70bca60f5826562c17376 2026-04-23 05:32:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,461 - lava_callback - DEBUG - Processing node 69e70bca60f5826562c17376: baseline-arm64-clabbe 2026-04-23 05:32:07,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70bca60f5826562c17376 2026-04-23 05:32:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:32:07,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:32:07,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70bca60f5826562c17376 HTTP/1.1" 200 None 2026-04-23 05:32:07,512 - lava_callback - ERROR - Error processing callback for node 69e70bca60f5826562c17376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:33:47,481 - lava_callback - INFO - Received callback for node 69e70c2c60f5826562c17395 INFO: 172.21.0.1:60658 - "POST /node/69e70c2c60f5826562c17395 HTTP/1.0" 202 Accepted 2026-04-23 05:33:47,487 - lava_callback - INFO - Starting async job submit for node 69e70c2c60f5826562c17395 2026-04-23 05:33:47,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,506 - lava_callback - DEBUG - Processing node 69e70c2c60f5826562c17395: baseline-arm64-clabbe 2026-04-23 05:33:47,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70c2c60f5826562c17395 2026-04-23 05:33:47,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:33:47,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:33:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70c2c60f5826562c17395 HTTP/1.1" 200 None 2026-04-23 05:33:47,553 - lava_callback - ERROR - Error processing callback for node 69e70c2c60f5826562c17395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:35:07,582 - lava_callback - INFO - Received callback for node 69e70c7d60f5826562c173bb INFO: 172.21.0.1:46238 - "POST /node/69e70c7d60f5826562c173bb HTTP/1.0" 202 Accepted 2026-04-23 05:35:07,587 - lava_callback - INFO - Starting async job submit for node 69e70c7d60f5826562c173bb 2026-04-23 05:35:07,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,609 - lava_callback - DEBUG - Processing node 69e70c7d60f5826562c173bb: baseline-arm64-clabbe 2026-04-23 05:35:07,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70c7d60f5826562c173bb 2026-04-23 05:35:07,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:35:07,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:35:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70c7d60f5826562c173bb HTTP/1.1" 200 None 2026-04-23 05:35:07,661 - lava_callback - ERROR - Error processing callback for node 69e70c7d60f5826562c173bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:36:27,574 - lava_callback - INFO - Received callback for node 69e70ccd60f5826562c173d8 INFO: 172.21.0.1:42778 - "POST /node/69e70ccd60f5826562c173d8 HTTP/1.0" 202 Accepted 2026-04-23 05:36:27,580 - lava_callback - INFO - Starting async job submit for node 69e70ccd60f5826562c173d8 2026-04-23 05:36:27,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,608 - lava_callback - DEBUG - Processing node 69e70ccd60f5826562c173d8: baseline-arm64-clabbe 2026-04-23 05:36:27,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70ccd60f5826562c173d8 2026-04-23 05:36:27,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:36:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:36:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70ccd60f5826562c173d8 HTTP/1.1" 200 None 2026-04-23 05:36:27,655 - lava_callback - ERROR - Error processing callback for node 69e70ccd60f5826562c173d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:37:47,671 - lava_callback - INFO - Received callback for node 69e70d1e60f5826562c173fc INFO: 172.21.0.1:49280 - "POST /node/69e70d1e60f5826562c173fc HTTP/1.0" 202 Accepted 2026-04-23 05:37:47,677 - lava_callback - INFO - Starting async job submit for node 69e70d1e60f5826562c173fc 2026-04-23 05:37:47,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,694 - lava_callback - DEBUG - Processing node 69e70d1e60f5826562c173fc: baseline-arm64-clabbe 2026-04-23 05:37:47,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70d1e60f5826562c173fc 2026-04-23 05:37:47,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:37:47,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:37:47,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70d1e60f5826562c173fc HTTP/1.1" 200 None 2026-04-23 05:37:47,746 - lava_callback - ERROR - Error processing callback for node 69e70d1e60f5826562c173fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:39:07,734 - lava_callback - INFO - Received callback for node 69e70d6e60f5826562c17422 INFO: 172.21.0.1:45536 - "POST /node/69e70d6e60f5826562c17422 HTTP/1.0" 202 Accepted 2026-04-23 05:39:07,740 - lava_callback - INFO - Starting async job submit for node 69e70d6e60f5826562c17422 2026-04-23 05:39:07,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,755 - lava_callback - DEBUG - Processing node 69e70d6e60f5826562c17422: baseline-arm64-clabbe 2026-04-23 05:39:07,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70d6e60f5826562c17422 2026-04-23 05:39:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-23 05:39:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:39:07,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70d6e60f5826562c17422 HTTP/1.1" 200 None 2026-04-23 05:39:07,808 - lava_callback - ERROR - Error processing callback for node 69e70d6e60f5826562c17422: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:46:18,455 - lava_callback - INFO - Received callback for node 69e70f2660f5826562c17449 INFO: 172.21.0.1:36196 - "POST /node/69e70f2660f5826562c17449 HTTP/1.0" 202 Accepted 2026-04-23 05:46:18,460 - lava_callback - INFO - Starting async job submit for node 69e70f2660f5826562c17449 2026-04-23 05:46:18,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,477 - lava_callback - DEBUG - Processing node 69e70f2660f5826562c17449: baseline-arm-baylibre 2026-04-23 05:46:18,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70f2660f5826562c17449 2026-04-23 05:46:18,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:46:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:46:18,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70f2660f5826562c17449 HTTP/1.1" 200 None 2026-04-23 05:46:18,532 - lava_callback - ERROR - Error processing callback for node 69e70f2660f5826562c17449: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:48:18,462 - lava_callback - INFO - Received callback for node 69e70f9e60f5826562c17459 INFO: 172.21.0.1:46798 - "POST /node/69e70f9e60f5826562c17459 HTTP/1.0" 202 Accepted 2026-04-23 05:48:18,467 - lava_callback - INFO - Starting async job submit for node 69e70f9e60f5826562c17459 2026-04-23 05:48:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,483 - lava_callback - DEBUG - Processing node 69e70f9e60f5826562c17459: baseline-arm-baylibre 2026-04-23 05:48:18,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e70f9e60f5826562c17459 2026-04-23 05:48:18,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:48:18,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:48:18,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e70f9e60f5826562c17459 HTTP/1.1" 200 None 2026-04-23 05:48:18,528 - lava_callback - ERROR - Error processing callback for node 69e70f9e60f5826562c17459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:50:18,522 - lava_callback - INFO - Received callback for node 69e7101660f5826562c17467 INFO: 172.21.0.1:32966 - "POST /node/69e7101660f5826562c17467 HTTP/1.0" 202 Accepted 2026-04-23 05:50:18,528 - lava_callback - INFO - Starting async job submit for node 69e7101660f5826562c17467 2026-04-23 05:50:18,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,542 - lava_callback - DEBUG - Processing node 69e7101660f5826562c17467: baseline-arm-baylibre 2026-04-23 05:50:18,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7101660f5826562c17467 2026-04-23 05:50:18,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:50:18,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:50:18,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7101660f5826562c17467 HTTP/1.1" 200 None 2026-04-23 05:50:18,602 - lava_callback - ERROR - Error processing callback for node 69e7101660f5826562c17467: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:51:18,567 - lava_callback - INFO - Received callback for node 69e7105460f5826562c17478 INFO: 172.21.0.1:49816 - "POST /node/69e7105460f5826562c17478 HTTP/1.0" 202 Accepted 2026-04-23 05:51:18,573 - lava_callback - INFO - Starting async job submit for node 69e7105460f5826562c17478 2026-04-23 05:51:18,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,593 - lava_callback - DEBUG - Processing node 69e7105460f5826562c17478: baseline-arm-baylibre 2026-04-23 05:51:18,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7105460f5826562c17478 2026-04-23 05:51:18,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:51:18,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:18,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7105460f5826562c17478 HTTP/1.1" 200 None 2026-04-23 05:51:18,660 - lava_callback - ERROR - Error processing callback for node 69e7105460f5826562c17478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:51:58,705 - lava_callback - INFO - Received callback for node 69e7107860f5826562c17485 INFO: 172.21.0.1:47774 - "POST /node/69e7107860f5826562c17485 HTTP/1.0" 202 Accepted 2026-04-23 05:51:58,713 - lava_callback - INFO - Starting async job submit for node 69e7107860f5826562c17485 2026-04-23 05:51:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,733 - lava_callback - DEBUG - Processing node 69e7107860f5826562c17485: baseline-arm-baylibre 2026-04-23 05:51:58,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7107860f5826562c17485 2026-04-23 05:51:58,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:51:58,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:51:58,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7107860f5826562c17485 HTTP/1.1" 200 None 2026-04-23 05:51:58,781 - lava_callback - ERROR - Error processing callback for node 69e7107860f5826562c17485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:54:28,396 - lava_callback - INFO - Received callback for node 69e7110b60f5826562c17491 INFO: 172.21.0.1:42172 - "POST /node/69e7110b60f5826562c17491 HTTP/1.0" 202 Accepted 2026-04-23 05:54:28,402 - lava_callback - INFO - Starting async job submit for node 69e7110b60f5826562c17491 2026-04-23 05:54:28,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,431 - lava_callback - DEBUG - Processing node 69e7110b60f5826562c17491: baseline-arm-clabbe 2026-04-23 05:54:28,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7110b60f5826562c17491 2026-04-23 05:54:28,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:54:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:54:28,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7110b60f5826562c17491 HTTP/1.1" 200 None 2026-04-23 05:54:28,497 - lava_callback - ERROR - Error processing callback for node 69e7110b60f5826562c17491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:55:28,458 - lava_callback - INFO - Received callback for node 69e7114760f5826562c1749f INFO: 172.21.0.1:54460 - "POST /node/69e7114760f5826562c1749f HTTP/1.0" 202 Accepted 2026-04-23 05:55:28,463 - lava_callback - INFO - Starting async job submit for node 69e7114760f5826562c1749f 2026-04-23 05:55:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,477 - lava_callback - DEBUG - Processing node 69e7114760f5826562c1749f: baseline-arm-clabbe 2026-04-23 05:55:28,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7114760f5826562c1749f 2026-04-23 05:55:28,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:55:28,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:55:28,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7114760f5826562c1749f HTTP/1.1" 200 None 2026-04-23 05:55:28,537 - lava_callback - ERROR - Error processing callback for node 69e7114760f5826562c1749f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:56:28,462 - lava_callback - INFO - Received callback for node 69e7118360f5826562c174b0 INFO: 172.21.0.1:41262 - "POST /node/69e7118360f5826562c174b0 HTTP/1.0" 202 Accepted 2026-04-23 05:56:28,468 - lava_callback - INFO - Starting async job submit for node 69e7118360f5826562c174b0 2026-04-23 05:56:28,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,484 - lava_callback - DEBUG - Processing node 69e7118360f5826562c174b0: baseline-arm-clabbe 2026-04-23 05:56:28,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7118360f5826562c174b0 2026-04-23 05:56:28,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:56:28,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:56:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7118360f5826562c174b0 HTTP/1.1" 200 None 2026-04-23 05:56:28,550 - lava_callback - ERROR - Error processing callback for node 69e7118360f5826562c174b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:57:08,439 - lava_callback - INFO - Received callback for node 69e711a860f5826562c174bd INFO: 172.21.0.1:46400 - "POST /node/69e711a860f5826562c174bd HTTP/1.0" 202 Accepted 2026-04-23 05:57:08,444 - lava_callback - INFO - Starting async job submit for node 69e711a860f5826562c174bd 2026-04-23 05:57:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,459 - lava_callback - DEBUG - Processing node 69e711a860f5826562c174bd: baseline-arm-clabbe 2026-04-23 05:57:08,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711a860f5826562c174bd 2026-04-23 05:57:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:57:08,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:08,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711a860f5826562c174bd HTTP/1.1" 200 None 2026-04-23 05:57:08,511 - lava_callback - ERROR - Error processing callback for node 69e711a860f5826562c174bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:57:48,676 - lava_callback - INFO - Received callback for node 69e711cd60f5826562c174cb INFO: 172.21.0.1:53054 - "POST /node/69e711cd60f5826562c174cb HTTP/1.0" 202 Accepted 2026-04-23 05:57:48,682 - lava_callback - INFO - Starting async job submit for node 69e711cd60f5826562c174cb 2026-04-23 05:57:48,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,701 - lava_callback - DEBUG - Processing node 69e711cd60f5826562c174cb: baseline-arm-clabbe 2026-04-23 05:57:48,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711cd60f5826562c174cb 2026-04-23 05:57:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:57:48,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:57:48,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711cd60f5826562c174cb HTTP/1.1" 200 None 2026-04-23 05:57:48,747 - lava_callback - ERROR - Error processing callback for node 69e711cd60f5826562c174cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:58:39,090 - lava_callback - INFO - Received callback for node 69e711fa60f5826562c174dc INFO: 172.21.0.1:37424 - "POST /node/69e711fa60f5826562c174dc HTTP/1.0" 202 Accepted 2026-04-23 05:58:39,096 - lava_callback - INFO - Starting async job submit for node 69e711fa60f5826562c174dc 2026-04-23 05:58:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,117 - lava_callback - DEBUG - Processing node 69e711fa60f5826562c174dc: baseline-arm64-baylibre 2026-04-23 05:58:39,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e711fa60f5826562c174dc 2026-04-23 05:58:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 05:58:39,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:58:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e711fa60f5826562c174dc HTTP/1.1" 200 None 2026-04-23 05:58:39,179 - lava_callback - ERROR - Error processing callback for node 69e711fa60f5826562c174dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK 2026-04-23 05:59:48,619 - lava_callback - INFO - Received callback for node 69e7124660f5826562c17502 INFO: 172.21.0.1:40134 - "POST /node/69e7124660f5826562c17502 HTTP/1.0" 202 Accepted 2026-04-23 05:59:48,624 - lava_callback - INFO - Starting async job submit for node 69e7124660f5826562c17502 2026-04-23 05:59:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,640 - lava_callback - DEBUG - Processing node 69e7124660f5826562c17502: baseline-arm-clabbe 2026-04-23 05:59:48,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7124660f5826562c17502 2026-04-23 05:59:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 05:59:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 05:59:48,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7124660f5826562c17502 HTTP/1.1" 200 None 2026-04-23 05:59:48,684 - lava_callback - ERROR - Error processing callback for node 69e7124660f5826562c17502: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:00:28,627 - lava_callback - INFO - Received callback for node 69e7126c60f5826562c17511 INFO: 172.21.0.1:49300 - "POST /node/69e7126c60f5826562c17511 HTTP/1.0" 202 Accepted 2026-04-23 06:00:28,633 - lava_callback - INFO - Starting async job submit for node 69e7126c60f5826562c17511 2026-04-23 06:00:28,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,648 - lava_callback - DEBUG - Processing node 69e7126c60f5826562c17511: baseline-arm-clabbe 2026-04-23 06:00:28,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7126c60f5826562c17511 2026-04-23 06:00:28,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:00:28,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:00:28,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7126c60f5826562c17511 HTTP/1.1" 200 None 2026-04-23 06:00:28,692 - lava_callback - ERROR - Error processing callback for node 69e7126c60f5826562c17511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:01:08,710 - lava_callback - INFO - Received callback for node 69e712a060f5826562c17520 INFO: 172.21.0.1:38816 - "POST /node/69e712a060f5826562c17520 HTTP/1.0" 202 Accepted 2026-04-23 06:01:08,715 - lava_callback - INFO - Starting async job submit for node 69e712a060f5826562c17520 2026-04-23 06:01:08,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,732 - lava_callback - DEBUG - Processing node 69e712a060f5826562c17520: baseline-arm64-clabbe 2026-04-23 06:01:08,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e712a060f5826562c17520 2026-04-23 06:01:08,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:01:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:01:08,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e712a060f5826562c17520 HTTP/1.1" 200 None 2026-04-23 06:01:08,788 - lava_callback - ERROR - Error processing callback for node 69e712a060f5826562c17520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:02:28,746 - lava_callback - INFO - Received callback for node 69e712e260f5826562c17540 INFO: 172.21.0.1:45256 - "POST /node/69e712e260f5826562c17540 HTTP/1.0" 202 Accepted 2026-04-23 06:02:28,752 - lava_callback - INFO - Starting async job submit for node 69e712e260f5826562c17540 2026-04-23 06:02:28,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,774 - lava_callback - DEBUG - Processing node 69e712e260f5826562c17540: baseline-arm-clabbe 2026-04-23 06:02:28,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e712e260f5826562c17540 2026-04-23 06:02:28,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:02:28,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:02:28,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e712e260f5826562c17540 HTTP/1.1" 200 None 2026-04-23 06:02:28,853 - lava_callback - ERROR - Error processing callback for node 69e712e260f5826562c17540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:03:08,728 - lava_callback - INFO - Received callback for node 69e7130860f5826562c1754d INFO: 172.21.0.1:43010 - "POST /node/69e7130860f5826562c1754d HTTP/1.0" 202 Accepted 2026-04-23 06:03:08,735 - lava_callback - INFO - Starting async job submit for node 69e7130860f5826562c1754d 2026-04-23 06:03:08,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,750 - lava_callback - DEBUG - Processing node 69e7130860f5826562c1754d: baseline-arm-clabbe 2026-04-23 06:03:08,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7130860f5826562c1754d 2026-04-23 06:03:08,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:03:08,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7130860f5826562c1754d HTTP/1.1" 200 None 2026-04-23 06:03:08,804 - lava_callback - ERROR - Error processing callback for node 69e7130860f5826562c1754d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:03:48,789 - lava_callback - INFO - Received callback for node 69e7133c60f5826562c17560 INFO: 172.21.0.1:59474 - "POST /node/69e7133c60f5826562c17560 HTTP/1.0" 202 Accepted 2026-04-23 06:03:48,795 - lava_callback - INFO - Starting async job submit for node 69e7133c60f5826562c17560 2026-04-23 06:03:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,821 - lava_callback - DEBUG - Processing node 69e7133c60f5826562c17560: baseline-arm64-clabbe 2026-04-23 06:03:48,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7133c60f5826562c17560 2026-04-23 06:03:48,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:03:48,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:03:48,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7133c60f5826562c17560 HTTP/1.1" 200 None 2026-04-23 06:03:48,866 - lava_callback - ERROR - Error processing callback for node 69e7133c60f5826562c17560: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:05:08,795 - lava_callback - INFO - Received callback for node 69e7137f60f5826562c1757e INFO: 172.21.0.1:57398 - "POST /node/69e7137f60f5826562c1757e HTTP/1.0" 202 Accepted 2026-04-23 06:05:08,800 - lava_callback - INFO - Starting async job submit for node 69e7137f60f5826562c1757e 2026-04-23 06:05:08,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,815 - lava_callback - DEBUG - Processing node 69e7137f60f5826562c1757e: baseline-arm-clabbe 2026-04-23 06:05:08,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7137f60f5826562c1757e 2026-04-23 06:05:08,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:05:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7137f60f5826562c1757e HTTP/1.1" 200 None 2026-04-23 06:05:08,865 - lava_callback - ERROR - Error processing callback for node 69e7137f60f5826562c1757e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:05:48,855 - lava_callback - INFO - Received callback for node 69e713b260f5826562c17592 INFO: 172.21.0.1:41652 - "POST /node/69e713b260f5826562c17592 HTTP/1.0" 202 Accepted 2026-04-23 06:05:48,860 - lava_callback - INFO - Starting async job submit for node 69e713b260f5826562c17592 2026-04-23 06:05:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,877 - lava_callback - DEBUG - Processing node 69e713b260f5826562c17592: baseline-arm64-clabbe 2026-04-23 06:05:48,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e713b260f5826562c17592 2026-04-23 06:05:48,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:05:48,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:05:48,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e713b260f5826562c17592 HTTP/1.1" 200 None 2026-04-23 06:05:48,935 - lava_callback - ERROR - Error processing callback for node 69e713b260f5826562c17592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:06:48,947 - lava_callback - INFO - Received callback for node 69e713f360f5826562c175b1 INFO: 172.21.0.1:49640 - "POST /node/69e713f360f5826562c175b1 HTTP/1.0" 202 Accepted 2026-04-23 06:06:48,953 - lava_callback - INFO - Starting async job submit for node 69e713f360f5826562c175b1 2026-04-23 06:06:48,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:48,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:48,979 - lava_callback - DEBUG - Processing node 69e713f360f5826562c175b1: baseline-arm-clabbe 2026-04-23 06:06:48,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e713f360f5826562c175b1 2026-04-23 06:06:48,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:48,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:06:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:06:49,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e713f360f5826562c175b1 HTTP/1.1" 200 None 2026-04-23 06:06:49,030 - lava_callback - ERROR - Error processing callback for node 69e713f360f5826562c175b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:07:48,992 - lava_callback - INFO - Received callback for node 69e7142660f5826562c175c3 INFO: 172.21.0.1:53156 - "POST /node/69e7142660f5826562c175c3 HTTP/1.0" 202 Accepted 2026-04-23 06:07:48,998 - lava_callback - INFO - Starting async job submit for node 69e7142660f5826562c175c3 2026-04-23 06:07:48,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,012 - lava_callback - DEBUG - Processing node 69e7142660f5826562c175c3: baseline-arm64-clabbe 2026-04-23 06:07:49,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7142660f5826562c175c3 2026-04-23 06:07:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:07:49,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:07:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7142660f5826562c175c3 HTTP/1.1" 200 None 2026-04-23 06:07:49,056 - lava_callback - ERROR - Error processing callback for node 69e7142660f5826562c175c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:08:49,058 - lava_callback - INFO - Received callback for node 69e7146960f5826562c175df INFO: 172.21.0.1:40538 - "POST /node/69e7146960f5826562c175df HTTP/1.0" 202 Accepted 2026-04-23 06:08:49,063 - lava_callback - INFO - Starting async job submit for node 69e7146960f5826562c175df 2026-04-23 06:08:49,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,087 - lava_callback - DEBUG - Processing node 69e7146960f5826562c175df: baseline-arm-clabbe 2026-04-23 06:08:49,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7146960f5826562c175df 2026-04-23 06:08:49,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:08:49,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:08:49,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7146960f5826562c175df HTTP/1.1" 200 None 2026-04-23 06:08:49,137 - lava_callback - ERROR - Error processing callback for node 69e7146960f5826562c175df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:09:29,017 - lava_callback - INFO - Received callback for node 69e7149060f5826562c175ee INFO: 172.21.0.1:38170 - "POST /node/69e7149060f5826562c175ee HTTP/1.0" 202 Accepted 2026-04-23 06:09:29,022 - lava_callback - INFO - Starting async job submit for node 69e7149060f5826562c175ee 2026-04-23 06:09:29,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,037 - lava_callback - DEBUG - Processing node 69e7149060f5826562c175ee: baseline-arm-clabbe 2026-04-23 06:09:29,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7149060f5826562c175ee 2026-04-23 06:09:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:09:29,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:09:29,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7149060f5826562c175ee HTTP/1.1" 200 None 2026-04-23 06:09:29,093 - lava_callback - ERROR - Error processing callback for node 69e7149060f5826562c175ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:10:29,076 - lava_callback - INFO - Received callback for node 69e714c360f5826562c175fa INFO: 172.21.0.1:38792 - "POST /node/69e714c360f5826562c175fa HTTP/1.0" 202 Accepted 2026-04-23 06:10:29,081 - lava_callback - INFO - Starting async job submit for node 69e714c360f5826562c175fa 2026-04-23 06:10:29,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,097 - lava_callback - DEBUG - Processing node 69e714c360f5826562c175fa: baseline-arm64-clabbe 2026-04-23 06:10:29,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e714c360f5826562c175fa 2026-04-23 06:10:29,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:10:29,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:10:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e714c360f5826562c175fa HTTP/1.1" 200 None 2026-04-23 06:10:29,153 - lava_callback - ERROR - Error processing callback for node 69e714c360f5826562c175fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:11:49,143 - lava_callback - INFO - Received callback for node 69e7151460f5826562c17620 INFO: 172.21.0.1:60640 - "POST /node/69e7151460f5826562c17620 HTTP/1.0" 202 Accepted 2026-04-23 06:11:49,148 - lava_callback - INFO - Starting async job submit for node 69e7151460f5826562c17620 2026-04-23 06:11:49,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,163 - lava_callback - DEBUG - Processing node 69e7151460f5826562c17620: baseline-arm64-clabbe 2026-04-23 06:11:49,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7151460f5826562c17620 2026-04-23 06:11:49,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:11:49,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:11:49,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7151460f5826562c17620 HTTP/1.1" 200 None 2026-04-23 06:11:49,221 - lava_callback - ERROR - Error processing callback for node 69e7151460f5826562c17620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:12:49,228 - lava_callback - INFO - Received callback for node 69e7155560f5826562c1763c INFO: 172.21.0.1:53230 - "POST /node/69e7155560f5826562c1763c HTTP/1.0" 202 Accepted 2026-04-23 06:12:49,233 - lava_callback - INFO - Starting async job submit for node 69e7155560f5826562c1763c 2026-04-23 06:12:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,249 - lava_callback - DEBUG - Processing node 69e7155560f5826562c1763c: baseline-arm-clabbe 2026-04-23 06:12:49,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7155560f5826562c1763c 2026-04-23 06:12:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:12:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:12:49,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7155560f5826562c1763c HTTP/1.1" 200 None 2026-04-23 06:12:49,302 - lava_callback - ERROR - Error processing callback for node 69e7155560f5826562c1763c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:13:49,256 - lava_callback - INFO - Received callback for node 69e7158960f5826562c1764f INFO: 172.21.0.1:53170 - "POST /node/69e7158960f5826562c1764f HTTP/1.0" 202 Accepted 2026-04-23 06:13:49,261 - lava_callback - INFO - Starting async job submit for node 69e7158960f5826562c1764f 2026-04-23 06:13:49,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,277 - lava_callback - DEBUG - Processing node 69e7158960f5826562c1764f: baseline-arm64-clabbe 2026-04-23 06:13:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7158960f5826562c1764f 2026-04-23 06:13:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-23 06:13:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:13:49,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7158960f5826562c1764f HTTP/1.1" 200 None 2026-04-23 06:13:49,330 - lava_callback - ERROR - Error processing callback for node 69e7158960f5826562c1764f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:14:49,257 - lava_callback - INFO - Received callback for node 69e715cb60f5826562c17667 INFO: 172.21.0.1:39030 - "POST /node/69e715cb60f5826562c17667 HTTP/1.0" 202 Accepted 2026-04-23 06:14:49,262 - lava_callback - INFO - Starting async job submit for node 69e715cb60f5826562c17667 2026-04-23 06:14:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,276 - lava_callback - DEBUG - Processing node 69e715cb60f5826562c17667: baseline-arm-clabbe 2026-04-23 06:14:49,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e715cb60f5826562c17667 2026-04-23 06:14:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:14:49,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:14:49,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e715cb60f5826562c17667 HTTP/1.1" 200 None 2026-04-23 06:14:49,327 - lava_callback - ERROR - Error processing callback for node 69e715cb60f5826562c17667: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:15:29,240 - lava_callback - INFO - Received callback for node 69e715f060f5826562c17672 INFO: 172.21.0.1:40874 - "POST /node/69e715f060f5826562c17672 HTTP/1.0" 202 Accepted 2026-04-23 06:15:29,245 - lava_callback - INFO - Starting async job submit for node 69e715f060f5826562c17672 2026-04-23 06:15:29,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,305 - lava_callback - DEBUG - Processing node 69e715f060f5826562c17672: baseline-arm-clabbe 2026-04-23 06:15:29,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e715f060f5826562c17672 2026-04-23 06:15:29,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:15:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:15:29,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e715f060f5826562c17672 HTTP/1.1" 200 None 2026-04-23 06:15:29,424 - lava_callback - ERROR - Error processing callback for node 69e715f060f5826562c17672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:16:09,345 - lava_callback - INFO - Received callback for node 69e7161560f5826562c1767d INFO: 172.21.0.1:33934 - "POST /node/69e7161560f5826562c1767d HTTP/1.0" 202 Accepted 2026-04-23 06:16:09,351 - lava_callback - INFO - Starting async job submit for node 69e7161560f5826562c1767d 2026-04-23 06:16:09,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,367 - lava_callback - DEBUG - Processing node 69e7161560f5826562c1767d: baseline-arm-clabbe 2026-04-23 06:16:09,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7161560f5826562c1767d 2026-04-23 06:16:09,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 06:16:09,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:16:09,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7161560f5826562c1767d HTTP/1.1" 200 None 2026-04-23 06:16:09,415 - lava_callback - ERROR - Error processing callback for node 69e7161560f5826562c1767d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:29:09,945 - lava_callback - INFO - Received callback for node 69e7192a60f5826562c176d1 INFO: 172.21.0.1:53346 - "POST /node/69e7192a60f5826562c176d1 HTTP/1.0" 202 Accepted 2026-04-23 06:29:09,951 - lava_callback - INFO - Starting async job submit for node 69e7192a60f5826562c176d1 2026-04-23 06:29:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:09,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:09,966 - lava_callback - DEBUG - Processing node 69e7192a60f5826562c176d1: baseline-arm-clabbe 2026-04-23 06:29:09,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7192a60f5826562c176d1 2026-04-23 06:29:09,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:09,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:09,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:10,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:29:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:10,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7192a60f5826562c176d1 HTTP/1.1" 200 None 2026-04-23 06:29:10,035 - lava_callback - ERROR - Error processing callback for node 69e7192a60f5826562c176d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:29:49,916 - lava_callback - INFO - Received callback for node 69e7194f60f5826562c176df INFO: 172.21.0.1:53778 - "POST /node/69e7194f60f5826562c176df HTTP/1.0" 202 Accepted 2026-04-23 06:29:49,921 - lava_callback - INFO - Starting async job submit for node 69e7194f60f5826562c176df 2026-04-23 06:29:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,937 - lava_callback - DEBUG - Processing node 69e7194f60f5826562c176df: baseline-arm-clabbe 2026-04-23 06:29:49,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7194f60f5826562c176df 2026-04-23 06:29:49,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:29:49,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:29:49,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7194f60f5826562c176df HTTP/1.1" 200 None 2026-04-23 06:29:49,986 - lava_callback - ERROR - Error processing callback for node 69e7194f60f5826562c176df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:30:29,989 - lava_callback - INFO - Received callback for node 69e7197560f5826562c176ed INFO: 172.21.0.1:45688 - "POST /node/69e7197560f5826562c176ed HTTP/1.0" 202 Accepted 2026-04-23 06:30:29,995 - lava_callback - INFO - Starting async job submit for node 69e7197560f5826562c176ed 2026-04-23 06:30:29,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,013 - lava_callback - DEBUG - Processing node 69e7197560f5826562c176ed: baseline-arm-clabbe 2026-04-23 06:30:30,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7197560f5826562c176ed 2026-04-23 06:30:30,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:30:30,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:30:30,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7197560f5826562c176ed HTTP/1.1" 200 None 2026-04-23 06:30:30,073 - lava_callback - ERROR - Error processing callback for node 69e7197560f5826562c176ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:31:09,983 - lava_callback - INFO - Received callback for node 69e7199a60f5826562c176fc INFO: 172.21.0.1:43838 - "POST /node/69e7199a60f5826562c176fc HTTP/1.0" 202 Accepted 2026-04-23 06:31:09,988 - lava_callback - INFO - Starting async job submit for node 69e7199a60f5826562c176fc 2026-04-23 06:31:09,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,005 - lava_callback - DEBUG - Processing node 69e7199a60f5826562c176fc: baseline-arm-clabbe 2026-04-23 06:31:10,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7199a60f5826562c176fc 2026-04-23 06:31:10,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:31:10,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:10,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7199a60f5826562c176fc HTTP/1.1" 200 None 2026-04-23 06:31:10,052 - lava_callback - ERROR - Error processing callback for node 69e7199a60f5826562c176fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:31:50,041 - lava_callback - INFO - Received callback for node 69e719c160f5826562c1770e INFO: 172.21.0.1:46960 - "POST /node/69e719c160f5826562c1770e HTTP/1.0" 202 Accepted 2026-04-23 06:31:50,046 - lava_callback - INFO - Starting async job submit for node 69e719c160f5826562c1770e 2026-04-23 06:31:50,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,067 - lava_callback - DEBUG - Processing node 69e719c160f5826562c1770e: baseline-arm-clabbe 2026-04-23 06:31:50,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e719c160f5826562c1770e 2026-04-23 06:31:50,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:31:50,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:31:50,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e719c160f5826562c1770e HTTP/1.1" 200 None 2026-04-23 06:31:50,113 - lava_callback - ERROR - Error processing callback for node 69e719c160f5826562c1770e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:32:09,990 - lava_callback - INFO - Received callback for node 69e719e760f5826562c17719 INFO: 172.21.0.1:36140 - "POST /node/69e719e760f5826562c17719 HTTP/1.0" 202 Accepted 2026-04-23 06:32:09,996 - lava_callback - INFO - Starting async job submit for node 69e719e760f5826562c17719 2026-04-23 06:32:09,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,011 - lava_callback - DEBUG - Processing node 69e719e760f5826562c17719: baseline-arm-clabbe 2026-04-23 06:32:10,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e719e760f5826562c17719 2026-04-23 06:32:10,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:32:10,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e719e760f5826562c17719 HTTP/1.1" 200 None 2026-04-23 06:32:10,073 - lava_callback - ERROR - Error processing callback for node 69e719e760f5826562c17719: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:32:50,101 - lava_callback - INFO - Received callback for node 69e71a0d60f5826562c1772e INFO: 172.21.0.1:44356 - "POST /node/69e71a0d60f5826562c1772e HTTP/1.0" 202 Accepted 2026-04-23 06:32:50,106 - lava_callback - INFO - Starting async job submit for node 69e71a0d60f5826562c1772e 2026-04-23 06:32:50,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,121 - lava_callback - DEBUG - Processing node 69e71a0d60f5826562c1772e: baseline-arm-clabbe 2026-04-23 06:32:50,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a0d60f5826562c1772e 2026-04-23 06:32:50,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:32:50,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:32:50,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a0d60f5826562c1772e HTTP/1.1" 200 None 2026-04-23 06:32:50,171 - lava_callback - ERROR - Error processing callback for node 69e71a0d60f5826562c1772e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:34:41,037 - lava_callback - INFO - Received callback for node 69e71a7560f5826562c1778c INFO: 172.21.0.1:59800 - "POST /node/69e71a7560f5826562c1778c HTTP/1.0" 202 Accepted 2026-04-23 06:34:41,043 - lava_callback - INFO - Starting async job submit for node 69e71a7560f5826562c1778c 2026-04-23 06:34:41,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,067 - lava_callback - DEBUG - Processing node 69e71a7560f5826562c1778c: baseline-arm-baylibre 2026-04-23 06:34:41,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a7560f5826562c1778c 2026-04-23 06:34:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:34:41,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:34:41,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a7560f5826562c1778c HTTP/1.1" 200 None 2026-04-23 06:34:41,144 - lava_callback - ERROR - Error processing callback for node 69e71a7560f5826562c1778c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:35:20,990 - lava_callback - INFO - Received callback for node 69e71a9960f5826562c17798 INFO: 172.21.0.1:53460 - "POST /node/69e71a9960f5826562c17798 HTTP/1.0" 202 Accepted 2026-04-23 06:35:20,995 - lava_callback - INFO - Starting async job submit for node 69e71a9960f5826562c17798 2026-04-23 06:35:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,010 - lava_callback - DEBUG - Processing node 69e71a9960f5826562c17798: baseline-arm-baylibre 2026-04-23 06:35:21,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71a9960f5826562c17798 2026-04-23 06:35:21,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:35:21,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:35:21,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71a9960f5826562c17798 HTTP/1.1" 200 None 2026-04-23 06:35:21,077 - lava_callback - ERROR - Error processing callback for node 69e71a9960f5826562c17798: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:36:01,145 - lava_callback - INFO - Received callback for node 69e71abe60f5826562c177a7 INFO: 172.21.0.1:40518 - "POST /node/69e71abe60f5826562c177a7 HTTP/1.0" 202 Accepted 2026-04-23 06:36:01,150 - lava_callback - INFO - Starting async job submit for node 69e71abe60f5826562c177a7 2026-04-23 06:36:01,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,167 - lava_callback - DEBUG - Processing node 69e71abe60f5826562c177a7: baseline-arm-baylibre 2026-04-23 06:36:01,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71abe60f5826562c177a7 2026-04-23 06:36:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:36:01,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:01,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71abe60f5826562c177a7 HTTP/1.1" 200 None 2026-04-23 06:36:01,218 - lava_callback - ERROR - Error processing callback for node 69e71abe60f5826562c177a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:36:30,209 - lava_callback - INFO - Received callback for node 69e71ae760f5826562c177b4 INFO: 172.21.0.1:55788 - "POST /node/69e71ae760f5826562c177b4 HTTP/1.0" 202 Accepted 2026-04-23 06:36:30,214 - lava_callback - INFO - Starting async job submit for node 69e71ae760f5826562c177b4 2026-04-23 06:36:30,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,230 - lava_callback - DEBUG - Processing node 69e71ae760f5826562c177b4: baseline-arm-clabbe 2026-04-23 06:36:30,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ae760f5826562c177b4 2026-04-23 06:36:30,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:36:30,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:36:30,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ae760f5826562c177b4 HTTP/1.1" 200 None 2026-04-23 06:36:30,287 - lava_callback - ERROR - Error processing callback for node 69e71ae760f5826562c177b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:37:01,099 - lava_callback - INFO - Received callback for node 69e71b0860f5826562c177c1 INFO: 172.21.0.1:43806 - "POST /node/69e71b0860f5826562c177c1 HTTP/1.0" 202 Accepted 2026-04-23 06:37:01,104 - lava_callback - INFO - Starting async job submit for node 69e71b0860f5826562c177c1 2026-04-23 06:37:01,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,120 - lava_callback - DEBUG - Processing node 69e71b0860f5826562c177c1: baseline-arm-baylibre 2026-04-23 06:37:01,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b0860f5826562c177c1 2026-04-23 06:37:01,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:37:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:01,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b0860f5826562c177c1 HTTP/1.1" 200 None 2026-04-23 06:37:01,167 - lava_callback - ERROR - Error processing callback for node 69e71b0860f5826562c177c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:37:41,235 - lava_callback - INFO - Received callback for node 69e71b2e60f5826562c177ca INFO: 172.21.0.1:39584 - "POST /node/69e71b2e60f5826562c177ca HTTP/1.0" 202 Accepted 2026-04-23 06:37:41,241 - lava_callback - INFO - Starting async job submit for node 69e71b2e60f5826562c177ca 2026-04-23 06:37:41,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,278 - lava_callback - DEBUG - Processing node 69e71b2e60f5826562c177ca: baseline-arm-baylibre 2026-04-23 06:37:41,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b2e60f5826562c177ca 2026-04-23 06:37:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:37:41,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:37:41,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b2e60f5826562c177ca HTTP/1.1" 200 None 2026-04-23 06:37:41,352 - lava_callback - ERROR - Error processing callback for node 69e71b2e60f5826562c177ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:38:21,180 - lava_callback - INFO - Received callback for node 69e71b5260f5826562c177d5 INFO: 172.21.0.1:56592 - "POST /node/69e71b5260f5826562c177d5 HTTP/1.0" 202 Accepted 2026-04-23 06:38:21,185 - lava_callback - INFO - Starting async job submit for node 69e71b5260f5826562c177d5 2026-04-23 06:38:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,201 - lava_callback - DEBUG - Processing node 69e71b5260f5826562c177d5: baseline-arm-baylibre 2026-04-23 06:38:21,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71b5260f5826562c177d5 2026-04-23 06:38:21,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:38:21,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:38:21,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71b5260f5826562c177d5 HTTP/1.1" 200 None 2026-04-23 06:38:21,246 - lava_callback - ERROR - Error processing callback for node 69e71b5260f5826562c177d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:39:24,892 - lava_callback - INFO - Received callback for node 69e904bd8327522856daf238 INFO: 172.21.0.1:40342 - "POST /node/69e904bd8327522856daf238 HTTP/1.0" 202 Accepted 2026-04-23 06:39:24,897 - lava_callback - INFO - Starting async job submit for node 69e904bd8327522856daf238 2026-04-23 06:39:24,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:24,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:24,939 - lava_callback - DEBUG - Processing node 69e904bd8327522856daf238: baseline-arm64-broonie 2026-04-23 06:39:25,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/log.txt.gz 2026-04-23 06:39:25,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/lava-logs.yaml 2026-04-23 06:39:25,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:39:25,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:39:25,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904bd8327522856daf238/lava_callback.json.gz 2026-04-23 06:39:25,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:25,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:39:25,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:25,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904bd8327522856daf238 HTTP/1.1" 200 None 2026-04-23 06:39:25,791 - lava_callback - INFO - Completed processing callback for node 69e904bd8327522856daf238 2026-04-23 06:39:26,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:39:26,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:10,361 - lava_callback - INFO - Received callback for node 69e71bc160f5826562c177fd INFO: 172.21.0.1:43816 - "POST /node/69e71bc160f5826562c177fd HTTP/1.0" 202 Accepted 2026-04-23 06:40:10,367 - lava_callback - INFO - Starting async job submit for node 69e71bc160f5826562c177fd 2026-04-23 06:40:10,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,381 - lava_callback - DEBUG - Processing node 69e71bc160f5826562c177fd: baseline-arm-clabbe 2026-04-23 06:40:10,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71bc160f5826562c177fd 2026-04-23 06:40:10,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:40:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:10,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71bc160f5826562c177fd HTTP/1.1" 200 None 2026-04-23 06:40:10,427 - lava_callback - ERROR - Error processing callback for node 69e71bc160f5826562c177fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:24,592 - lava_callback - INFO - Received callback for node 69e95df48327522856db19be INFO: 172.21.0.1:34248 - "POST /node/69e95df48327522856db19be HTTP/1.0" 202 Accepted 2026-04-23 06:40:24,598 - lava_callback - INFO - Starting async job submit for node 69e95df48327522856db19be 2026-04-23 06:40:24,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:24,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:24,636 - lava_callback - DEBUG - Processing node 69e95df48327522856db19be: baseline-arm64-broonie 2026-04-23 06:40:24,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:24,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:24,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/log.txt.gz 2026-04-23 06:40:25,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:25,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:25,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/lava-logs.yaml 2026-04-23 06:40:25,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:40:25,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:40:25,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e95df48327522856db19be/lava_callback.json.gz 2026-04-23 06:40:25,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:40:25,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:25,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e95df48327522856db19be HTTP/1.1" 200 None 2026-04-23 06:40:25,466 - lava_callback - INFO - Completed processing callback for node 69e95df48327522856db19be 2026-04-23 06:40:26,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:26,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:40:50,367 - lava_callback - INFO - Received callback for node 69e71be760f5826562c17809 INFO: 172.21.0.1:54480 - "POST /node/69e71be760f5826562c17809 HTTP/1.0" 202 Accepted 2026-04-23 06:40:50,372 - lava_callback - INFO - Starting async job submit for node 69e71be760f5826562c17809 2026-04-23 06:40:50,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,393 - lava_callback - DEBUG - Processing node 69e71be760f5826562c17809: baseline-arm-clabbe 2026-04-23 06:40:50,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71be760f5826562c17809 2026-04-23 06:40:50,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:40:50,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:40:50,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71be760f5826562c17809 HTTP/1.1" 200 None 2026-04-23 06:40:50,469 - lava_callback - ERROR - Error processing callback for node 69e71be760f5826562c17809: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:04,453 - lava_callback - INFO - Received callback for node 69e985a78137cb226ce20275 INFO: 172.21.0.1:46578 - "POST /node/69e985a78137cb226ce20275 HTTP/1.0" 202 Accepted 2026-04-23 06:41:04,459 - lava_callback - INFO - Starting async job submit for node 69e985a78137cb226ce20275 2026-04-23 06:41:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:04,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:04,496 - lava_callback - DEBUG - Processing node 69e985a78137cb226ce20275: baseline-arm64-broonie 2026-04-23 06:41:04,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:04,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:04,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/log.txt.gz 2026-04-23 06:41:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:05,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:05,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/lava-logs.yaml 2026-04-23 06:41:05,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:05,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:05,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e985a78137cb226ce20275/lava_callback.json.gz 2026-04-23 06:41:05,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:05,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9650e8137cb226ce1ca7a HTTP/1.1" 200 None 2026-04-23 06:41:05,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:05,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e985a78137cb226ce20275 HTTP/1.1" 200 None 2026-04-23 06:41:05,395 - lava_callback - INFO - Completed processing callback for node 69e985a78137cb226ce20275 INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:26,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:26,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:30,411 - lava_callback - INFO - Received callback for node 69e71c0d60f5826562c17819 INFO: 172.21.0.1:50452 - "POST /node/69e71c0d60f5826562c17819 HTTP/1.0" 202 Accepted 2026-04-23 06:41:30,416 - lava_callback - INFO - Starting async job submit for node 69e71c0d60f5826562c17819 2026-04-23 06:41:30,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,439 - lava_callback - DEBUG - Processing node 69e71c0d60f5826562c17819: baseline-arm-clabbe 2026-04-23 06:41:30,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c0d60f5826562c17819 2026-04-23 06:41:30,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:41:30,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:30,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c0d60f5826562c17819 HTTP/1.1" 200 None 2026-04-23 06:41:30,495 - lava_callback - ERROR - Error processing callback for node 69e71c0d60f5826562c17819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:44,887 - lava_callback - INFO - Received callback for node 69e9b2a08137cb226ce21734 INFO: 172.21.0.1:51032 - "POST /node/69e9b2a08137cb226ce21734 HTTP/1.0" 202 Accepted 2026-04-23 06:41:44,892 - lava_callback - INFO - Starting async job submit for node 69e9b2a08137cb226ce21734 2026-04-23 06:41:44,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:44,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:44,946 - lava_callback - DEBUG - Processing node 69e9b2a08137cb226ce21734: baseline-arm64-broonie 2026-04-23 06:41:45,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/log.txt.gz 2026-04-23 06:41:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,731 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/lava-logs.yaml 2026-04-23 06:41:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-23 06:41:45,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-23 06:41:45,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e9b2a08137cb226ce21734/lava_callback.json.gz 2026-04-23 06:41:45,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:45,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-23 06:41:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:41:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9b2a08137cb226ce21734 HTTP/1.1" 200 None 2026-04-23 06:41:45,984 - lava_callback - INFO - Completed processing callback for node 69e9b2a08137cb226ce21734 INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:56,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:41:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:42:10,420 - lava_callback - INFO - Received callback for node 69e71c3260f5826562c17826 INFO: 172.21.0.1:40356 - "POST /node/69e71c3260f5826562c17826 HTTP/1.0" 202 Accepted 2026-04-23 06:42:10,425 - lava_callback - INFO - Starting async job submit for node 69e71c3260f5826562c17826 2026-04-23 06:42:10,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,440 - lava_callback - DEBUG - Processing node 69e71c3260f5826562c17826: baseline-arm-clabbe 2026-04-23 06:42:10,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c3260f5826562c17826 2026-04-23 06:42:10,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:42:10,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:10,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c3260f5826562c17826 HTTP/1.1" 200 None 2026-04-23 06:42:10,491 - lava_callback - ERROR - Error processing callback for node 69e71c3260f5826562c17826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:42:50,479 - lava_callback - INFO - Received callback for node 69e71c5860f5826562c17831 INFO: 172.21.0.1:45590 - "POST /node/69e71c5860f5826562c17831 HTTP/1.0" 202 Accepted 2026-04-23 06:42:50,485 - lava_callback - INFO - Starting async job submit for node 69e71c5860f5826562c17831 2026-04-23 06:42:50,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,504 - lava_callback - DEBUG - Processing node 69e71c5860f5826562c17831: baseline-arm-clabbe 2026-04-23 06:42:50,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c5860f5826562c17831 2026-04-23 06:42:50,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:42:50,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:42:50,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c5860f5826562c17831 HTTP/1.1" 200 None 2026-04-23 06:42:50,552 - lava_callback - ERROR - Error processing callback for node 69e71c5860f5826562c17831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:43:30,547 - lava_callback - INFO - Received callback for node 69e71c7f60f5826562c1783e INFO: 172.21.0.1:46314 - "POST /node/69e71c7f60f5826562c1783e HTTP/1.0" 202 Accepted 2026-04-23 06:43:30,552 - lava_callback - INFO - Starting async job submit for node 69e71c7f60f5826562c1783e 2026-04-23 06:43:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,572 - lava_callback - DEBUG - Processing node 69e71c7f60f5826562c1783e: baseline-arm-clabbe 2026-04-23 06:43:30,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71c7f60f5826562c1783e 2026-04-23 06:43:30,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:43:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:43:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71c7f60f5826562c1783e HTTP/1.1" 200 None 2026-04-23 06:43:30,620 - lava_callback - ERROR - Error processing callback for node 69e71c7f60f5826562c1783e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:44:10,555 - lava_callback - INFO - Received callback for node 69e71ca660f5826562c1784e INFO: 172.21.0.1:51342 - "POST /node/69e71ca660f5826562c1784e HTTP/1.0" 202 Accepted 2026-04-23 06:44:10,561 - lava_callback - INFO - Starting async job submit for node 69e71ca660f5826562c1784e 2026-04-23 06:44:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,576 - lava_callback - DEBUG - Processing node 69e71ca660f5826562c1784e: baseline-arm-clabbe 2026-04-23 06:44:10,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ca660f5826562c1784e 2026-04-23 06:44:10,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:44:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:10,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ca660f5826562c1784e HTTP/1.1" 200 None 2026-04-23 06:44:10,632 - lava_callback - ERROR - Error processing callback for node 69e71ca660f5826562c1784e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:44:50,534 - lava_callback - INFO - Received callback for node 69e71ccc60f5826562c1785b INFO: 172.21.0.1:42458 - "POST /node/69e71ccc60f5826562c1785b HTTP/1.0" 202 Accepted 2026-04-23 06:44:50,540 - lava_callback - INFO - Starting async job submit for node 69e71ccc60f5826562c1785b 2026-04-23 06:44:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,555 - lava_callback - DEBUG - Processing node 69e71ccc60f5826562c1785b: baseline-arm-clabbe 2026-04-23 06:44:50,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71ccc60f5826562c1785b 2026-04-23 06:44:50,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:44:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:44:50,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71ccc60f5826562c1785b HTTP/1.1" 200 None 2026-04-23 06:44:50,614 - lava_callback - ERROR - Error processing callback for node 69e71ccc60f5826562c1785b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:45:10,534 - lava_callback - INFO - Received callback for node 69e71cf160f5826562c17864 INFO: 172.21.0.1:37930 - "POST /node/69e71cf160f5826562c17864 HTTP/1.0" 202 Accepted 2026-04-23 06:45:10,539 - lava_callback - INFO - Starting async job submit for node 69e71cf160f5826562c17864 2026-04-23 06:45:10,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,556 - lava_callback - DEBUG - Processing node 69e71cf160f5826562c17864: baseline-arm-clabbe 2026-04-23 06:45:10,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71cf160f5826562c17864 2026-04-23 06:45:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c20d60f5826562c1508b HTTP/1.1" 200 None 2026-04-23 06:45:10,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:10,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71cf160f5826562c17864 HTTP/1.1" 200 None 2026-04-23 06:45:10,615 - lava_callback - ERROR - Error processing callback for node 69e71cf160f5826562c17864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK 2026-04-23 06:45:50,572 - lava_callback - INFO - Received callback for node 69e71d1660f5826562c17870 INFO: 172.21.0.1:34806 - "POST /node/69e71d1660f5826562c17870 HTTP/1.0" 202 Accepted 2026-04-23 06:45:50,578 - lava_callback - INFO - Starting async job submit for node 69e71d1660f5826562c17870 2026-04-23 06:45:50,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,617 - lava_callback - DEBUG - Processing node 69e71d1660f5826562c17870: baseline-arm-clabbe 2026-04-23 06:45:50,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e71d1660f5826562c17870 2026-04-23 06:45:50,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-23 06:45:50,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 06:45:50,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e71d1660f5826562c17870 HTTP/1.1" 200 None 2026-04-23 06:45:50,664 - lava_callback - ERROR - Error processing callback for node 69e71d1660f5826562c17870: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:04:02,654 - lava_callback - INFO - Received callback for node 69e7215560f5826562c17a32 INFO: 172.21.0.1:52958 - "POST /node/69e7215560f5826562c17a32 HTTP/1.0" 202 Accepted 2026-04-23 07:04:02,659 - lava_callback - INFO - Starting async job submit for node 69e7215560f5826562c17a32 2026-04-23 07:04:02,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,674 - lava_callback - DEBUG - Processing node 69e7215560f5826562c17a32: baseline-arm64-baylibre 2026-04-23 07:04:02,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7215560f5826562c17a32 2026-04-23 07:04:02,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:04:02,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:04:02,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7215560f5826562c17a32 HTTP/1.1" 200 None 2026-04-23 07:04:02,730 - lava_callback - ERROR - Error processing callback for node 69e7215560f5826562c17a32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:05:22,690 - lava_callback - INFO - Received callback for node 69e721a660f5826562c17a58 INFO: 172.21.0.1:54640 - "POST /node/69e721a660f5826562c17a58 HTTP/1.0" 202 Accepted 2026-04-23 07:05:22,695 - lava_callback - INFO - Starting async job submit for node 69e721a660f5826562c17a58 2026-04-23 07:05:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,712 - lava_callback - DEBUG - Processing node 69e721a660f5826562c17a58: baseline-arm64-baylibre 2026-04-23 07:05:22,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e721a660f5826562c17a58 2026-04-23 07:05:22,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:05:22,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:05:22,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e721a660f5826562c17a58 HTTP/1.1" 200 None 2026-04-23 07:05:22,757 - lava_callback - ERROR - Error processing callback for node 69e721a660f5826562c17a58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:06:42,677 - lava_callback - INFO - Received callback for node 69e721f560f5826562c17a7f INFO: 172.21.0.1:33890 - "POST /node/69e721f560f5826562c17a7f HTTP/1.0" 202 Accepted 2026-04-23 07:06:42,683 - lava_callback - INFO - Starting async job submit for node 69e721f560f5826562c17a7f 2026-04-23 07:06:42,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,698 - lava_callback - DEBUG - Processing node 69e721f560f5826562c17a7f: baseline-arm64-baylibre 2026-04-23 07:06:42,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e721f560f5826562c17a7f 2026-04-23 07:06:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:06:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:06:42,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e721f560f5826562c17a7f HTTP/1.1" 200 None 2026-04-23 07:06:42,751 - lava_callback - ERROR - Error processing callback for node 69e721f560f5826562c17a7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:08:02,864 - lava_callback - INFO - Received callback for node 69e7224860f5826562c17aa2 INFO: 172.21.0.1:39766 - "POST /node/69e7224860f5826562c17aa2 HTTP/1.0" 202 Accepted 2026-04-23 07:08:02,870 - lava_callback - INFO - Starting async job submit for node 69e7224860f5826562c17aa2 2026-04-23 07:08:02,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,885 - lava_callback - DEBUG - Processing node 69e7224860f5826562c17aa2: baseline-arm64-baylibre 2026-04-23 07:08:02,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7224860f5826562c17aa2 2026-04-23 07:08:02,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:08:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:08:02,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7224860f5826562c17aa2 HTTP/1.1" 200 None 2026-04-23 07:08:02,950 - lava_callback - ERROR - Error processing callback for node 69e7224860f5826562c17aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:09:22,957 - lava_callback - INFO - Received callback for node 69e7229a60f5826562c17ac5 INFO: 172.21.0.1:33336 - "POST /node/69e7229a60f5826562c17ac5 HTTP/1.0" 202 Accepted 2026-04-23 07:09:22,963 - lava_callback - INFO - Starting async job submit for node 69e7229a60f5826562c17ac5 2026-04-23 07:09:22,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:22,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:22,977 - lava_callback - DEBUG - Processing node 69e7229a60f5826562c17ac5: baseline-arm64-baylibre 2026-04-23 07:09:22,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7229a60f5826562c17ac5 2026-04-23 07:09:22,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:09:23,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:09:23,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7229a60f5826562c17ac5 HTTP/1.1" 200 None 2026-04-23 07:09:23,033 - lava_callback - ERROR - Error processing callback for node 69e7229a60f5826562c17ac5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:10:42,992 - lava_callback - INFO - Received callback for node 69e722ec60f5826562c17aec INFO: 172.21.0.1:44004 - "POST /node/69e722ec60f5826562c17aec HTTP/1.0" 202 Accepted 2026-04-23 07:10:42,998 - lava_callback - INFO - Starting async job submit for node 69e722ec60f5826562c17aec 2026-04-23 07:10:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,020 - lava_callback - DEBUG - Processing node 69e722ec60f5826562c17aec: baseline-arm64-baylibre 2026-04-23 07:10:43,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e722ec60f5826562c17aec 2026-04-23 07:10:43,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:10:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:10:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e722ec60f5826562c17aec HTTP/1.1" 200 None 2026-04-23 07:10:43,101 - lava_callback - ERROR - Error processing callback for node 69e722ec60f5826562c17aec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:12:11,791 - lava_callback - INFO - Received callback for node 69e7234160f5826562c17b18 INFO: 172.21.0.1:47664 - "POST /node/69e7234160f5826562c17b18 HTTP/1.0" 202 Accepted 2026-04-23 07:12:11,797 - lava_callback - INFO - Starting async job submit for node 69e7234160f5826562c17b18 2026-04-23 07:12:11,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,817 - lava_callback - DEBUG - Processing node 69e7234160f5826562c17b18: baseline-arm64-clabbe 2026-04-23 07:12:11,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7234160f5826562c17b18 2026-04-23 07:12:11,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:12:11,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:12:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7234160f5826562c17b18 HTTP/1.1" 200 None 2026-04-23 07:12:11,867 - lava_callback - ERROR - Error processing callback for node 69e7234160f5826562c17b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:13:31,813 - lava_callback - INFO - Received callback for node 69e7239260f5826562c17b3c INFO: 172.21.0.1:54630 - "POST /node/69e7239260f5826562c17b3c HTTP/1.0" 202 Accepted 2026-04-23 07:13:31,818 - lava_callback - INFO - Starting async job submit for node 69e7239260f5826562c17b3c 2026-04-23 07:13:31,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,834 - lava_callback - DEBUG - Processing node 69e7239260f5826562c17b3c: baseline-arm64-clabbe 2026-04-23 07:13:31,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7239260f5826562c17b3c 2026-04-23 07:13:31,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:13:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:13:31,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7239260f5826562c17b3c HTTP/1.1" 200 None 2026-04-23 07:13:31,883 - lava_callback - ERROR - Error processing callback for node 69e7239260f5826562c17b3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:14:51,850 - lava_callback - INFO - Received callback for node 69e723e160f5826562c17b5d INFO: 172.21.0.1:44360 - "POST /node/69e723e160f5826562c17b5d HTTP/1.0" 202 Accepted 2026-04-23 07:14:51,856 - lava_callback - INFO - Starting async job submit for node 69e723e160f5826562c17b5d 2026-04-23 07:14:51,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,875 - lava_callback - DEBUG - Processing node 69e723e160f5826562c17b5d: baseline-arm64-clabbe 2026-04-23 07:14:51,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e723e160f5826562c17b5d 2026-04-23 07:14:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:14:51,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:14:51,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e723e160f5826562c17b5d HTTP/1.1" 200 None 2026-04-23 07:14:51,995 - lava_callback - ERROR - Error processing callback for node 69e723e160f5826562c17b5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:16:11,924 - lava_callback - INFO - Received callback for node 69e7243160f5826562c17b81 INFO: 172.21.0.1:51018 - "POST /node/69e7243160f5826562c17b81 HTTP/1.0" 202 Accepted 2026-04-23 07:16:11,930 - lava_callback - INFO - Starting async job submit for node 69e7243160f5826562c17b81 2026-04-23 07:16:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:11,952 - lava_callback - DEBUG - Processing node 69e7243160f5826562c17b81: baseline-arm64-clabbe 2026-04-23 07:16:11,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7243160f5826562c17b81 2026-04-23 07:16:11,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:11,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:11,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:16:11,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:16:12,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7243160f5826562c17b81 HTTP/1.1" 200 None 2026-04-23 07:16:12,003 - lava_callback - ERROR - Error processing callback for node 69e7243160f5826562c17b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:17:51,991 - lava_callback - INFO - Received callback for node 69e7248a60f5826562c17ba1 INFO: 172.21.0.1:55518 - "POST /node/69e7248a60f5826562c17ba1 HTTP/1.0" 202 Accepted 2026-04-23 07:17:51,996 - lava_callback - INFO - Starting async job submit for node 69e7248a60f5826562c17ba1 2026-04-23 07:17:51,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,012 - lava_callback - DEBUG - Processing node 69e7248a60f5826562c17ba1: baseline-arm64-clabbe 2026-04-23 07:17:52,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7248a60f5826562c17ba1 2026-04-23 07:17:52,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:17:52,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:17:52,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7248a60f5826562c17ba1 HTTP/1.1" 200 None 2026-04-23 07:17:52,085 - lava_callback - ERROR - Error processing callback for node 69e7248a60f5826562c17ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:19:12,058 - lava_callback - INFO - Received callback for node 69e724de60f5826562c17bb8 INFO: 172.21.0.1:33404 - "POST /node/69e724de60f5826562c17bb8 HTTP/1.0" 202 Accepted 2026-04-23 07:19:12,064 - lava_callback - INFO - Starting async job submit for node 69e724de60f5826562c17bb8 2026-04-23 07:19:12,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,085 - lava_callback - DEBUG - Processing node 69e724de60f5826562c17bb8: baseline-arm64-clabbe 2026-04-23 07:19:12,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e724de60f5826562c17bb8 2026-04-23 07:19:12,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c22160f5826562c1509a HTTP/1.1" 200 None 2026-04-23 07:19:12,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:19:12,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e724de60f5826562c17bb8 HTTP/1.1" 200 None 2026-04-23 07:19:12,147 - lava_callback - ERROR - Error processing callback for node 69e724de60f5826562c17bb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:30:03,976 - lava_callback - INFO - Received callback for node 69e72774fbd3a2737e5416b4 INFO: 172.21.0.1:37370 - "POST /node/69e72774fbd3a2737e5416b4 HTTP/1.0" 202 Accepted 2026-04-23 07:30:03,981 - lava_callback - INFO - Starting async job submit for node 69e72774fbd3a2737e5416b4 2026-04-23 07:30:03,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,004 - lava_callback - DEBUG - Processing node 69e72774fbd3a2737e5416b4: baseline-arm64-baylibre 2026-04-23 07:30:04,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72774fbd3a2737e5416b4 2026-04-23 07:30:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:30:04,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:30:04,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72774fbd3a2737e5416b4 HTTP/1.1" 200 None 2026-04-23 07:30:04,064 - lava_callback - ERROR - Error processing callback for node 69e72774fbd3a2737e5416b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:31:24,123 - lava_callback - INFO - Received callback for node 69e727c2fbd3a2737e5416d8 INFO: 172.21.0.1:38220 - "POST /node/69e727c2fbd3a2737e5416d8 HTTP/1.0" 202 Accepted 2026-04-23 07:31:24,130 - lava_callback - INFO - Starting async job submit for node 69e727c2fbd3a2737e5416d8 2026-04-23 07:31:24,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,151 - lava_callback - DEBUG - Processing node 69e727c2fbd3a2737e5416d8: baseline-arm64-baylibre 2026-04-23 07:31:24,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e727c2fbd3a2737e5416d8 2026-04-23 07:31:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:31:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:31:24,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e727c2fbd3a2737e5416d8 HTTP/1.1" 200 None 2026-04-23 07:31:24,205 - lava_callback - ERROR - Error processing callback for node 69e727c2fbd3a2737e5416d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:33:04,221 - lava_callback - INFO - Received callback for node 69e72829fbd3a2737e5416f6 INFO: 172.21.0.1:55388 - "POST /node/69e72829fbd3a2737e5416f6 HTTP/1.0" 202 Accepted 2026-04-23 07:33:04,226 - lava_callback - INFO - Starting async job submit for node 69e72829fbd3a2737e5416f6 2026-04-23 07:33:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,243 - lava_callback - DEBUG - Processing node 69e72829fbd3a2737e5416f6: baseline-arm64-baylibre 2026-04-23 07:33:04,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72829fbd3a2737e5416f6 2026-04-23 07:33:04,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:33:04,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:33:04,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72829fbd3a2737e5416f6 HTTP/1.1" 200 None 2026-04-23 07:33:04,291 - lava_callback - ERROR - Error processing callback for node 69e72829fbd3a2737e5416f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:34:24,308 - lava_callback - INFO - Received callback for node 69e72876fbd3a2737e54171b INFO: 172.21.0.1:60026 - "POST /node/69e72876fbd3a2737e54171b HTTP/1.0" 202 Accepted 2026-04-23 07:34:24,314 - lava_callback - INFO - Starting async job submit for node 69e72876fbd3a2737e54171b 2026-04-23 07:34:24,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,338 - lava_callback - DEBUG - Processing node 69e72876fbd3a2737e54171b: baseline-arm64-baylibre 2026-04-23 07:34:24,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72876fbd3a2737e54171b 2026-04-23 07:34:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:34:24,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:34:24,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72876fbd3a2737e54171b HTTP/1.1" 200 None 2026-04-23 07:34:24,396 - lava_callback - ERROR - Error processing callback for node 69e72876fbd3a2737e54171b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:35:44,444 - lava_callback - INFO - Received callback for node 69e728c2fbd3a2737e54173c INFO: 172.21.0.1:41056 - "POST /node/69e728c2fbd3a2737e54173c HTTP/1.0" 202 Accepted 2026-04-23 07:35:44,450 - lava_callback - INFO - Starting async job submit for node 69e728c2fbd3a2737e54173c 2026-04-23 07:35:44,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,465 - lava_callback - DEBUG - Processing node 69e728c2fbd3a2737e54173c: baseline-arm64-baylibre 2026-04-23 07:35:44,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e728c2fbd3a2737e54173c 2026-04-23 07:35:44,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:35:44,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:35:44,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e728c2fbd3a2737e54173c HTTP/1.1" 200 None 2026-04-23 07:35:44,519 - lava_callback - ERROR - Error processing callback for node 69e728c2fbd3a2737e54173c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:37:04,409 - lava_callback - INFO - Received callback for node 69e7291bfbd3a2737e541768 INFO: 172.21.0.1:45048 - "POST /node/69e7291bfbd3a2737e541768 HTTP/1.0" 202 Accepted 2026-04-23 07:37:04,414 - lava_callback - INFO - Starting async job submit for node 69e7291bfbd3a2737e541768 2026-04-23 07:37:04,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,430 - lava_callback - DEBUG - Processing node 69e7291bfbd3a2737e541768: baseline-arm64-baylibre 2026-04-23 07:37:04,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e7291bfbd3a2737e541768 2026-04-23 07:37:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:37:04,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:37:04,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7291bfbd3a2737e541768 HTTP/1.1" 200 None 2026-04-23 07:37:04,484 - lava_callback - ERROR - Error processing callback for node 69e7291bfbd3a2737e541768: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET /node/6985d74b71989fb14149a761%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47272 - "GET /node/6992678a98a8bdb31c39201d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:42:13,003 - lava_callback - INFO - Received callback for node 69e72a4ffbd3a2737e541794 INFO: 172.21.0.1:58978 - "POST /node/69e72a4ffbd3a2737e541794 HTTP/1.0" 202 Accepted 2026-04-23 07:42:13,012 - lava_callback - INFO - Starting async job submit for node 69e72a4ffbd3a2737e541794 2026-04-23 07:42:13,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,028 - lava_callback - DEBUG - Processing node 69e72a4ffbd3a2737e541794: baseline-arm64-clabbe 2026-04-23 07:42:13,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72a4ffbd3a2737e541794 2026-04-23 07:42:13,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:42:13,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:42:13,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72a4ffbd3a2737e541794 HTTP/1.1" 200 None 2026-04-23 07:42:13,083 - lava_callback - ERROR - Error processing callback for node 69e72a4ffbd3a2737e541794: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET /node/698956a985773790cd34e72c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /node/6992f8af31166481c8ddd716%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:44:13,063 - lava_callback - INFO - Received callback for node 69e72ac6fbd3a2737e5417b5 INFO: 172.21.0.1:42580 - "POST /node/69e72ac6fbd3a2737e5417b5 HTTP/1.0" 202 Accepted 2026-04-23 07:44:13,071 - lava_callback - INFO - Starting async job submit for node 69e72ac6fbd3a2737e5417b5 2026-04-23 07:44:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,086 - lava_callback - DEBUG - Processing node 69e72ac6fbd3a2737e5417b5: baseline-arm64-clabbe 2026-04-23 07:44:13,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ac6fbd3a2737e5417b5 2026-04-23 07:44:13,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:44:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:44:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ac6fbd3a2737e5417b5 HTTP/1.1" 200 None 2026-04-23 07:44:13,141 - lava_callback - ERROR - Error processing callback for node 69e72ac6fbd3a2737e5417b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET /node/6988bdf39fc35f969e1ed49d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:47:13,226 - lava_callback - INFO - Received callback for node 69e72b7afbd3a2737e5417dc INFO: 172.21.0.1:42568 - "POST /node/69e72b7afbd3a2737e5417dc HTTP/1.0" 202 Accepted 2026-04-23 07:47:13,231 - lava_callback - INFO - Starting async job submit for node 69e72b7afbd3a2737e5417dc 2026-04-23 07:47:13,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,246 - lava_callback - DEBUG - Processing node 69e72b7afbd3a2737e5417dc: baseline-arm64-clabbe 2026-04-23 07:47:13,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72b7afbd3a2737e5417dc 2026-04-23 07:47:13,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:47:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:47:13,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72b7afbd3a2737e5417dc HTTP/1.1" 200 None 2026-04-23 07:47:13,291 - lava_callback - ERROR - Error processing callback for node 69e72b7afbd3a2737e5417dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:49:13,268 - lava_callback - INFO - Received callback for node 69e72bf5fbd3a2737e54180c INFO: 172.21.0.1:38290 - "POST /node/69e72bf5fbd3a2737e54180c HTTP/1.0" 202 Accepted 2026-04-23 07:49:13,273 - lava_callback - INFO - Starting async job submit for node 69e72bf5fbd3a2737e54180c 2026-04-23 07:49:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,289 - lava_callback - DEBUG - Processing node 69e72bf5fbd3a2737e54180c: baseline-arm64-clabbe 2026-04-23 07:49:13,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72bf5fbd3a2737e54180c 2026-04-23 07:49:13,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:49:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:49:13,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72bf5fbd3a2737e54180c HTTP/1.1" 200 None 2026-04-23 07:49:13,335 - lava_callback - ERROR - Error processing callback for node 69e72bf5fbd3a2737e54180c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET /node/693afd18fee8383e92b6dc52%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:50:33,319 - lava_callback - INFO - Received callback for node 69e72c45fbd3a2737e541825 INFO: 172.21.0.1:41244 - "POST /node/69e72c45fbd3a2737e541825 HTTP/1.0" 202 Accepted 2026-04-23 07:50:33,325 - lava_callback - INFO - Starting async job submit for node 69e72c45fbd3a2737e541825 2026-04-23 07:50:33,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,340 - lava_callback - DEBUG - Processing node 69e72c45fbd3a2737e541825: baseline-arm64-clabbe 2026-04-23 07:50:33,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c45fbd3a2737e541825 2026-04-23 07:50:33,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:50:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:50:33,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c45fbd3a2737e541825 HTTP/1.1" 200 None 2026-04-23 07:50:33,390 - lava_callback - ERROR - Error processing callback for node 69e72c45fbd3a2737e541825: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:51:53,398 - lava_callback - INFO - Received callback for node 69e72c95fbd3a2737e541869 INFO: 172.21.0.1:59902 - "POST /node/69e72c95fbd3a2737e541869 HTTP/1.0" 202 Accepted 2026-04-23 07:51:53,403 - lava_callback - INFO - Starting async job submit for node 69e72c95fbd3a2737e541869 2026-04-23 07:51:53,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,419 - lava_callback - DEBUG - Processing node 69e72c95fbd3a2737e541869: baseline-arm64-clabbe 2026-04-23 07:51:53,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c95fbd3a2737e541869 2026-04-23 07:51:53,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:51:53,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:51:53,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c95fbd3a2737e541869 HTTP/1.1" 200 None 2026-04-23 07:51:53,466 - lava_callback - ERROR - Error processing callback for node 69e72c95fbd3a2737e541869: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:05,463 - lava_callback - INFO - Received callback for node 69e72c93fbd3a2737e541864 INFO: 172.21.0.1:50184 - "POST /node/69e72c93fbd3a2737e541864 HTTP/1.0" 202 Accepted 2026-04-23 07:52:05,471 - lava_callback - INFO - Starting async job submit for node 69e72c93fbd3a2737e541864 2026-04-23 07:52:05,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,488 - lava_callback - DEBUG - Processing node 69e72c93fbd3a2737e541864: baseline-arm-baylibre 2026-04-23 07:52:05,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c93fbd3a2737e541864 2026-04-23 07:52:05,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c93fbd3a2737e541864 HTTP/1.1" 200 None 2026-04-23 07:52:05,538 - lava_callback - ERROR - Error processing callback for node 69e72c93fbd3a2737e541864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:06,158 - lava_callback - INFO - Received callback for node 69e72c94fbd3a2737e541867 INFO: 172.21.0.1:50200 - "POST /node/69e72c94fbd3a2737e541867 HTTP/1.0" 202 Accepted 2026-04-23 07:52:06,163 - lava_callback - INFO - Starting async job submit for node 69e72c94fbd3a2737e541867 2026-04-23 07:52:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,181 - lava_callback - DEBUG - Processing node 69e72c94fbd3a2737e541867: baseline-arm-baylibre 2026-04-23 07:52:06,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c94fbd3a2737e541867 2026-04-23 07:52:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:06,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c94fbd3a2737e541867 HTTP/1.1" 200 None 2026-04-23 07:52:06,231 - lava_callback - ERROR - Error processing callback for node 69e72c94fbd3a2737e541867: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:06,846 - lava_callback - INFO - Received callback for node 69e72c96fbd3a2737e54186c INFO: 172.21.0.1:50218 - "POST /node/69e72c96fbd3a2737e54186c HTTP/1.0" 202 Accepted 2026-04-23 07:52:06,852 - lava_callback - INFO - Starting async job submit for node 69e72c96fbd3a2737e54186c 2026-04-23 07:52:06,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,866 - lava_callback - DEBUG - Processing node 69e72c96fbd3a2737e54186c: baseline-arm-baylibre 2026-04-23 07:52:06,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c96fbd3a2737e54186c 2026-04-23 07:52:06,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:06,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:06,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c96fbd3a2737e54186c HTTP/1.1" 200 None 2026-04-23 07:52:06,933 - lava_callback - ERROR - Error processing callback for node 69e72c96fbd3a2737e54186c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:07,515 - lava_callback - INFO - Received callback for node 69e72c97fbd3a2737e541872 INFO: 172.21.0.1:50230 - "POST /node/69e72c97fbd3a2737e541872 HTTP/1.0" 202 Accepted 2026-04-23 07:52:07,524 - lava_callback - INFO - Starting async job submit for node 69e72c97fbd3a2737e541872 2026-04-23 07:52:07,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,540 - lava_callback - DEBUG - Processing node 69e72c97fbd3a2737e541872: baseline-arm-baylibre 2026-04-23 07:52:07,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c97fbd3a2737e541872 2026-04-23 07:52:07,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:07,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:07,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c97fbd3a2737e541872 HTTP/1.1" 200 None 2026-04-23 07:52:07,583 - lava_callback - ERROR - Error processing callback for node 69e72c97fbd3a2737e541872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:08,216 - lava_callback - INFO - Received callback for node 69e72c99fbd3a2737e54187d INFO: 172.21.0.1:50238 - "POST /node/69e72c99fbd3a2737e54187d HTTP/1.0" 202 Accepted 2026-04-23 07:52:08,221 - lava_callback - INFO - Starting async job submit for node 69e72c99fbd3a2737e54187d 2026-04-23 07:52:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,237 - lava_callback - DEBUG - Processing node 69e72c99fbd3a2737e54187d: baseline-arm-baylibre 2026-04-23 07:52:08,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c99fbd3a2737e54187d 2026-04-23 07:52:08,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c99fbd3a2737e54187d HTTP/1.1" 200 None 2026-04-23 07:52:08,294 - lava_callback - ERROR - Error processing callback for node 69e72c99fbd3a2737e54187d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:08,885 - lava_callback - INFO - Received callback for node 69e72c9bfbd3a2737e541880 INFO: 172.21.0.1:50242 - "POST /node/69e72c9bfbd3a2737e541880 HTTP/1.0" 202 Accepted 2026-04-23 07:52:08,893 - lava_callback - INFO - Starting async job submit for node 69e72c9bfbd3a2737e541880 2026-04-23 07:52:08,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,911 - lava_callback - DEBUG - Processing node 69e72c9bfbd3a2737e541880: baseline-arm-baylibre 2026-04-23 07:52:08,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72c9bfbd3a2737e541880 2026-04-23 07:52:08,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:08,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:08,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72c9bfbd3a2737e541880 HTTP/1.1" 200 None 2026-04-23 07:52:08,960 - lava_callback - ERROR - Error processing callback for node 69e72c9bfbd3a2737e541880: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:13,393 - lava_callback - INFO - Received callback for node 69e72ca2fbd3a2737e541895 INFO: 172.21.0.1:40520 - "POST /node/69e72ca2fbd3a2737e541895 HTTP/1.0" 202 Accepted 2026-04-23 07:52:13,399 - lava_callback - INFO - Starting async job submit for node 69e72ca2fbd3a2737e541895 2026-04-23 07:52:13,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,414 - lava_callback - DEBUG - Processing node 69e72ca2fbd3a2737e541895: baseline-arm-clabbe 2026-04-23 07:52:13,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca2fbd3a2737e541895 2026-04-23 07:52:13,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:13,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:13,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca2fbd3a2737e541895 HTTP/1.1" 200 None 2026-04-23 07:52:13,464 - lava_callback - ERROR - Error processing callback for node 69e72ca2fbd3a2737e541895: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:14,090 - lava_callback - INFO - Received callback for node 69e72ca3fbd3a2737e54189b INFO: 172.21.0.1:40526 - "POST /node/69e72ca3fbd3a2737e54189b HTTP/1.0" 202 Accepted 2026-04-23 07:52:14,097 - lava_callback - INFO - Starting async job submit for node 69e72ca3fbd3a2737e54189b 2026-04-23 07:52:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,112 - lava_callback - DEBUG - Processing node 69e72ca3fbd3a2737e54189b: baseline-arm-clabbe 2026-04-23 07:52:14,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca3fbd3a2737e54189b 2026-04-23 07:52:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:14,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca3fbd3a2737e54189b HTTP/1.1" 200 None 2026-04-23 07:52:14,165 - lava_callback - ERROR - Error processing callback for node 69e72ca3fbd3a2737e54189b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:14,790 - lava_callback - INFO - Received callback for node 69e72ca4fbd3a2737e54189f INFO: 172.21.0.1:40528 - "POST /node/69e72ca4fbd3a2737e54189f HTTP/1.0" 202 Accepted 2026-04-23 07:52:14,796 - lava_callback - INFO - Starting async job submit for node 69e72ca4fbd3a2737e54189f 2026-04-23 07:52:14,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,811 - lava_callback - DEBUG - Processing node 69e72ca4fbd3a2737e54189f: baseline-arm-clabbe 2026-04-23 07:52:14,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca4fbd3a2737e54189f 2026-04-23 07:52:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:14,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:14,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca4fbd3a2737e54189f HTTP/1.1" 200 None 2026-04-23 07:52:14,858 - lava_callback - ERROR - Error processing callback for node 69e72ca4fbd3a2737e54189f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-23 07:52:15,483 - lava_callback - INFO - Received callback for node 69e72ca5fbd3a2737e5418a2 INFO: 172.21.0.1:40544 - "POST /node/69e72ca5fbd3a2737e5418a2 HTTP/1.0" 202 Accepted 2026-04-23 07:52:15,489 - lava_callback - INFO - Starting async job submit for node 69e72ca5fbd3a2737e5418a2 2026-04-23 07:52:15,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,504 - lava_callback - DEBUG - Processing node 69e72ca5fbd3a2737e5418a2: baseline-arm-clabbe 2026-04-23 07:52:15,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca5fbd3a2737e5418a2 2026-04-23 07:52:15,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:15,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca5fbd3a2737e5418a2 HTTP/1.1" 200 None 2026-04-23 07:52:15,549 - lava_callback - ERROR - Error processing callback for node 69e72ca5fbd3a2737e5418a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:16,174 - lava_callback - INFO - Received callback for node 69e72ca5fbd3a2737e5418a5 INFO: 172.21.0.1:40560 - "POST /node/69e72ca5fbd3a2737e5418a5 HTTP/1.0" 202 Accepted 2026-04-23 07:52:16,181 - lava_callback - INFO - Starting async job submit for node 69e72ca5fbd3a2737e5418a5 2026-04-23 07:52:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,199 - lava_callback - DEBUG - Processing node 69e72ca5fbd3a2737e5418a5: baseline-arm-clabbe 2026-04-23 07:52:16,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca5fbd3a2737e5418a5 2026-04-23 07:52:16,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:16,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca5fbd3a2737e5418a5 HTTP/1.1" 200 None 2026-04-23 07:52:16,243 - lava_callback - ERROR - Error processing callback for node 69e72ca5fbd3a2737e5418a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:52:16,888 - lava_callback - INFO - Received callback for node 69e72ca6fbd3a2737e5418a8 INFO: 172.21.0.1:40586 - "POST /node/69e72ca6fbd3a2737e5418a8 HTTP/1.0" 202 Accepted 2026-04-23 07:52:16,894 - lava_callback - INFO - Starting async job submit for node 69e72ca6fbd3a2737e5418a8 2026-04-23 07:52:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,911 - lava_callback - DEBUG - Processing node 69e72ca6fbd3a2737e5418a8: baseline-arm-clabbe 2026-04-23 07:52:16,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca6fbd3a2737e5418a8 2026-04-23 07:52:16,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:16,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:16,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca6fbd3a2737e5418a8 HTTP/1.1" 200 None 2026-04-23 07:52:16,972 - lava_callback - ERROR - Error processing callback for node 69e72ca6fbd3a2737e5418a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:17,585 - lava_callback - INFO - Received callback for node 69e72ca7fbd3a2737e5418ab INFO: 172.21.0.1:40590 - "POST /node/69e72ca7fbd3a2737e5418ab HTTP/1.0" 202 Accepted 2026-04-23 07:52:17,593 - lava_callback - INFO - Starting async job submit for node 69e72ca7fbd3a2737e5418ab 2026-04-23 07:52:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,656 - lava_callback - DEBUG - Processing node 69e72ca7fbd3a2737e5418ab: baseline-arm-clabbe 2026-04-23 07:52:17,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca7fbd3a2737e5418ab 2026-04-23 07:52:17,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:17,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:17,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca7fbd3a2737e5418ab HTTP/1.1" 200 None 2026-04-23 07:52:17,717 - lava_callback - ERROR - Error processing callback for node 69e72ca7fbd3a2737e5418ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:18,262 - lava_callback - INFO - Received callback for node 69e72ca8fbd3a2737e5418ae INFO: 172.21.0.1:40594 - "POST /node/69e72ca8fbd3a2737e5418ae HTTP/1.0" 202 Accepted 2026-04-23 07:52:18,268 - lava_callback - INFO - Starting async job submit for node 69e72ca8fbd3a2737e5418ae 2026-04-23 07:52:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,288 - lava_callback - DEBUG - Processing node 69e72ca8fbd3a2737e5418ae: baseline-arm-clabbe 2026-04-23 07:52:18,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca8fbd3a2737e5418ae 2026-04-23 07:52:18,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:18,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca8fbd3a2737e5418ae HTTP/1.1" 200 None 2026-04-23 07:52:18,348 - lava_callback - ERROR - Error processing callback for node 69e72ca8fbd3a2737e5418ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-23 07:52:18,965 - lava_callback - INFO - Received callback for node 69e72ca9fbd3a2737e5418e4 INFO: 172.21.0.1:40604 - "POST /node/69e72ca9fbd3a2737e5418e4 HTTP/1.0" 202 Accepted 2026-04-23 07:52:18,971 - lava_callback - INFO - Starting async job submit for node 69e72ca9fbd3a2737e5418e4 2026-04-23 07:52:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:18,986 - lava_callback - DEBUG - Processing node 69e72ca9fbd3a2737e5418e4: baseline-arm-clabbe 2026-04-23 07:52:18,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72ca9fbd3a2737e5418e4 2026-04-23 07:52:18,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:19,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72628fbd3a2737e541601 HTTP/1.1" 200 None 2026-04-23 07:52:19,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:52:19,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72ca9fbd3a2737e5418e4 HTTP/1.1" 200 None 2026-04-23 07:52:19,038 - lava_callback - ERROR - Error processing callback for node 69e72ca9fbd3a2737e5418e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET /node/69afb37b275c8d3b7939b467%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK 2026-04-23 07:57:53,653 - lava_callback - INFO - Received callback for node 69e72df0fbd3a2737e541a71 INFO: 172.21.0.1:50218 - "POST /node/69e72df0fbd3a2737e541a71 HTTP/1.0" 202 Accepted 2026-04-23 07:57:53,659 - lava_callback - INFO - Starting async job submit for node 69e72df0fbd3a2737e541a71 2026-04-23 07:57:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,688 - lava_callback - DEBUG - Processing node 69e72df0fbd3a2737e541a71: baseline-arm64-clabbe 2026-04-23 07:57:53,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e72df0fbd3a2737e541a71 2026-04-23 07:57:53,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-23 07:57:53,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 07:57:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e72df0fbd3a2737e541a71 HTTP/1.1" 200 None 2026-04-23 07:57:53,737 - lava_callback - ERROR - Error processing callback for node 69e72df0fbd3a2737e541a71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK 2026-04-23 08:13:46,619 - lava_callback - INFO - Received callback for node 69e731a5fbd3a2737e5442c3 INFO: 172.21.0.1:45802 - "POST /node/69e731a5fbd3a2737e5442c3 HTTP/1.0" 202 Accepted 2026-04-23 08:13:46,627 - lava_callback - INFO - Starting async job submit for node 69e731a5fbd3a2737e5442c3 2026-04-23 08:13:46,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,650 - lava_callback - DEBUG - Processing node 69e731a5fbd3a2737e5442c3: baseline-arm-baylibre 2026-04-23 08:13:46,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e731a5fbd3a2737e5442c3 2026-04-23 08:13:46,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-23 08:13:46,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 08:13:46,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e731a5fbd3a2737e5442c3 HTTP/1.1" 200 None 2026-04-23 08:13:46,739 - lava_callback - ERROR - Error processing callback for node 69e731a5fbd3a2737e5442c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]