INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59484 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:41:22,488 - lava_callback - INFO - Received callback for node 69982c3ae4d71f8580ba3f4b 2026-02-22 09:41:22,495 - lava_callback - INFO - Starting async job submit for node 69982c3ae4d71f8580ba3f4b INFO: 172.20.0.1:45818 - "POST /node/69982c3ae4d71f8580ba3f4b HTTP/1.0" 202 Accepted 2026-02-22 09:41:22,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:41:22,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982c3ae4d71f8580ba3f4b HTTP/1.1" 200 None 2026-02-22 09:41:22,518 - lava_callback - DEBUG - Processing node 69982c3ae4d71f8580ba3f4b: baseline-arm64-baylibre 2026-02-22 09:41:22,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982c3ae4d71f8580ba3f4b 2026-02-22 09:41:22,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:41:22,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982c3ae4d71f8580ba3f4b HTTP/1.1" 200 None 2026-02-22 09:41:22,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:41:22,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6992627498a8bdb31c391803 HTTP/1.1" 200 None 2026-02-22 09:41:22,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:41:22,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982c3ae4d71f8580ba3f4b HTTP/1.1" 200 None 2026-02-22 09:41:22,588 - lava_callback - ERROR - Error processing callback for node 69982c3ae4d71f8580ba3f4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:45:31,644 - lava_callback - INFO - Received callback for node 699ac7a34c2498fde4fe60ab INFO: 172.20.0.1:48710 - "POST /node/699ac7a34c2498fde4fe60ab HTTP/1.0" 202 Accepted 2026-02-22 09:45:31,649 - lava_callback - INFO - Starting async job submit for node 699ac7a34c2498fde4fe60ab 2026-02-22 09:45:31,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:45:31,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ac7a34c2498fde4fe60ab HTTP/1.1" 200 None 2026-02-22 09:45:31,683 - lava_callback - DEBUG - Processing node 699ac7a34c2498fde4fe60ab: baseline-arm64-broonie 2026-02-22 09:45:31,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:45:31,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:45:31,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-699ac7a34c2498fde4fe60ab/log.txt.gz 2026-02-22 09:45:31,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:45:32,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:45:32,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-699ac7a34c2498fde4fe60ab/lava-logs.yaml 2026-02-22 09:45:32,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:45:32,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:45:32,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-699ac7a34c2498fde4fe60ab/lava_callback.json.gz 2026-02-22 09:45:32,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:45:32,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ac7a34c2498fde4fe60ab HTTP/1.1" 200 None 2026-02-22 09:45:32,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:45:32,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699abbf84c2498fde4fe5c13 HTTP/1.1" 200 None 2026-02-22 09:45:32,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:45:32,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ac7a34c2498fde4fe60ab HTTP/1.1" 200 None 2026-02-22 09:45:32,381 - lava_callback - INFO - Completed processing callback for node 699ac7a34c2498fde4fe60ab INFO: 172.20.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:45:52,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:45:52,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:46:42,519 - lava_callback - INFO - Received callback for node 699ad06563fa09c76bb0714d INFO: 172.20.0.1:33482 - "POST /node/699ad06563fa09c76bb0714d HTTP/1.0" 202 Accepted 2026-02-22 09:46:42,526 - lava_callback - INFO - Starting async job submit for node 699ad06563fa09c76bb0714d 2026-02-22 09:46:42,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:42,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06563fa09c76bb0714d HTTP/1.1" 200 None 2026-02-22 09:46:42,561 - lava_callback - DEBUG - Processing node 699ad06563fa09c76bb0714d: baseline-x86 2026-02-22 09:46:42,748 - lava_callback - INFO - Received callback for node 69982d70e4d71f8580ba3f80 2026-02-22 09:46:42,774 - lava_callback - INFO - Starting async job submit for node 69982d70e4d71f8580ba3f80 INFO: 172.20.0.1:33496 - "POST /node/69982d70e4d71f8580ba3f80 HTTP/1.0" 202 Accepted 2026-02-22 09:46:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:42,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:42,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982d70e4d71f8580ba3f80 HTTP/1.1" 200 None 2026-02-22 09:46:42,837 - lava_callback - DEBUG - Processing node 69982d70e4d71f8580ba3f80: baseline-arm64-baylibre 2026-02-22 09:46:42,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982d70e4d71f8580ba3f80 2026-02-22 09:46:42,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:42,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982d70e4d71f8580ba3f80 HTTP/1.1" 200 None 2026-02-22 09:46:42,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:42,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:46:42,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:42,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982d70e4d71f8580ba3f80 HTTP/1.1" 200 None 2026-02-22 09:46:42,943 - lava_callback - ERROR - Error processing callback for node 69982d70e4d71f8580ba3f80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-02-22 09:46:43,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:43,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06563fa09c76bb0714d/log.txt.gz 2026-02-22 09:46:43,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:43,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:43,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06563fa09c76bb0714d/lava-logs.yaml 2026-02-22 09:46:43,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:43,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:43,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06563fa09c76bb0714d/lava_callback.json.gz 2026-02-22 09:46:43,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:43,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06563fa09c76bb0714d HTTP/1.1" 200 None 2026-02-22 09:46:43,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:43,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc2563fa09c76bb06eaf HTTP/1.1" 200 None 2026-02-22 09:46:43,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad06563fa09c76bb0714d HTTP/1.1" 200 None 2026-02-22 09:46:43,741 - lava_callback - INFO - Completed processing callback for node 699ad06563fa09c76bb0714d INFO: 172.20.0.1:33500 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:46:46,721 - lava_callback - INFO - Received callback for node 699ad06763fa09c76bb07156 INFO: 172.20.0.1:33516 - "POST /node/699ad06763fa09c76bb07156 HTTP/1.0" 202 Accepted 2026-02-22 09:46:46,730 - lava_callback - INFO - Starting async job submit for node 699ad06763fa09c76bb07156 2026-02-22 09:46:46,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:46,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06763fa09c76bb07156 HTTP/1.1" 200 None 2026-02-22 09:46:46,773 - lava_callback - DEBUG - Processing node 699ad06763fa09c76bb07156: baseline-x86 2026-02-22 09:46:46,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:47,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:47,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06763fa09c76bb07156/log.txt.gz 2026-02-22 09:46:47,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:47,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:47,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06763fa09c76bb07156/lava-logs.yaml 2026-02-22 09:46:47,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:46:47,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:46:47,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06763fa09c76bb07156/lava_callback.json.gz 2026-02-22 09:46:47,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:47,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06763fa09c76bb07156 HTTP/1.1" 200 None 2026-02-22 09:46:47,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:47,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc2563fa09c76bb06eaf HTTP/1.1" 200 None 2026-02-22 09:46:47,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:47,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad06763fa09c76bb07156 HTTP/1.1" 200 None 2026-02-22 09:46:47,705 - lava_callback - INFO - Completed processing callback for node 699ad06763fa09c76bb07156 2026-02-22 09:46:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:46:52,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:47:33,343 - lava_callback - INFO - Received callback for node 699ad06663fa09c76bb07150 INFO: 172.20.0.1:57562 - "POST /node/699ad06663fa09c76bb07150 HTTP/1.0" 202 Accepted 2026-02-22 09:47:33,349 - lava_callback - INFO - Starting async job submit for node 699ad06663fa09c76bb07150 2026-02-22 09:47:33,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:47:33,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06663fa09c76bb07150 HTTP/1.1" 200 None 2026-02-22 09:47:33,385 - lava_callback - DEBUG - Processing node 699ad06663fa09c76bb07150: baseline-x86 2026-02-22 09:47:33,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:47:33,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:47:33,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07150/log.txt.gz 2026-02-22 09:47:33,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:47:34,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:47:34,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07150/lava-logs.yaml 2026-02-22 09:47:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:47:34,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:47:34,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07150/lava_callback.json.gz 2026-02-22 09:47:34,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:47:34,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06663fa09c76bb07150 HTTP/1.1" 200 None 2026-02-22 09:47:34,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:47:34,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc2563fa09c76bb06eaf HTTP/1.1" 200 None 2026-02-22 09:47:34,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:47:34,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad06663fa09c76bb07150 HTTP/1.1" 200 None 2026-02-22 09:47:34,457 - lava_callback - INFO - Completed processing callback for node 699ad06663fa09c76bb07150 INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51244 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:47:52,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:47:52,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57960 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:48:02,827 - lava_callback - INFO - Received callback for node 69982dc2e4d71f8580ba3f93 INFO: 172.20.0.1:34940 - "POST /node/69982dc2e4d71f8580ba3f93 HTTP/1.0" 202 Accepted 2026-02-22 09:48:02,833 - lava_callback - INFO - Starting async job submit for node 69982dc2e4d71f8580ba3f93 2026-02-22 09:48:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:02,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982dc2e4d71f8580ba3f93 HTTP/1.1" 200 None 2026-02-22 09:48:02,870 - lava_callback - DEBUG - Processing node 69982dc2e4d71f8580ba3f93: baseline-arm64-baylibre 2026-02-22 09:48:02,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982dc2e4d71f8580ba3f93 2026-02-22 09:48:02,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:02,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982dc2e4d71f8580ba3f93 HTTP/1.1" 200 None 2026-02-22 09:48:02,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:02,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:48:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:02,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982dc2e4d71f8580ba3f93 HTTP/1.1" 200 None 2026-02-22 09:48:02,977 - lava_callback - ERROR - Error processing callback for node 69982dc2e4d71f8580ba3f93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-02-22 09:48:04,116 - lava_callback - INFO - Received callback for node 699ad06663fa09c76bb07153 INFO: 172.20.0.1:34954 - "POST /node/699ad06663fa09c76bb07153 HTTP/1.0" 202 Accepted 2026-02-22 09:48:04,122 - lava_callback - INFO - Starting async job submit for node 699ad06663fa09c76bb07153 2026-02-22 09:48:04,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:04,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06663fa09c76bb07153 HTTP/1.1" 200 None 2026-02-22 09:48:04,162 - lava_callback - DEBUG - Processing node 699ad06663fa09c76bb07153: baseline-x86 2026-02-22 09:48:04,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:48:04,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:48:04,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07153/log.txt.gz 2026-02-22 09:48:04,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:48:04,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:48:04,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07153/lava-logs.yaml 2026-02-22 09:48:04,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:48:05,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:48:05,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-699ad06663fa09c76bb07153/lava_callback.json.gz 2026-02-22 09:48:05,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:05,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad06663fa09c76bb07153 HTTP/1.1" 200 None 2026-02-22 09:48:05,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:05,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc2563fa09c76bb06eaf HTTP/1.1" 200 None 2026-02-22 09:48:05,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:05,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad06663fa09c76bb07153 HTTP/1.1" 200 None 2026-02-22 09:48:05,183 - lava_callback - INFO - Completed processing callback for node 699ad06663fa09c76bb07153 INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:48:22,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:48:22,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:49:22,893 - lava_callback - INFO - Received callback for node 69982e10e4d71f8580ba3fa1 INFO: 172.20.0.1:50542 - "POST /node/69982e10e4d71f8580ba3fa1 HTTP/1.0" 202 Accepted 2026-02-22 09:49:22,898 - lava_callback - INFO - Starting async job submit for node 69982e10e4d71f8580ba3fa1 2026-02-22 09:49:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:49:22,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982e10e4d71f8580ba3fa1 HTTP/1.1" 200 None 2026-02-22 09:49:22,915 - lava_callback - DEBUG - Processing node 69982e10e4d71f8580ba3fa1: baseline-arm64-baylibre 2026-02-22 09:49:22,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982e10e4d71f8580ba3fa1 2026-02-22 09:49:22,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:49:22,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982e10e4d71f8580ba3fa1 HTTP/1.1" 200 None 2026-02-22 09:49:22,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:49:22,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:49:22,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:49:22,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982e10e4d71f8580ba3fa1 HTTP/1.1" 200 None 2026-02-22 09:49:22,979 - lava_callback - ERROR - Error processing callback for node 69982e10e4d71f8580ba3fa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:50:42,953 - lava_callback - INFO - Received callback for node 69982e5ee4d71f8580ba3fb0 INFO: 172.20.0.1:55528 - "POST /node/69982e5ee4d71f8580ba3fb0 HTTP/1.0" 202 Accepted 2026-02-22 09:50:42,962 - lava_callback - INFO - Starting async job submit for node 69982e5ee4d71f8580ba3fb0 2026-02-22 09:50:42,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:50:42,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982e5ee4d71f8580ba3fb0 HTTP/1.1" 200 None 2026-02-22 09:50:42,981 - lava_callback - DEBUG - Processing node 69982e5ee4d71f8580ba3fb0: baseline-arm64-baylibre 2026-02-22 09:50:42,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982e5ee4d71f8580ba3fb0 2026-02-22 09:50:42,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:50:43,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982e5ee4d71f8580ba3fb0 HTTP/1.1" 200 None 2026-02-22 09:50:43,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:50:43,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:50:43,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:50:43,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982e5ee4d71f8580ba3fb0 HTTP/1.1" 200 None 2026-02-22 09:50:43,139 - lava_callback - ERROR - Error processing callback for node 69982e5ee4d71f8580ba3fb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:51:03,274 - lava_callback - INFO - Received callback for node 699ad16963fa09c76bb071d6 INFO: 172.20.0.1:46502 - "POST /node/699ad16963fa09c76bb071d6 HTTP/1.0" 202 Accepted 2026-02-22 09:51:03,326 - lava_callback - INFO - Starting async job submit for node 699ad16963fa09c76bb071d6 2026-02-22 09:51:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:03,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad16963fa09c76bb071d6 HTTP/1.1" 200 None 2026-02-22 09:51:03,359 - lava_callback - DEBUG - Processing node 699ad16963fa09c76bb071d6: baseline-arm 2026-02-22 09:51:03,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:03,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:03,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16963fa09c76bb071d6/log.txt.gz 2026-02-22 09:51:03,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:04,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:04,104 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16963fa09c76bb071d6/lava-logs.yaml 2026-02-22 09:51:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:04,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:04,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16963fa09c76bb071d6/lava_callback.json.gz 2026-02-22 09:51:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:04,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad16963fa09c76bb071d6 HTTP/1.1" 200 None 2026-02-22 09:51:04,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:04,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc0263fa09c76bb06e82 HTTP/1.1" 200 None 2026-02-22 09:51:04,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:04,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad16963fa09c76bb071d6 HTTP/1.1" 200 None 2026-02-22 09:51:04,323 - lava_callback - INFO - Completed processing callback for node 699ad16963fa09c76bb071d6 INFO: 172.20.0.1:46504 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:51:07,246 - lava_callback - INFO - Received callback for node 699ad16663fa09c76bb071bf INFO: 172.20.0.1:46516 - "POST /node/699ad16663fa09c76bb071bf HTTP/1.0" 202 Accepted 2026-02-22 09:51:07,294 - lava_callback - INFO - Starting async job submit for node 699ad16663fa09c76bb071bf 2026-02-22 09:51:07,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:07,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad16663fa09c76bb071bf HTTP/1.1" 200 None 2026-02-22 09:51:07,350 - lava_callback - DEBUG - Processing node 699ad16663fa09c76bb071bf: baseline-arm 2026-02-22 09:51:07,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:07,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:07,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16663fa09c76bb071bf/log.txt.gz 2026-02-22 09:51:07,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:07,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:07,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16663fa09c76bb071bf/lava-logs.yaml 2026-02-22 09:51:07,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-02-22 09:51:08,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-02-22 09:51:08,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-699ad16663fa09c76bb071bf/lava_callback.json.gz 2026-02-22 09:51:08,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:08,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699ad16663fa09c76bb071bf HTTP/1.1" 200 None 2026-02-22 09:51:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:08,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699acc0263fa09c76bb06e82 HTTP/1.1" 200 None 2026-02-22 09:51:08,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:08,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/699ad16663fa09c76bb071bf HTTP/1.1" 200 None 2026-02-22 09:51:08,292 - lava_callback - INFO - Completed processing callback for node 699ad16663fa09c76bb071bf INFO: 172.20.0.1:37190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:51:22,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:51:22,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53068 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:54:03,182 - lava_callback - INFO - Received callback for node 69982f26e4d71f8580ba3feb INFO: 172.20.0.1:58256 - "POST /node/69982f26e4d71f8580ba3feb HTTP/1.0" 202 Accepted 2026-02-22 09:54:03,195 - lava_callback - INFO - Starting async job submit for node 69982f26e4d71f8580ba3feb 2026-02-22 09:54:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:54:03,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f26e4d71f8580ba3feb HTTP/1.1" 200 None 2026-02-22 09:54:03,249 - lava_callback - DEBUG - Processing node 69982f26e4d71f8580ba3feb: baseline-arm64-baylibre 2026-02-22 09:54:03,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982f26e4d71f8580ba3feb 2026-02-22 09:54:03,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:54:03,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f26e4d71f8580ba3feb HTTP/1.1" 200 None 2026-02-22 09:54:03,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:54:03,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:54:03,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:54:03,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982f26e4d71f8580ba3feb HTTP/1.1" 200 None 2026-02-22 09:54:03,353 - lava_callback - ERROR - Error processing callback for node 69982f26e4d71f8580ba3feb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57014 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:55:03,192 - lava_callback - INFO - Received callback for node 69982f6ee4d71f8580ba3ffb INFO: 172.20.0.1:52708 - "POST /node/69982f6ee4d71f8580ba3ffb HTTP/1.0" 202 Accepted 2026-02-22 09:55:03,198 - lava_callback - INFO - Starting async job submit for node 69982f6ee4d71f8580ba3ffb 2026-02-22 09:55:03,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:03,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f6ee4d71f8580ba3ffb HTTP/1.1" 200 None 2026-02-22 09:55:03,214 - lava_callback - DEBUG - Processing node 69982f6ee4d71f8580ba3ffb: baseline-arm-baylibre 2026-02-22 09:55:03,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982f6ee4d71f8580ba3ffb 2026-02-22 09:55:03,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:03,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f6ee4d71f8580ba3ffb HTTP/1.1" 200 None 2026-02-22 09:55:03,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:03,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6992d3ef31166481c8dd30fa HTTP/1.1" 200 None 2026-02-22 09:55:03,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:03,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982f6ee4d71f8580ba3ffb HTTP/1.1" 200 None 2026-02-22 09:55:03,272 - lava_callback - ERROR - Error processing callback for node 69982f6ee4d71f8580ba3ffb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:55:43,253 - lava_callback - INFO - Received callback for node 69982f9ae4d71f8580ba4007 INFO: 172.20.0.1:58686 - "POST /node/69982f9ae4d71f8580ba4007 HTTP/1.0" 202 Accepted 2026-02-22 09:55:43,259 - lava_callback - INFO - Starting async job submit for node 69982f9ae4d71f8580ba4007 2026-02-22 09:55:43,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:43,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f9ae4d71f8580ba4007 HTTP/1.1" 200 None 2026-02-22 09:55:43,282 - lava_callback - DEBUG - Processing node 69982f9ae4d71f8580ba4007: baseline-arm-baylibre 2026-02-22 09:55:43,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982f9ae4d71f8580ba4007 2026-02-22 09:55:43,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:43,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982f9ae4d71f8580ba4007 HTTP/1.1" 200 None 2026-02-22 09:55:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:43,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6992d3ef31166481c8dd30fa HTTP/1.1" 200 None 2026-02-22 09:55:43,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:55:43,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982f9ae4d71f8580ba4007 HTTP/1.1" 200 None 2026-02-22 09:55:43,364 - lava_callback - ERROR - Error processing callback for node 69982f9ae4d71f8580ba4007: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:56:43,260 - lava_callback - INFO - Received callback for node 69982fc6e4d71f8580ba4015 INFO: 172.20.0.1:56122 - "POST /node/69982fc6e4d71f8580ba4015 HTTP/1.0" 202 Accepted 2026-02-22 09:56:43,265 - lava_callback - INFO - Starting async job submit for node 69982fc6e4d71f8580ba4015 2026-02-22 09:56:43,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:56:43,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982fc6e4d71f8580ba4015 HTTP/1.1" 200 None 2026-02-22 09:56:43,281 - lava_callback - DEBUG - Processing node 69982fc6e4d71f8580ba4015: baseline-arm-baylibre 2026-02-22 09:56:43,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982fc6e4d71f8580ba4015 2026-02-22 09:56:43,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:56:43,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982fc6e4d71f8580ba4015 HTTP/1.1" 200 None 2026-02-22 09:56:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:56:43,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6992d3ef31166481c8dd30fa HTTP/1.1" 200 None 2026-02-22 09:56:43,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:56:43,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982fc6e4d71f8580ba4015 HTTP/1.1" 200 None 2026-02-22 09:56:43,348 - lava_callback - ERROR - Error processing callback for node 69982fc6e4d71f8580ba4015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:57:23,333 - lava_callback - INFO - Received callback for node 69982ff9e4d71f8580ba402a INFO: 172.20.0.1:40730 - "POST /node/69982ff9e4d71f8580ba402a HTTP/1.0" 202 Accepted 2026-02-22 09:57:23,340 - lava_callback - INFO - Starting async job submit for node 69982ff9e4d71f8580ba402a 2026-02-22 09:57:23,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:57:23,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982ff9e4d71f8580ba402a HTTP/1.1" 200 None 2026-02-22 09:57:23,356 - lava_callback - DEBUG - Processing node 69982ff9e4d71f8580ba402a: baseline-arm64-baylibre 2026-02-22 09:57:23,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69982ff9e4d71f8580ba402a 2026-02-22 09:57:23,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:57:23,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69982ff9e4d71f8580ba402a HTTP/1.1" 200 None 2026-02-22 09:57:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:57:23,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:57:23,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:57:23,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69982ff9e4d71f8580ba402a HTTP/1.1" 200 None 2026-02-22 09:57:23,407 - lava_callback - ERROR - Error processing callback for node 69982ff9e4d71f8580ba402a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36160 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:58:43,389 - lava_callback - INFO - Received callback for node 69983042e4d71f8580ba4034 INFO: 172.20.0.1:37546 - "POST /node/69983042e4d71f8580ba4034 HTTP/1.0" 202 Accepted 2026-02-22 09:58:43,395 - lava_callback - INFO - Starting async job submit for node 69983042e4d71f8580ba4034 2026-02-22 09:58:43,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:58:43,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69983042e4d71f8580ba4034 HTTP/1.1" 200 None 2026-02-22 09:58:43,411 - lava_callback - DEBUG - Processing node 69983042e4d71f8580ba4034: baseline-arm-baylibre 2026-02-22 09:58:43,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69983042e4d71f8580ba4034 2026-02-22 09:58:43,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:58:43,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69983042e4d71f8580ba4034 HTTP/1.1" 200 None 2026-02-22 09:58:43,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:58:43,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6992d3ef31166481c8dd30fa HTTP/1.1" 200 None 2026-02-22 09:58:43,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:58:43,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69983042e4d71f8580ba4034 HTTP/1.1" 200 None 2026-02-22 09:58:43,477 - lava_callback - ERROR - Error processing callback for node 69983042e4d71f8580ba4034: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45708 - "GET / HTTP/1.0" 200 OK 2026-02-22 09:59:23,418 - lava_callback - INFO - Received callback for node 69983074e4d71f8580ba4046 INFO: 172.20.0.1:51246 - "POST /node/69983074e4d71f8580ba4046 HTTP/1.0" 202 Accepted 2026-02-22 09:59:23,424 - lava_callback - INFO - Starting async job submit for node 69983074e4d71f8580ba4046 2026-02-22 09:59:23,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:59:23,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69983074e4d71f8580ba4046 HTTP/1.1" 200 None 2026-02-22 09:59:23,450 - lava_callback - DEBUG - Processing node 69983074e4d71f8580ba4046: baseline-arm64-baylibre 2026-02-22 09:59:23,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69983074e4d71f8580ba4046 2026-02-22 09:59:23,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:59:23,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69983074e4d71f8580ba4046 HTTP/1.1" 200 None 2026-02-22 09:59:23,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:59:23,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/699262d698a8bdb31c3918f9 HTTP/1.1" 200 None 2026-02-22 09:59:23,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-02-22 09:59:23,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69983074e4d71f8580ba4046 HTTP/1.1" 200 None 2026-02-22 09:59:23,506 - lava_callback - ERROR - Error processing callback for node 69983074e4d71f8580ba4046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]