INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:13:59,009 - lava_callback - INFO - Received callback for node 69be5333d54b5122738c79cf 2026-03-23 08:13:59,016 - lava_callback - INFO - Starting async job submit for node 69be5333d54b5122738c79cf INFO: 172.21.0.1:50484 - "POST /node/69be5333d54b5122738c79cf HTTP/1.0" 202 Accepted 2026-03-23 08:13:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:13:59,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5333d54b5122738c79cf HTTP/1.1" 200 None 2026-03-23 08:13:59,057 - lava_callback - DEBUG - Processing node 69be5333d54b5122738c79cf: baseline-arm64-baylibre 2026-03-23 08:13:59,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5333d54b5122738c79cf 2026-03-23 08:13:59,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:13:59,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5333d54b5122738c79cf HTTP/1.1" 200 None 2026-03-23 08:13:59,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:13:59,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-23 08:13:59,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:13:59,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5333d54b5122738c79cf HTTP/1.1" 200 None 2026-03-23 08:13:59,122 - lava_callback - ERROR - Error processing callback for node 69be5333d54b5122738c79cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:31:53,191 - lava_callback - INFO - Received callback for node 69c0fa03acdb2e26c83cd025 INFO: 172.21.0.1:43000 - "POST /node/69c0fa03acdb2e26c83cd025 HTTP/1.0" 202 Accepted 2026-03-23 08:31:53,197 - lava_callback - INFO - Starting async job submit for node 69c0fa03acdb2e26c83cd025 2026-03-23 08:31:53,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:31:53,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fa03acdb2e26c83cd025 HTTP/1.1" 200 None 2026-03-23 08:31:53,235 - lava_callback - DEBUG - Processing node 69c0fa03acdb2e26c83cd025: baseline-arm 2026-03-23 08:31:53,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:31:53,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:31:53,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fa03acdb2e26c83cd025/log.txt.gz 2026-03-23 08:31:53,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:31:53,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:31:53,949 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fa03acdb2e26c83cd025/lava-logs.yaml 2026-03-23 08:31:53,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:31:54,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:31:54,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fa03acdb2e26c83cd025/lava_callback.json.gz 2026-03-23 08:31:54,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:31:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fa03acdb2e26c83cd025 HTTP/1.1" 200 None 2026-03-23 08:31:54,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:31:54,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f734acdb2e26c83cca26 HTTP/1.1" 200 None 2026-03-23 08:31:54,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:31:54,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fa03acdb2e26c83cd025 HTTP/1.1" 200 None 2026-03-23 08:31:54,253 - lava_callback - INFO - Completed processing callback for node 69c0fa03acdb2e26c83cd025 INFO: 172.21.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43020 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:31:59,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:31:59,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:39:40,480 - lava_callback - INFO - Received callback for node 69be593e448e074b3ffe16ac INFO: 172.21.0.1:53992 - "POST /node/69be593e448e074b3ffe16ac HTTP/1.0" 202 Accepted 2026-03-23 08:39:40,486 - lava_callback - INFO - Starting async job submit for node 69be593e448e074b3ffe16ac 2026-03-23 08:39:40,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:40,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be593e448e074b3ffe16ac HTTP/1.1" 200 None 2026-03-23 08:39:40,509 - lava_callback - DEBUG - Processing node 69be593e448e074b3ffe16ac: baseline-arm-baylibre 2026-03-23 08:39:40,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be593e448e074b3ffe16ac 2026-03-23 08:39:40,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:40,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be593e448e074b3ffe16ac HTTP/1.1" 200 None 2026-03-23 08:39:40,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:40,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:39:40,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:40,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be593e448e074b3ffe16ac HTTP/1.1" 200 None 2026-03-23 08:39:40,569 - lava_callback - ERROR - Error processing callback for node 69be593e448e074b3ffe16ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:41,153 - lava_callback - INFO - Received callback for node 69be593f448e074b3ffe16ae INFO: 172.21.0.1:54002 - "POST /node/69be593f448e074b3ffe16ae HTTP/1.0" 202 Accepted 2026-03-23 08:39:41,158 - lava_callback - INFO - Starting async job submit for node 69be593f448e074b3ffe16ae 2026-03-23 08:39:41,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be593f448e074b3ffe16ae HTTP/1.1" 200 None 2026-03-23 08:39:41,179 - lava_callback - DEBUG - Processing node 69be593f448e074b3ffe16ae: baseline-arm-baylibre 2026-03-23 08:39:41,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be593f448e074b3ffe16ae 2026-03-23 08:39:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be593f448e074b3ffe16ae HTTP/1.1" 200 None 2026-03-23 08:39:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:41,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be593f448e074b3ffe16ae HTTP/1.1" 200 None 2026-03-23 08:39:41,244 - lava_callback - ERROR - Error processing callback for node 69be593f448e074b3ffe16ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:41,807 - lava_callback - INFO - Received callback for node 69be5940448e074b3ffe16b2 INFO: 172.21.0.1:54004 - "POST /node/69be5940448e074b3ffe16b2 HTTP/1.0" 202 Accepted 2026-03-23 08:39:41,813 - lava_callback - INFO - Starting async job submit for node 69be5940448e074b3ffe16b2 2026-03-23 08:39:41,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5940448e074b3ffe16b2 HTTP/1.1" 200 None 2026-03-23 08:39:41,830 - lava_callback - DEBUG - Processing node 69be5940448e074b3ffe16b2: baseline-arm-baylibre 2026-03-23 08:39:41,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5940448e074b3ffe16b2 2026-03-23 08:39:41,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5940448e074b3ffe16b2 HTTP/1.1" 200 None 2026-03-23 08:39:41,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:41,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:41,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5940448e074b3ffe16b2 HTTP/1.1" 200 None 2026-03-23 08:39:41,896 - lava_callback - ERROR - Error processing callback for node 69be5940448e074b3ffe16b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:42,471 - lava_callback - INFO - Received callback for node 69be5941448e074b3ffe16b7 INFO: 172.21.0.1:54006 - "POST /node/69be5941448e074b3ffe16b7 HTTP/1.0" 202 Accepted 2026-03-23 08:39:42,477 - lava_callback - INFO - Starting async job submit for node 69be5941448e074b3ffe16b7 2026-03-23 08:39:42,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:42,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5941448e074b3ffe16b7 HTTP/1.1" 200 None 2026-03-23 08:39:42,494 - lava_callback - DEBUG - Processing node 69be5941448e074b3ffe16b7: baseline-arm-baylibre 2026-03-23 08:39:42,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5941448e074b3ffe16b7 2026-03-23 08:39:42,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:42,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5941448e074b3ffe16b7 HTTP/1.1" 200 None 2026-03-23 08:39:42,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:42,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:42,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:42,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5941448e074b3ffe16b7 HTTP/1.1" 200 None 2026-03-23 08:39:42,556 - lava_callback - ERROR - Error processing callback for node 69be5941448e074b3ffe16b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:43,177 - lava_callback - INFO - Received callback for node 69be5943448e074b3ffe16bb INFO: 172.21.0.1:54018 - "POST /node/69be5943448e074b3ffe16bb HTTP/1.0" 202 Accepted 2026-03-23 08:39:43,182 - lava_callback - INFO - Starting async job submit for node 69be5943448e074b3ffe16bb 2026-03-23 08:39:43,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5943448e074b3ffe16bb HTTP/1.1" 200 None 2026-03-23 08:39:43,199 - lava_callback - DEBUG - Processing node 69be5943448e074b3ffe16bb: baseline-arm-baylibre 2026-03-23 08:39:43,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5943448e074b3ffe16bb 2026-03-23 08:39:43,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5943448e074b3ffe16bb HTTP/1.1" 200 None 2026-03-23 08:39:43,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:43,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5943448e074b3ffe16bb HTTP/1.1" 200 None 2026-03-23 08:39:43,269 - lava_callback - ERROR - Error processing callback for node 69be5943448e074b3ffe16bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:43,843 - lava_callback - INFO - Received callback for node 69be5945448e074b3ffe16c6 INFO: 172.21.0.1:54026 - "POST /node/69be5945448e074b3ffe16c6 HTTP/1.0" 202 Accepted 2026-03-23 08:39:43,849 - lava_callback - INFO - Starting async job submit for node 69be5945448e074b3ffe16c6 2026-03-23 08:39:43,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5945448e074b3ffe16c6 HTTP/1.1" 200 None 2026-03-23 08:39:43,866 - lava_callback - DEBUG - Processing node 69be5945448e074b3ffe16c6: baseline-arm-baylibre 2026-03-23 08:39:43,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5945448e074b3ffe16c6 2026-03-23 08:39:43,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5945448e074b3ffe16c6 HTTP/1.1" 200 None 2026-03-23 08:39:43,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:43,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:43,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5945448e074b3ffe16c6 HTTP/1.1" 200 None 2026-03-23 08:39:43,941 - lava_callback - ERROR - Error processing callback for node 69be5945448e074b3ffe16c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:44,520 - lava_callback - INFO - Received callback for node 69be5947448e074b3ffe16c9 INFO: 172.21.0.1:54028 - "POST /node/69be5947448e074b3ffe16c9 HTTP/1.0" 202 Accepted 2026-03-23 08:39:44,526 - lava_callback - INFO - Starting async job submit for node 69be5947448e074b3ffe16c9 2026-03-23 08:39:44,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:44,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5947448e074b3ffe16c9 HTTP/1.1" 200 None 2026-03-23 08:39:44,544 - lava_callback - DEBUG - Processing node 69be5947448e074b3ffe16c9: baseline-arm-baylibre 2026-03-23 08:39:44,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5947448e074b3ffe16c9 2026-03-23 08:39:44,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:44,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5947448e074b3ffe16c9 HTTP/1.1" 200 None 2026-03-23 08:39:44,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:44,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:44,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:44,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5947448e074b3ffe16c9 HTTP/1.1" 200 None 2026-03-23 08:39:44,638 - lava_callback - ERROR - Error processing callback for node 69be5947448e074b3ffe16c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:39:53,465 - lava_callback - INFO - Received callback for node 69be594f448e074b3ffe16f9 INFO: 172.21.0.1:34748 - "POST /node/69be594f448e074b3ffe16f9 HTTP/1.0" 202 Accepted 2026-03-23 08:39:53,471 - lava_callback - INFO - Starting async job submit for node 69be594f448e074b3ffe16f9 2026-03-23 08:39:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:53,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be594f448e074b3ffe16f9 HTTP/1.1" 200 None 2026-03-23 08:39:53,487 - lava_callback - DEBUG - Processing node 69be594f448e074b3ffe16f9: baseline-arm-clabbe 2026-03-23 08:39:53,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be594f448e074b3ffe16f9 2026-03-23 08:39:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be594f448e074b3ffe16f9 HTTP/1.1" 200 None 2026-03-23 08:39:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:53,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:53,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:53,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be594f448e074b3ffe16f9 HTTP/1.1" 200 None 2026-03-23 08:39:53,543 - lava_callback - ERROR - Error processing callback for node 69be594f448e074b3ffe16f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:54,135 - lava_callback - INFO - Received callback for node 69be5953448e074b3ffe1706 INFO: 172.21.0.1:34754 - "POST /node/69be5953448e074b3ffe1706 HTTP/1.0" 202 Accepted 2026-03-23 08:39:54,144 - lava_callback - INFO - Starting async job submit for node 69be5953448e074b3ffe1706 2026-03-23 08:39:54,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5953448e074b3ffe1706 HTTP/1.1" 200 None 2026-03-23 08:39:54,164 - lava_callback - DEBUG - Processing node 69be5953448e074b3ffe1706: baseline-arm-clabbe 2026-03-23 08:39:54,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5953448e074b3ffe1706 2026-03-23 08:39:54,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5953448e074b3ffe1706 HTTP/1.1" 200 None 2026-03-23 08:39:54,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:54,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5953448e074b3ffe1706 HTTP/1.1" 200 None 2026-03-23 08:39:54,227 - lava_callback - ERROR - Error processing callback for node 69be5953448e074b3ffe1706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:39:54,827 - lava_callback - INFO - Received callback for node 69be5954448e074b3ffe170a INFO: 172.21.0.1:34770 - "POST /node/69be5954448e074b3ffe170a HTTP/1.0" 202 Accepted 2026-03-23 08:39:54,833 - lava_callback - INFO - Starting async job submit for node 69be5954448e074b3ffe170a 2026-03-23 08:39:54,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5954448e074b3ffe170a HTTP/1.1" 200 None 2026-03-23 08:39:54,856 - lava_callback - DEBUG - Processing node 69be5954448e074b3ffe170a: baseline-arm-clabbe 2026-03-23 08:39:54,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5954448e074b3ffe170a 2026-03-23 08:39:54,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5954448e074b3ffe170a HTTP/1.1" 200 None 2026-03-23 08:39:54,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:54,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:54,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5954448e074b3ffe170a HTTP/1.1" 200 None 2026-03-23 08:39:54,910 - lava_callback - ERROR - Error processing callback for node 69be5954448e074b3ffe170a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:55,508 - lava_callback - INFO - Received callback for node 69be5955448e074b3ffe170d INFO: 172.21.0.1:34778 - "POST /node/69be5955448e074b3ffe170d HTTP/1.0" 202 Accepted 2026-03-23 08:39:55,514 - lava_callback - INFO - Starting async job submit for node 69be5955448e074b3ffe170d 2026-03-23 08:39:55,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:55,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5955448e074b3ffe170d HTTP/1.1" 200 None 2026-03-23 08:39:55,543 - lava_callback - DEBUG - Processing node 69be5955448e074b3ffe170d: baseline-arm-clabbe 2026-03-23 08:39:55,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5955448e074b3ffe170d 2026-03-23 08:39:55,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:55,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5955448e074b3ffe170d HTTP/1.1" 200 None 2026-03-23 08:39:55,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:55,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:55,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:55,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5955448e074b3ffe170d HTTP/1.1" 200 None 2026-03-23 08:39:55,599 - lava_callback - ERROR - Error processing callback for node 69be5955448e074b3ffe170d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:39:56,175 - lava_callback - INFO - Received callback for node 69be5957448e074b3ffe1716 INFO: 172.21.0.1:34794 - "POST /node/69be5957448e074b3ffe1716 HTTP/1.0" 202 Accepted 2026-03-23 08:39:56,181 - lava_callback - INFO - Starting async job submit for node 69be5957448e074b3ffe1716 2026-03-23 08:39:56,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:56,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5957448e074b3ffe1716 HTTP/1.1" 200 None 2026-03-23 08:39:56,198 - lava_callback - DEBUG - Processing node 69be5957448e074b3ffe1716: baseline-arm-clabbe 2026-03-23 08:39:56,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5957448e074b3ffe1716 2026-03-23 08:39:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:56,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5957448e074b3ffe1716 HTTP/1.1" 200 None 2026-03-23 08:39:56,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:56,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 08:39:56,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:39:56,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5957448e074b3ffe1716 HTTP/1.1" 200 None 2026-03-23 08:39:56,254 - lava_callback - ERROR - Error processing callback for node 69be5957448e074b3ffe1716: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:41:03,264 - lava_callback - INFO - Received callback for node 69c0fc7dacdb2e26c83cd06e INFO: 172.21.0.1:54838 - "POST /node/69c0fc7dacdb2e26c83cd06e HTTP/1.0" 202 Accepted 2026-03-23 08:41:03,271 - lava_callback - INFO - Starting async job submit for node 69c0fc7dacdb2e26c83cd06e 2026-03-23 08:41:03,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:03,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7dacdb2e26c83cd06e HTTP/1.1" 200 None 2026-03-23 08:41:03,324 - lava_callback - DEBUG - Processing node 69c0fc7dacdb2e26c83cd06e: baseline-x86 2026-03-23 08:41:03,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:03,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:03,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7dacdb2e26c83cd06e/log.txt.gz 2026-03-23 08:41:04,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:04,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:04,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7dacdb2e26c83cd06e/lava-logs.yaml 2026-03-23 08:41:04,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:04,808 - lava_callback - INFO - Received callback for node 69c0fc80acdb2e26c83cd077 2026-03-23 08:41:04,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:04,821 - lava_callback - INFO - Starting async job submit for node 69c0fc80acdb2e26c83cd077 INFO: 172.21.0.1:54846 - "POST /node/69c0fc80acdb2e26c83cd077 HTTP/1.0" 202 Accepted 2026-03-23 08:41:04,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7dacdb2e26c83cd06e/lava_callback.json.gz 2026-03-23 08:41:04,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:04,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:04,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7dacdb2e26c83cd06e HTTP/1.1" 200 None 2026-03-23 08:41:04,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc80acdb2e26c83cd077 HTTP/1.1" 200 None 2026-03-23 08:41:04,895 - lava_callback - DEBUG - Processing node 69c0fc80acdb2e26c83cd077: baseline-x86 2026-03-23 08:41:04,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:04,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f74cacdb2e26c83cca4c HTTP/1.1" 200 None 2026-03-23 08:41:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:05,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fc7dacdb2e26c83cd06e HTTP/1.1" 200 None 2026-03-23 08:41:05,146 - lava_callback - INFO - Completed processing callback for node 69c0fc7dacdb2e26c83cd06e 2026-03-23 08:41:05,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:05,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:05,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc80acdb2e26c83cd077/log.txt.gz 2026-03-23 08:41:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:05,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:05,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc80acdb2e26c83cd077/lava-logs.yaml 2026-03-23 08:41:06,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:41:06,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:41:06,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc80acdb2e26c83cd077/lava_callback.json.gz 2026-03-23 08:41:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:06,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc80acdb2e26c83cd077 HTTP/1.1" 200 None 2026-03-23 08:41:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:06,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f74cacdb2e26c83cca4c HTTP/1.1" 200 None 2026-03-23 08:41:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:41:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fc80acdb2e26c83cd077 HTTP/1.1" 200 None 2026-03-23 08:41:06,539 - lava_callback - INFO - Completed processing callback for node 69c0fc80acdb2e26c83cd077 INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:41:29,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:41:29,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 08:42:16,491 - lava_callback - INFO - Received callback for node 69c0fc7facdb2e26c83cd074 INFO: 172.21.0.1:56858 - "POST /node/69c0fc7facdb2e26c83cd074 HTTP/1.0" 202 Accepted 2026-03-23 08:42:16,499 - lava_callback - INFO - Starting async job submit for node 69c0fc7facdb2e26c83cd074 2026-03-23 08:42:16,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:42:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7facdb2e26c83cd074 HTTP/1.1" 200 None 2026-03-23 08:42:16,561 - lava_callback - DEBUG - Processing node 69c0fc7facdb2e26c83cd074: baseline-x86 2026-03-23 08:42:16,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:42:18,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:18,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7facdb2e26c83cd074/log.txt.gz 2026-03-23 08:42:18,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:42:19,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:19,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7facdb2e26c83cd074/lava-logs.yaml 2026-03-23 08:42:19,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:42:21,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:21,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7facdb2e26c83cd074/lava_callback.json.gz 2026-03-23 08:42:21,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:21,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7facdb2e26c83cd074 HTTP/1.1" 200 None 2026-03-23 08:42:21,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:21,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f74cacdb2e26c83cca4c HTTP/1.1" 200 None 2026-03-23 08:42:21,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:21,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fc7facdb2e26c83cd074 HTTP/1.1" 200 None 2026-03-23 08:42:21,130 - lava_callback - INFO - Completed processing callback for node 69c0fc7facdb2e26c83cd074 2026-03-23 08:42:23,627 - lava_callback - INFO - Received callback for node 69c0fc7eacdb2e26c83cd071 INFO: 172.21.0.1:33228 - "POST /node/69c0fc7eacdb2e26c83cd071 HTTP/1.0" 202 Accepted 2026-03-23 08:42:23,637 - lava_callback - INFO - Starting async job submit for node 69c0fc7eacdb2e26c83cd071 2026-03-23 08:42:23,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:23,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7eacdb2e26c83cd071 HTTP/1.1" 200 None 2026-03-23 08:42:23,695 - lava_callback - DEBUG - Processing node 69c0fc7eacdb2e26c83cd071: baseline-x86 2026-03-23 08:42:24,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:42:25,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:25,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7eacdb2e26c83cd071/log.txt.gz 2026-03-23 08:42:25,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:42:26,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:26,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7eacdb2e26c83cd071/lava-logs.yaml 2026-03-23 08:42:26,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:42:27,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:42:27,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc7eacdb2e26c83cd071/lava_callback.json.gz 2026-03-23 08:42:27,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:27,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc7eacdb2e26c83cd071 HTTP/1.1" 200 None 2026-03-23 08:42:27,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:27,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f74cacdb2e26c83cca4c HTTP/1.1" 200 None 2026-03-23 08:42:27,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:28,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fc7eacdb2e26c83cd071 HTTP/1.1" 200 None 2026-03-23 08:42:28,018 - lava_callback - INFO - Completed processing callback for node 69c0fc7eacdb2e26c83cd071 2026-03-23 08:42:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:42:29,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:44:40,808 - lava_callback - INFO - Received callback for node 69be5a6c448e074b3ffe184a INFO: 172.21.0.1:60106 - "POST /node/69be5a6c448e074b3ffe184a HTTP/1.0" 202 Accepted 2026-03-23 08:44:40,817 - lava_callback - INFO - Starting async job submit for node 69be5a6c448e074b3ffe184a 2026-03-23 08:44:40,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:44:40,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5a6c448e074b3ffe184a HTTP/1.1" 200 None 2026-03-23 08:44:40,837 - lava_callback - DEBUG - Processing node 69be5a6c448e074b3ffe184a: baseline-arm-baylibre 2026-03-23 08:44:40,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5a6c448e074b3ffe184a 2026-03-23 08:44:40,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:44:40,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5a6c448e074b3ffe184a HTTP/1.1" 200 None 2026-03-23 08:44:40,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:44:40,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:44:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:44:40,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5a6c448e074b3ffe184a HTTP/1.1" 200 None 2026-03-23 08:44:40,913 - lava_callback - ERROR - Error processing callback for node 69be5a6c448e074b3ffe184a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:45:20,654 - lava_callback - INFO - Received callback for node 69be5a93448e074b3ffe1874 INFO: 172.21.0.1:37568 - "POST /node/69be5a93448e074b3ffe1874 HTTP/1.0" 202 Accepted 2026-03-23 08:45:20,663 - lava_callback - INFO - Starting async job submit for node 69be5a93448e074b3ffe1874 2026-03-23 08:45:20,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:20,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5a93448e074b3ffe1874 HTTP/1.1" 200 None 2026-03-23 08:45:20,682 - lava_callback - DEBUG - Processing node 69be5a93448e074b3ffe1874: baseline-arm-baylibre 2026-03-23 08:45:20,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5a93448e074b3ffe1874 2026-03-23 08:45:20,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:20,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5a93448e074b3ffe1874 HTTP/1.1" 200 None 2026-03-23 08:45:20,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:20,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:45:20,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5a93448e074b3ffe1874 HTTP/1.1" 200 None 2026-03-23 08:45:20,760 - lava_callback - ERROR - Error processing callback for node 69be5a93448e074b3ffe1874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:45:45,835 - lava_callback - INFO - Received callback for node 69c0fdaeacdb2e26c83cd0f8 INFO: 172.21.0.1:52814 - "POST /node/69c0fdaeacdb2e26c83cd0f8 HTTP/1.0" 202 Accepted 2026-03-23 08:45:45,845 - lava_callback - INFO - Starting async job submit for node 69c0fdaeacdb2e26c83cd0f8 2026-03-23 08:45:45,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:45,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdaeacdb2e26c83cd0f8 HTTP/1.1" 200 None 2026-03-23 08:45:45,876 - lava_callback - DEBUG - Processing node 69c0fdaeacdb2e26c83cd0f8: baseline-arm 2026-03-23 08:45:45,885 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:45:45,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52816 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:45:46,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:45:46,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdaeacdb2e26c83cd0f8/lava-logs.yaml 2026-03-23 08:45:46,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:45:48,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:45:48,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdaeacdb2e26c83cd0f8/lava_callback.json.gz 2026-03-23 08:45:48,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:48,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdaeacdb2e26c83cd0f8 HTTP/1.1" 200 None 2026-03-23 08:45:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:48,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:45:48,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:48,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdaeacdb2e26c83cd0f8 HTTP/1.1" 200 None 2026-03-23 08:45:48,203 - lava_callback - INFO - Completed processing callback for node 69c0fdaeacdb2e26c83cd0f8 INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:45:59,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:45:59,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:46:11,664 - lava_callback - INFO - Received callback for node 69c0fdb4acdb2e26c83cd105 INFO: 172.21.0.1:42890 - "POST /node/69c0fdb4acdb2e26c83cd105 HTTP/1.0" 202 Accepted 2026-03-23 08:46:11,724 - lava_callback - INFO - Starting async job submit for node 69c0fdb4acdb2e26c83cd105 2026-03-23 08:46:11,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:11,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb4acdb2e26c83cd105 HTTP/1.1" 200 None 2026-03-23 08:46:11,789 - lava_callback - DEBUG - Processing node 69c0fdb4acdb2e26c83cd105: baseline-arm 2026-03-23 08:46:11,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:13,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:13,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb4acdb2e26c83cd105/log.txt.gz 2026-03-23 08:46:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:14,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:14,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb4acdb2e26c83cd105/lava-logs.yaml 2026-03-23 08:46:14,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42900 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 08:46:15,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:15,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb4acdb2e26c83cd105/lava_callback.json.gz 2026-03-23 08:46:15,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:15,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb4acdb2e26c83cd105 HTTP/1.1" 200 None 2026-03-23 08:46:15,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:15,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:46:15,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:15,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdb4acdb2e26c83cd105 HTTP/1.1" 200 None 2026-03-23 08:46:15,998 - lava_callback - INFO - Completed processing callback for node 69c0fdb4acdb2e26c83cd105 INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:46:29,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:29,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:46:56,075 - lava_callback - INFO - Received callback for node 69c0fdacacdb2e26c83cd0f3 INFO: 172.21.0.1:51124 - "POST /node/69c0fdacacdb2e26c83cd0f3 HTTP/1.0" 202 Accepted 2026-03-23 08:46:56,084 - lava_callback - INFO - Starting async job submit for node 69c0fdacacdb2e26c83cd0f3 2026-03-23 08:46:56,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:56,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdacacdb2e26c83cd0f3 HTTP/1.1" 200 None 2026-03-23 08:46:56,153 - lava_callback - DEBUG - Processing node 69c0fdacacdb2e26c83cd0f3: baseline-arm 2026-03-23 08:46:56,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:46:56,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:56,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdacacdb2e26c83cd0f3/log.txt.gz 2026-03-23 08:46:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:57,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:57,066 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdacacdb2e26c83cd0f3/lava-logs.yaml 2026-03-23 08:46:57,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:57,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:57,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdacacdb2e26c83cd0f3/lava_callback.json.gz 2026-03-23 08:46:57,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:57,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdacacdb2e26c83cd0f3 HTTP/1.1" 200 None 2026-03-23 08:46:57,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:57,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:46:57,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:57,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdacacdb2e26c83cd0f3 HTTP/1.1" 200 None 2026-03-23 08:46:57,606 - lava_callback - INFO - Completed processing callback for node 69c0fdacacdb2e26c83cd0f3 2026-03-23 08:46:58,049 - lava_callback - INFO - Received callback for node 69c0fdafacdb2e26c83cd0fb INFO: 172.21.0.1:51134 - "POST /node/69c0fdafacdb2e26c83cd0fb HTTP/1.0" 202 Accepted 2026-03-23 08:46:58,101 - lava_callback - INFO - Starting async job submit for node 69c0fdafacdb2e26c83cd0fb 2026-03-23 08:46:58,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:58,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdafacdb2e26c83cd0fb HTTP/1.1" 200 None 2026-03-23 08:46:58,182 - lava_callback - DEBUG - Processing node 69c0fdafacdb2e26c83cd0fb: baseline-arm 2026-03-23 08:46:58,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:58,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:58,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdafacdb2e26c83cd0fb/log.txt.gz 2026-03-23 08:46:58,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:59,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:59,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdafacdb2e26c83cd0fb/lava-logs.yaml 2026-03-23 08:46:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:46:59,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:46:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:59,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdafacdb2e26c83cd0fb/lava_callback.json.gz 2026-03-23 08:46:59,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:59,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdafacdb2e26c83cd0fb HTTP/1.1" 200 None 2026-03-23 08:46:59,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:46:59,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:59,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:46:59,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:46:59,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdafacdb2e26c83cd0fb HTTP/1.1" 200 None 2026-03-23 08:46:59,375 - lava_callback - INFO - Completed processing callback for node 69c0fdafacdb2e26c83cd0fb INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:47:06,944 - lava_callback - INFO - Received callback for node 69c0fdb2acdb2e26c83cd102 INFO: 172.21.0.1:33896 - "POST /node/69c0fdb2acdb2e26c83cd102 HTTP/1.0" 202 Accepted 2026-03-23 08:47:06,952 - lava_callback - INFO - Starting async job submit for node 69c0fdb2acdb2e26c83cd102 2026-03-23 08:47:06,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb2acdb2e26c83cd102 HTTP/1.1" 200 None 2026-03-23 08:47:07,011 - lava_callback - DEBUG - Processing node 69c0fdb2acdb2e26c83cd102: baseline-arm 2026-03-23 08:47:07,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:07,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:07,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb2acdb2e26c83cd102/log.txt.gz 2026-03-23 08:47:07,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:08,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:08,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb2acdb2e26c83cd102/lava-logs.yaml 2026-03-23 08:47:08,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:08,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:08,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb2acdb2e26c83cd102/lava_callback.json.gz 2026-03-23 08:47:08,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:08,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb2acdb2e26c83cd102 HTTP/1.1" 200 None 2026-03-23 08:47:08,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:08,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:47:08,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:08,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdb2acdb2e26c83cd102 HTTP/1.1" 200 None 2026-03-23 08:47:08,799 - lava_callback - INFO - Completed processing callback for node 69c0fdb2acdb2e26c83cd102 INFO: 172.21.0.1:38940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:47:20,833 - lava_callback - INFO - Received callback for node 69be5b04448e074b3ffe18bc INFO: 172.21.0.1:39716 - "POST /node/69be5b04448e074b3ffe18bc HTTP/1.0" 202 Accepted 2026-03-23 08:47:20,842 - lava_callback - INFO - Starting async job submit for node 69be5b04448e074b3ffe18bc 2026-03-23 08:47:20,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:20,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b04448e074b3ffe18bc HTTP/1.1" 200 None 2026-03-23 08:47:20,861 - lava_callback - DEBUG - Processing node 69be5b04448e074b3ffe18bc: baseline-arm-baylibre 2026-03-23 08:47:20,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5b04448e074b3ffe18bc 2026-03-23 08:47:20,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:20,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b04448e074b3ffe18bc HTTP/1.1" 200 None 2026-03-23 08:47:20,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:20,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:47:20,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:20,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5b04448e074b3ffe18bc HTTP/1.1" 200 None 2026-03-23 08:47:20,939 - lava_callback - ERROR - Error processing callback for node 69be5b04448e074b3ffe18bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:47:29,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:29,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:47:33,787 - lava_callback - INFO - Received callback for node 69c0fdcdacdb2e26c83cd13a INFO: 172.21.0.1:50590 - "POST /node/69c0fdcdacdb2e26c83cd13a HTTP/1.0" 202 Accepted 2026-03-23 08:47:33,808 - lava_callback - INFO - Starting async job submit for node 69c0fdcdacdb2e26c83cd13a 2026-03-23 08:47:33,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:33,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcdacdb2e26c83cd13a HTTP/1.1" 200 None 2026-03-23 08:47:33,887 - lava_callback - DEBUG - Processing node 69c0fdcdacdb2e26c83cd13a: baseline-arm-broonie 2026-03-23 08:47:34,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:34,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:34,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcdacdb2e26c83cd13a/log.txt.gz 2026-03-23 08:47:34,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:35,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:35,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcdacdb2e26c83cd13a/lava-logs.yaml 2026-03-23 08:47:35,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:35,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:35,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcdacdb2e26c83cd13a/lava_callback.json.gz 2026-03-23 08:47:35,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:35,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcdacdb2e26c83cd13a HTTP/1.1" 200 None 2026-03-23 08:47:35,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:35,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:47:35,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:35,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdcdacdb2e26c83cd13a HTTP/1.1" 200 None 2026-03-23 08:47:35,854 - lava_callback - INFO - Completed processing callback for node 69c0fdcdacdb2e26c83cd13a 2026-03-23 08:47:36,407 - lava_callback - INFO - Received callback for node 69c0fdcfacdb2e26c83cd13d INFO: 172.21.0.1:50600 - "POST /node/69c0fdcfacdb2e26c83cd13d HTTP/1.0" 202 Accepted 2026-03-23 08:47:36,417 - lava_callback - INFO - Starting async job submit for node 69c0fdcfacdb2e26c83cd13d 2026-03-23 08:47:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:36,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcfacdb2e26c83cd13d HTTP/1.1" 200 None 2026-03-23 08:47:36,479 - lava_callback - DEBUG - Processing node 69c0fdcfacdb2e26c83cd13d: baseline-arm-broonie INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:47:36,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:37,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:37,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcfacdb2e26c83cd13d/log.txt.gz 2026-03-23 08:47:37,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:38,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:38,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcfacdb2e26c83cd13d/lava-logs.yaml 2026-03-23 08:47:38,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:47:38,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:47:38,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcfacdb2e26c83cd13d/lava_callback.json.gz 2026-03-23 08:47:38,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:38,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcfacdb2e26c83cd13d HTTP/1.1" 200 None 2026-03-23 08:47:38,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:38,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:47:38,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:38,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdcfacdb2e26c83cd13d HTTP/1.1" 200 None 2026-03-23 08:47:38,972 - lava_callback - INFO - Completed processing callback for node 69c0fdcfacdb2e26c83cd13d INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:47:59,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:47:59,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:48:00,202 - lava_callback - INFO - Received callback for node 69c0fdf6acdb2e26c83cd1ae INFO: 172.21.0.1:50000 - "POST /node/69c0fdf6acdb2e26c83cd1ae HTTP/1.0" 202 Accepted 2026-03-23 08:48:00,265 - lava_callback - INFO - Starting async job submit for node 69c0fdf6acdb2e26c83cd1ae 2026-03-23 08:48:00,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:00,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf6acdb2e26c83cd1ae HTTP/1.1" 200 None 2026-03-23 08:48:00,309 - lava_callback - DEBUG - Processing node 69c0fdf6acdb2e26c83cd1ae: baseline-arm-pengutronix 2026-03-23 08:48:00,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:00,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:00,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf6acdb2e26c83cd1ae/log.txt.gz 2026-03-23 08:48:00,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:00,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:00,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf6acdb2e26c83cd1ae/lava-logs.yaml 2026-03-23 08:48:00,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:01,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:01,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf6acdb2e26c83cd1ae/lava_callback.json.gz 2026-03-23 08:48:01,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:01,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf6acdb2e26c83cd1ae HTTP/1.1" 200 None 2026-03-23 08:48:01,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:01,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:48:01,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:01,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdf6acdb2e26c83cd1ae HTTP/1.1" 200 None 2026-03-23 08:48:01,382 - lava_callback - INFO - Completed processing callback for node 69c0fdf6acdb2e26c83cd1ae 2026-03-23 08:48:04,735 - lava_callback - INFO - Received callback for node 69c0fdd1acdb2e26c83cd140 INFO: 172.21.0.1:50012 - "POST /node/69c0fdd1acdb2e26c83cd140 HTTP/1.0" 202 Accepted 2026-03-23 08:48:04,745 - lava_callback - INFO - Starting async job submit for node 69c0fdd1acdb2e26c83cd140 2026-03-23 08:48:04,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:04,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdd1acdb2e26c83cd140 HTTP/1.1" 200 None 2026-03-23 08:48:04,793 - lava_callback - DEBUG - Processing node 69c0fdd1acdb2e26c83cd140: baseline-arm-broonie 2026-03-23 08:48:04,953 - lava_callback - INFO - Received callback for node 69c0fdf2acdb2e26c83cd192 INFO: 172.21.0.1:50016 - "POST /node/69c0fdf2acdb2e26c83cd192 HTTP/1.0" 202 Accepted 2026-03-23 08:48:04,969 - lava_callback - INFO - Starting async job submit for node 69c0fdf2acdb2e26c83cd192 2026-03-23 08:48:05,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:05,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf2acdb2e26c83cd192 HTTP/1.1" 200 None 2026-03-23 08:48:05,097 - lava_callback - DEBUG - Processing node 69c0fdf2acdb2e26c83cd192: baseline-arm-pengutronix 2026-03-23 08:48:05,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:05,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdd1acdb2e26c83cd140/log.txt.gz 2026-03-23 08:48:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:05,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf2acdb2e26c83cd192/log.txt.gz 2026-03-23 08:48:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:05,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdd1acdb2e26c83cd140/lava-logs.yaml 2026-03-23 08:48:05,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:05,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdd1acdb2e26c83cd140/lava_callback.json.gz 2026-03-23 08:48:05,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:05,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:05,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf2acdb2e26c83cd192/lava-logs.yaml 2026-03-23 08:48:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:05,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdd1acdb2e26c83cd140 HTTP/1.1" 200 None 2026-03-23 08:48:05,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:06,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:48:06,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:06,036 - lava_callback - INFO - Received callback for node 69c0fdddacdb2e26c83cd16a 2026-03-23 08:48:06,046 - lava_callback - INFO - Starting async job submit for node 69c0fdddacdb2e26c83cd16a INFO: 172.21.0.1:50026 - "POST /node/69c0fdddacdb2e26c83cd16a HTTP/1.0" 202 Accepted 2026-03-23 08:48:06,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdd1acdb2e26c83cd140 HTTP/1.1" 200 None 2026-03-23 08:48:06,082 - lava_callback - INFO - Completed processing callback for node 69c0fdd1acdb2e26c83cd140 2026-03-23 08:48:06,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:06,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdddacdb2e26c83cd16a HTTP/1.1" 200 None 2026-03-23 08:48:06,147 - lava_callback - DEBUG - Processing node 69c0fdddacdb2e26c83cd16a: baseline-arm-clabbe 2026-03-23 08:48:06,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:06,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf2acdb2e26c83cd192/lava_callback.json.gz 2026-03-23 08:48:06,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:06,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf2acdb2e26c83cd192 HTTP/1.1" 200 None 2026-03-23 08:48:06,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:06,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:48:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:48:06,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:06,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdf2acdb2e26c83cd192 HTTP/1.1" 200 None 2026-03-23 08:48:06,543 - lava_callback - INFO - Completed processing callback for node 69c0fdf2acdb2e26c83cd192 2026-03-23 08:48:06,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:06,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdddacdb2e26c83cd16a/log.txt.gz 2026-03-23 08:48:06,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:09,795 - lava_callback - INFO - Received callback for node 69c0fe2bacdb2e26c83cd226 INFO: 172.21.0.1:46814 - "POST /node/69c0fe2bacdb2e26c83cd226 HTTP/1.0" 202 Accepted 2026-03-23 08:48:09,806 - lava_callback - INFO - Starting async job submit for node 69c0fe2bacdb2e26c83cd226 2026-03-23 08:48:09,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:09,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2bacdb2e26c83cd226 HTTP/1.1" 200 None 2026-03-23 08:48:09,893 - lava_callback - DEBUG - Processing node 69c0fe2bacdb2e26c83cd226: baseline-arm64 2026-03-23 08:48:10,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:10,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:10,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2bacdb2e26c83cd226/log.txt.gz 2026-03-23 08:48:10,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:10,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:10,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2bacdb2e26c83cd226/lava-logs.yaml 2026-03-23 08:48:10,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:10,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:10,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2bacdb2e26c83cd226/lava_callback.json.gz 2026-03-23 08:48:10,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:10,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2bacdb2e26c83cd226 HTTP/1.1" 200 None 2026-03-23 08:48:10,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:10,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:48:10,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:10,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe2bacdb2e26c83cd226 HTTP/1.1" 200 None 2026-03-23 08:48:10,884 - lava_callback - INFO - Completed processing callback for node 69c0fe2bacdb2e26c83cd226 2026-03-23 08:48:11,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:11,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdddacdb2e26c83cd16a/lava-logs.yaml 2026-03-23 08:48:11,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:11,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:11,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdddacdb2e26c83cd16a/lava_callback.json.gz 2026-03-23 08:48:11,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdddacdb2e26c83cd16a HTTP/1.1" 200 None 2026-03-23 08:48:11,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:11,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:48:11,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:11,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdddacdb2e26c83cd16a HTTP/1.1" 200 None 2026-03-23 08:48:11,401 - lava_callback - INFO - Completed processing callback for node 69c0fdddacdb2e26c83cd16a INFO: 172.21.0.1:46826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:48:20,773 - lava_callback - INFO - Received callback for node 69be5b51448e074b3ffe18d6 INFO: 172.21.0.1:51566 - "POST /node/69be5b51448e074b3ffe18d6 HTTP/1.0" 202 Accepted 2026-03-23 08:48:20,779 - lava_callback - INFO - Starting async job submit for node 69be5b51448e074b3ffe18d6 2026-03-23 08:48:20,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:20,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b51448e074b3ffe18d6 HTTP/1.1" 200 None 2026-03-23 08:48:20,806 - lava_callback - DEBUG - Processing node 69be5b51448e074b3ffe18d6: baseline-arm-baylibre 2026-03-23 08:48:20,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5b51448e074b3ffe18d6 2026-03-23 08:48:20,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:20,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b51448e074b3ffe18d6 HTTP/1.1" 200 None 2026-03-23 08:48:20,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:20,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:48:20,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:20,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5b51448e074b3ffe18d6 HTTP/1.1" 200 None 2026-03-23 08:48:20,869 - lava_callback - ERROR - Error processing callback for node 69be5b51448e074b3ffe18d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:48:24,988 - lava_callback - INFO - Received callback for node 69c0fdcaacdb2e26c83cd137 INFO: 172.21.0.1:51570 - "POST /node/69c0fdcaacdb2e26c83cd137 HTTP/1.0" 202 Accepted 2026-03-23 08:48:24,994 - lava_callback - INFO - Starting async job submit for node 69c0fdcaacdb2e26c83cd137 2026-03-23 08:48:25,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:25,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcaacdb2e26c83cd137 HTTP/1.1" 200 None 2026-03-23 08:48:25,035 - lava_callback - DEBUG - Processing node 69c0fdcaacdb2e26c83cd137: baseline-arm-broonie 2026-03-23 08:48:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:25,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:25,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcaacdb2e26c83cd137/log.txt.gz 2026-03-23 08:48:25,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:48:27,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:27,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcaacdb2e26c83cd137/lava-logs.yaml 2026-03-23 08:48:27,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:27,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:27,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c0fdcaacdb2e26c83cd137/lava_callback.json.gz 2026-03-23 08:48:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:27,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdcaacdb2e26c83cd137 HTTP/1.1" 200 None 2026-03-23 08:48:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:27,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:48:27,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:27,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdcaacdb2e26c83cd137 HTTP/1.1" 200 None 2026-03-23 08:48:27,343 - lava_callback - INFO - Completed processing callback for node 69c0fdcaacdb2e26c83cd137 2026-03-23 08:48:29,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:29,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:48:30,910 - lava_callback - INFO - Received callback for node 69c0fe4aacdb2e26c83cd2a3 INFO: 172.21.0.1:53980 - "POST /node/69c0fe4aacdb2e26c83cd2a3 HTTP/1.0" 202 Accepted 2026-03-23 08:48:30,926 - lava_callback - INFO - Starting async job submit for node 69c0fe4aacdb2e26c83cd2a3 2026-03-23 08:48:30,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:30,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4aacdb2e26c83cd2a3 HTTP/1.1" 200 None 2026-03-23 08:48:30,977 - lava_callback - DEBUG - Processing node 69c0fe4aacdb2e26c83cd2a3: baseline-nfs-arm64 2026-03-23 08:48:30,979 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:48:30,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:31,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:31,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4aacdb2e26c83cd2a3/lava-logs.yaml 2026-03-23 08:48:31,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:31,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:31,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4aacdb2e26c83cd2a3/lava_callback.json.gz 2026-03-23 08:48:31,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:31,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4aacdb2e26c83cd2a3 HTTP/1.1" 200 None 2026-03-23 08:48:31,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:31,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:48:31,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:31,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe4aacdb2e26c83cd2a3 HTTP/1.1" 200 None 2026-03-23 08:48:31,326 - lava_callback - INFO - Completed processing callback for node 69c0fe4aacdb2e26c83cd2a3 INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:48:37,696 - lava_callback - INFO - Received callback for node 69c0fe2facdb2e26c83cd232 INFO: 172.21.0.1:53994 - "POST /node/69c0fe2facdb2e26c83cd232 HTTP/1.0" 202 Accepted 2026-03-23 08:48:37,703 - lava_callback - INFO - Starting async job submit for node 69c0fe2facdb2e26c83cd232 2026-03-23 08:48:37,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:37,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2facdb2e26c83cd232 HTTP/1.1" 200 None 2026-03-23 08:48:37,766 - lava_callback - DEBUG - Processing node 69c0fe2facdb2e26c83cd232: baseline-arm64 2026-03-23 08:48:37,909 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:48:37,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:38,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:38,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2facdb2e26c83cd232/lava-logs.yaml 2026-03-23 08:48:38,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:38,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:38,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2facdb2e26c83cd232/lava_callback.json.gz 2026-03-23 08:48:38,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:38,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2facdb2e26c83cd232 HTTP/1.1" 200 None 2026-03-23 08:48:38,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:38,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:48:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:38,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe2facdb2e26c83cd232 HTTP/1.1" 200 None 2026-03-23 08:48:38,548 - lava_callback - INFO - Completed processing callback for node 69c0fe2facdb2e26c83cd232 2026-03-23 08:48:39,973 - lava_callback - INFO - Received callback for node 69c0fe2dacdb2e26c83cd22c INFO: 172.21.0.1:42270 - "POST /node/69c0fe2dacdb2e26c83cd22c HTTP/1.0" 202 Accepted 2026-03-23 08:48:39,981 - lava_callback - INFO - Starting async job submit for node 69c0fe2dacdb2e26c83cd22c 2026-03-23 08:48:40,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:40,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2dacdb2e26c83cd22c HTTP/1.1" 200 None 2026-03-23 08:48:40,023 - lava_callback - DEBUG - Processing node 69c0fe2dacdb2e26c83cd22c: baseline-arm64 2026-03-23 08:48:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:40,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:40,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2dacdb2e26c83cd22c/log.txt.gz 2026-03-23 08:48:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:40,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:40,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2dacdb2e26c83cd22c/lava-logs.yaml 2026-03-23 08:48:40,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:41,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:41,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2dacdb2e26c83cd22c/lava_callback.json.gz 2026-03-23 08:48:41,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:41,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2dacdb2e26c83cd22c HTTP/1.1" 200 None 2026-03-23 08:48:41,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:41,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:48:41,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:41,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe2dacdb2e26c83cd22c HTTP/1.1" 200 None 2026-03-23 08:48:41,161 - lava_callback - INFO - Completed processing callback for node 69c0fe2dacdb2e26c83cd22c 2026-03-23 08:48:42,915 - lava_callback - INFO - Received callback for node 69c0fe39acdb2e26c83cd263 INFO: 172.21.0.1:42284 - "POST /node/69c0fe39acdb2e26c83cd263 HTTP/1.0" 202 Accepted 2026-03-23 08:48:42,921 - lava_callback - INFO - Starting async job submit for node 69c0fe39acdb2e26c83cd263 2026-03-23 08:48:42,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:42,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe39acdb2e26c83cd263 HTTP/1.1" 200 None 2026-03-23 08:48:42,956 - lava_callback - DEBUG - Processing node 69c0fe39acdb2e26c83cd263: baseline-arm64 2026-03-23 08:48:43,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:43,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:43,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe39acdb2e26c83cd263/log.txt.gz 2026-03-23 08:48:43,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:43,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:43,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe39acdb2e26c83cd263/lava-logs.yaml 2026-03-23 08:48:43,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:48:43,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:48:43,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe39acdb2e26c83cd263/lava_callback.json.gz 2026-03-23 08:48:43,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:43,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe39acdb2e26c83cd263 HTTP/1.1" 200 None 2026-03-23 08:48:43,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:43,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:48:43,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:43,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe39acdb2e26c83cd263 HTTP/1.1" 200 None 2026-03-23 08:48:43,880 - lava_callback - INFO - Completed processing callback for node 69c0fe39acdb2e26c83cd263 INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:48:59,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:48:59,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:49:03,583 - lava_callback - INFO - Received callback for node 69c0fdf3acdb2e26c83cd195 INFO: 172.21.0.1:53694 - "POST /node/69c0fdf3acdb2e26c83cd195 HTTP/1.0" 202 Accepted 2026-03-23 08:49:03,595 - lava_callback - INFO - Starting async job submit for node 69c0fdf3acdb2e26c83cd195 2026-03-23 08:49:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:03,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf3acdb2e26c83cd195 HTTP/1.1" 200 None 2026-03-23 08:49:03,655 - lava_callback - DEBUG - Processing node 69c0fdf3acdb2e26c83cd195: baseline-arm-pengutronix 2026-03-23 08:49:03,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:04,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:04,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf3acdb2e26c83cd195/log.txt.gz 2026-03-23 08:49:04,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:04,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:04,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf3acdb2e26c83cd195/lava-logs.yaml 2026-03-23 08:49:04,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:04,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:04,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf3acdb2e26c83cd195/lava_callback.json.gz 2026-03-23 08:49:04,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:04,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf3acdb2e26c83cd195 HTTP/1.1" 200 None 2026-03-23 08:49:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:04,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:49:04,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:04,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdf3acdb2e26c83cd195 HTTP/1.1" 200 None 2026-03-23 08:49:04,728 - lava_callback - INFO - Completed processing callback for node 69c0fdf3acdb2e26c83cd195 2026-03-23 08:49:05,668 - lava_callback - INFO - Received callback for node 69c0fe35acdb2e26c83cd25a INFO: 172.21.0.1:53698 - "POST /node/69c0fe35acdb2e26c83cd25a HTTP/1.0" 202 Accepted 2026-03-23 08:49:05,680 - lava_callback - INFO - Starting async job submit for node 69c0fe35acdb2e26c83cd25a 2026-03-23 08:49:05,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:05,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe35acdb2e26c83cd25a HTTP/1.1" 200 None 2026-03-23 08:49:05,731 - lava_callback - DEBUG - Processing node 69c0fe35acdb2e26c83cd25a: baseline-arm64 2026-03-23 08:49:06,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:06,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:06,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe35acdb2e26c83cd25a/log.txt.gz INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:06,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:07,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:07,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe35acdb2e26c83cd25a/lava-logs.yaml 2026-03-23 08:49:07,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:07,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:07,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe35acdb2e26c83cd25a/lava_callback.json.gz 2026-03-23 08:49:07,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:07,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe35acdb2e26c83cd25a HTTP/1.1" 200 None 2026-03-23 08:49:07,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:07,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:07,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:07,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe35acdb2e26c83cd25a HTTP/1.1" 200 None 2026-03-23 08:49:07,251 - lava_callback - INFO - Completed processing callback for node 69c0fe35acdb2e26c83cd25a 2026-03-23 08:49:08,481 - lava_callback - INFO - Received callback for node 69c0fe6eacdb2e26c83cd350 INFO: 172.21.0.1:53728 - "POST /node/69c0fe6eacdb2e26c83cd350 HTTP/1.0" 202 Accepted 2026-03-23 08:49:08,487 - lava_callback - INFO - Starting async job submit for node 69c0fe6eacdb2e26c83cd350 2026-03-23 08:49:08,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe6eacdb2e26c83cd350 HTTP/1.1" 200 None 2026-03-23 08:49:08,514 - lava_callback - DEBUG - Processing node 69c0fe6eacdb2e26c83cd350: baseline-arm 2026-03-23 08:49:08,522 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:49:08,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:08,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:08,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fe6eacdb2e26c83cd350/lava-logs.yaml 2026-03-23 08:49:08,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:08,876 - lava_callback - INFO - Received callback for node 69c0fe2cacdb2e26c83cd229 INFO: 172.21.0.1:53730 - "POST /node/69c0fe2cacdb2e26c83cd229 HTTP/1.0" 202 Accepted 2026-03-23 08:49:08,885 - lava_callback - INFO - Starting async job submit for node 69c0fe2cacdb2e26c83cd229 2026-03-23 08:49:08,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:08,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:08,917 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fe6eacdb2e26c83cd350/lava_callback.json.gz 2026-03-23 08:49:08,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:08,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe6eacdb2e26c83cd350 HTTP/1.1" 200 None 2026-03-23 08:49:08,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2cacdb2e26c83cd229 HTTP/1.1" 200 None 2026-03-23 08:49:08,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:08,951 - lava_callback - DEBUG - Processing node 69c0fe2cacdb2e26c83cd229: baseline-arm64 2026-03-23 08:49:09,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:49:09,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:09,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe6eacdb2e26c83cd350 HTTP/1.1" 200 None 2026-03-23 08:49:09,174 - lava_callback - INFO - Completed processing callback for node 69c0fe6eacdb2e26c83cd350 2026-03-23 08:49:09,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:09,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:09,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2cacdb2e26c83cd229/log.txt.gz 2026-03-23 08:49:09,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:09,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:09,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2cacdb2e26c83cd229/lava-logs.yaml 2026-03-23 08:49:09,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:10,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:10,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2cacdb2e26c83cd229/lava_callback.json.gz 2026-03-23 08:49:10,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:10,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2cacdb2e26c83cd229 HTTP/1.1" 200 None 2026-03-23 08:49:10,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:10,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:10,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:10,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe2cacdb2e26c83cd229 HTTP/1.1" 200 None 2026-03-23 08:49:10,107 - lava_callback - INFO - Completed processing callback for node 69c0fe2cacdb2e26c83cd229 2026-03-23 08:49:12,422 - lava_callback - INFO - Received callback for node 69c0fe3bacdb2e26c83cd266 INFO: 172.21.0.1:38520 - "POST /node/69c0fe3bacdb2e26c83cd266 HTTP/1.0" 202 Accepted 2026-03-23 08:49:12,432 - lava_callback - INFO - Starting async job submit for node 69c0fe3bacdb2e26c83cd266 2026-03-23 08:49:12,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:12,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3bacdb2e26c83cd266 HTTP/1.1" 200 None 2026-03-23 08:49:12,497 - lava_callback - DEBUG - Processing node 69c0fe3bacdb2e26c83cd266: baseline-arm64 2026-03-23 08:49:12,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:13,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:13,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3bacdb2e26c83cd266/log.txt.gz 2026-03-23 08:49:13,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:13,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:13,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3bacdb2e26c83cd266/lava-logs.yaml 2026-03-23 08:49:13,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:13,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:13,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3bacdb2e26c83cd266/lava_callback.json.gz 2026-03-23 08:49:13,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:13,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3bacdb2e26c83cd266 HTTP/1.1" 200 None 2026-03-23 08:49:13,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:13,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:13,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:13,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe3bacdb2e26c83cd266 HTTP/1.1" 200 None 2026-03-23 08:49:13,749 - lava_callback - INFO - Completed processing callback for node 69c0fe3bacdb2e26c83cd266 INFO: 172.21.0.1:38530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:16,557 - lava_callback - INFO - Received callback for node 69c0fe31acdb2e26c83cd235 INFO: 172.21.0.1:38556 - "POST /node/69c0fe31acdb2e26c83cd235 HTTP/1.0" 202 Accepted 2026-03-23 08:49:16,565 - lava_callback - INFO - Starting async job submit for node 69c0fe31acdb2e26c83cd235 2026-03-23 08:49:16,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe31acdb2e26c83cd235 HTTP/1.1" 200 None 2026-03-23 08:49:16,616 - lava_callback - DEBUG - Processing node 69c0fe31acdb2e26c83cd235: baseline-arm64 2026-03-23 08:49:16,832 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:49:16,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:17,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:17,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe31acdb2e26c83cd235/lava-logs.yaml 2026-03-23 08:49:17,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:17,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:17,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe31acdb2e26c83cd235/lava_callback.json.gz 2026-03-23 08:49:17,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:17,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe31acdb2e26c83cd235 HTTP/1.1" 200 None 2026-03-23 08:49:17,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:17,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:17,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:17,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe31acdb2e26c83cd235 HTTP/1.1" 200 None 2026-03-23 08:49:17,555 - lava_callback - INFO - Completed processing callback for node 69c0fe31acdb2e26c83cd235 2026-03-23 08:49:17,709 - lava_callback - INFO - Received callback for node 69c0fe34acdb2e26c83cd257 INFO: 172.21.0.1:38558 - "POST /node/69c0fe34acdb2e26c83cd257 HTTP/1.0" 202 Accepted 2026-03-23 08:49:17,716 - lava_callback - INFO - Starting async job submit for node 69c0fe34acdb2e26c83cd257 2026-03-23 08:49:17,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:17,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe34acdb2e26c83cd257 HTTP/1.1" 200 None 2026-03-23 08:49:17,756 - lava_callback - DEBUG - Processing node 69c0fe34acdb2e26c83cd257: baseline-arm64 2026-03-23 08:49:18,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:18,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:18,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe34acdb2e26c83cd257/log.txt.gz 2026-03-23 08:49:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:18,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:18,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe34acdb2e26c83cd257/lava-logs.yaml 2026-03-23 08:49:18,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:18,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:18,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe34acdb2e26c83cd257/lava_callback.json.gz 2026-03-23 08:49:19,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:19,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe34acdb2e26c83cd257 HTTP/1.1" 200 None 2026-03-23 08:49:19,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:19,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:19,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:19,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe34acdb2e26c83cd257 HTTP/1.1" 200 None 2026-03-23 08:49:19,094 - lava_callback - INFO - Completed processing callback for node 69c0fe34acdb2e26c83cd257 2026-03-23 08:49:20,359 - lava_callback - INFO - Received callback for node 69c0fe40acdb2e26c83cd279 INFO: 172.21.0.1:42680 - "POST /node/69c0fe40acdb2e26c83cd279 HTTP/1.0" 202 Accepted 2026-03-23 08:49:20,367 - lava_callback - INFO - Starting async job submit for node 69c0fe40acdb2e26c83cd279 2026-03-23 08:49:20,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:20,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe40acdb2e26c83cd279 HTTP/1.1" 200 None 2026-03-23 08:49:20,432 - lava_callback - DEBUG - Processing node 69c0fe40acdb2e26c83cd279: baseline-arm64 2026-03-23 08:49:20,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:20,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:20,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe40acdb2e26c83cd279/log.txt.gz 2026-03-23 08:49:21,196 - lava_callback - INFO - Received callback for node 69c0fe37acdb2e26c83cd25d INFO: 172.21.0.1:42694 - "POST /node/69c0fe37acdb2e26c83cd25d HTTP/1.0" 202 Accepted 2026-03-23 08:49:21,210 - lava_callback - INFO - Starting async job submit for node 69c0fe37acdb2e26c83cd25d 2026-03-23 08:49:21,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:21,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:21,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe37acdb2e26c83cd25d HTTP/1.1" 200 None 2026-03-23 08:49:21,303 - lava_callback - DEBUG - Processing node 69c0fe37acdb2e26c83cd25d: baseline-arm64 2026-03-23 08:49:21,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:21,745 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe40acdb2e26c83cd279/lava-logs.yaml 2026-03-23 08:49:21,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:21,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:21,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:21,927 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe37acdb2e26c83cd25d/log.txt.gz 2026-03-23 08:49:21,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:22,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe40acdb2e26c83cd279/lava_callback.json.gz 2026-03-23 08:49:22,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:22,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe40acdb2e26c83cd279 HTTP/1.1" 200 None 2026-03-23 08:49:22,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:22,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:22,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:22,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:22,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe40acdb2e26c83cd279 HTTP/1.1" 200 None 2026-03-23 08:49:22,286 - lava_callback - INFO - Completed processing callback for node 69c0fe40acdb2e26c83cd279 2026-03-23 08:49:22,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:22,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe37acdb2e26c83cd25d/lava-logs.yaml 2026-03-23 08:49:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:22,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:22,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe37acdb2e26c83cd25d/lava_callback.json.gz 2026-03-23 08:49:22,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:22,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe37acdb2e26c83cd25d HTTP/1.1" 200 None 2026-03-23 08:49:22,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:22,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:23,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe37acdb2e26c83cd25d HTTP/1.1" 200 None 2026-03-23 08:49:23,062 - lava_callback - INFO - Completed processing callback for node 69c0fe37acdb2e26c83cd25d 2026-03-23 08:49:23,673 - lava_callback - INFO - Received callback for node 69c0fe3eacdb2e26c83cd26c INFO: 172.21.0.1:42702 - "POST /node/69c0fe3eacdb2e26c83cd26c HTTP/1.0" 202 Accepted 2026-03-23 08:49:23,683 - lava_callback - INFO - Starting async job submit for node 69c0fe3eacdb2e26c83cd26c 2026-03-23 08:49:23,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:23,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3eacdb2e26c83cd26c HTTP/1.1" 200 None 2026-03-23 08:49:23,748 - lava_callback - DEBUG - Processing node 69c0fe3eacdb2e26c83cd26c: baseline-arm64 2026-03-23 08:49:24,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:24,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:24,309 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3eacdb2e26c83cd26c/log.txt.gz 2026-03-23 08:49:24,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:24,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:24,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3eacdb2e26c83cd26c/lava-logs.yaml 2026-03-23 08:49:24,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:25,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:25,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3eacdb2e26c83cd26c/lava_callback.json.gz 2026-03-23 08:49:25,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:25,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3eacdb2e26c83cd26c HTTP/1.1" 200 None 2026-03-23 08:49:25,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:25,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:25,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:25,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe3eacdb2e26c83cd26c HTTP/1.1" 200 None 2026-03-23 08:49:25,176 - lava_callback - INFO - Completed processing callback for node 69c0fe3eacdb2e26c83cd26c 2026-03-23 08:49:25,680 - lava_callback - INFO - Received callback for node 69c0fe38acdb2e26c83cd260 INFO: 172.21.0.1:42716 - "POST /node/69c0fe38acdb2e26c83cd260 HTTP/1.0" 202 Accepted 2026-03-23 08:49:25,688 - lava_callback - INFO - Starting async job submit for node 69c0fe38acdb2e26c83cd260 2026-03-23 08:49:25,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:25,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe38acdb2e26c83cd260 HTTP/1.1" 200 None 2026-03-23 08:49:25,744 - lava_callback - DEBUG - Processing node 69c0fe38acdb2e26c83cd260: baseline-arm64 2026-03-23 08:49:26,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:26,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:26,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe38acdb2e26c83cd260/log.txt.gz INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:26,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:27,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:27,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe38acdb2e26c83cd260/lava-logs.yaml 2026-03-23 08:49:27,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:27,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:27,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe38acdb2e26c83cd260/lava_callback.json.gz 2026-03-23 08:49:27,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:27,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe38acdb2e26c83cd260 HTTP/1.1" 200 None 2026-03-23 08:49:27,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:27,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:27,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe38acdb2e26c83cd260 HTTP/1.1" 200 None 2026-03-23 08:49:27,460 - lava_callback - INFO - Completed processing callback for node 69c0fe38acdb2e26c83cd260 2026-03-23 08:49:29,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:29,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:49:34,881 - lava_callback - INFO - Received callback for node 69c0fa05acdb2e26c83cd028 INFO: 172.21.0.1:54084 - "POST /node/69c0fa05acdb2e26c83cd028 HTTP/1.0" 202 Accepted 2026-03-23 08:49:34,890 - lava_callback - INFO - Starting async job submit for node 69c0fa05acdb2e26c83cd028 2026-03-23 08:49:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fa05acdb2e26c83cd028 HTTP/1.1" 200 None 2026-03-23 08:49:34,977 - lava_callback - DEBUG - Processing node 69c0fa05acdb2e26c83cd028: ltp-smoke 2026-03-23 08:49:35,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:35,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:35,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fa05acdb2e26c83cd028/log.txt.gz 2026-03-23 08:49:36,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:36,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:36,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fa05acdb2e26c83cd028/lava-logs.yaml 2026-03-23 08:49:36,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:36,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:36,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fa05acdb2e26c83cd028/lava_callback.json.gz 2026-03-23 08:49:36,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:36,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fa05acdb2e26c83cd028 HTTP/1.1" 200 None 2026-03-23 08:49:36,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:36,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f734acdb2e26c83cca26 HTTP/1.1" 200 None 2026-03-23 08:49:36,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:36,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fa05acdb2e26c83cd028 HTTP/1.1" 200 None 2026-03-23 08:49:36,982 - lava_callback - INFO - Completed processing callback for node 69c0fa05acdb2e26c83cd028 2026-03-23 08:49:40,941 - lava_callback - INFO - Received callback for node 69be5b9c448e074b3ffe190c INFO: 172.21.0.1:52384 - "POST /node/69be5b9c448e074b3ffe190c HTTP/1.0" 202 Accepted 2026-03-23 08:49:40,947 - lava_callback - INFO - Starting async job submit for node 69be5b9c448e074b3ffe190c 2026-03-23 08:49:40,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:40,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b9c448e074b3ffe190c HTTP/1.1" 200 None 2026-03-23 08:49:40,966 - lava_callback - DEBUG - Processing node 69be5b9c448e074b3ffe190c: baseline-arm-baylibre 2026-03-23 08:49:40,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5b9c448e074b3ffe190c 2026-03-23 08:49:40,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:40,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5b9c448e074b3ffe190c HTTP/1.1" 200 None 2026-03-23 08:49:40,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:40,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:49:40,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:41,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5b9c448e074b3ffe190c HTTP/1.1" 200 None 2026-03-23 08:49:41,044 - lava_callback - ERROR - Error processing callback for node 69be5b9c448e074b3ffe190c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:49:46,480 - lava_callback - INFO - Received callback for node 69c0fe45acdb2e26c83cd28b INFO: 172.21.0.1:52390 - "POST /node/69c0fe45acdb2e26c83cd28b HTTP/1.0" 202 Accepted 2026-03-23 08:49:46,492 - lava_callback - INFO - Starting async job submit for node 69c0fe45acdb2e26c83cd28b INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:46,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:46,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe45acdb2e26c83cd28b HTTP/1.1" 200 None 2026-03-23 08:49:46,545 - lava_callback - DEBUG - Processing node 69c0fe45acdb2e26c83cd28b: baseline-nfs-arm64 2026-03-23 08:49:46,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:47,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:47,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe45acdb2e26c83cd28b/log.txt.gz 2026-03-23 08:49:47,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:47,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:47,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe45acdb2e26c83cd28b/lava-logs.yaml 2026-03-23 08:49:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:47,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:47,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe45acdb2e26c83cd28b/lava_callback.json.gz 2026-03-23 08:49:47,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:47,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe45acdb2e26c83cd28b HTTP/1.1" 200 None 2026-03-23 08:49:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:47,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:47,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:47,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe45acdb2e26c83cd28b HTTP/1.1" 200 None 2026-03-23 08:49:47,928 - lava_callback - INFO - Completed processing callback for node 69c0fe45acdb2e26c83cd28b 2026-03-23 08:49:50,701 - lava_callback - INFO - Received callback for node 69c0fe78acdb2e26c83cd369 INFO: 172.21.0.1:58060 - "POST /node/69c0fe78acdb2e26c83cd369 HTTP/1.0" 202 Accepted 2026-03-23 08:49:50,711 - lava_callback - INFO - Starting async job submit for node 69c0fe78acdb2e26c83cd369 2026-03-23 08:49:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:50,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe78acdb2e26c83cd369 HTTP/1.1" 200 None 2026-03-23 08:49:50,760 - lava_callback - DEBUG - Processing node 69c0fe78acdb2e26c83cd369: baseline-arm64-foundriesio 2026-03-23 08:49:51,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:51,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:51,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe78acdb2e26c83cd369/log.txt.gz 2026-03-23 08:49:51,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:51,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:51,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe78acdb2e26c83cd369/lava-logs.yaml 2026-03-23 08:49:51,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:51,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:51,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe78acdb2e26c83cd369/lava_callback.json.gz 2026-03-23 08:49:51,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe78acdb2e26c83cd369 HTTP/1.1" 200 None 2026-03-23 08:49:51,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:52,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:52,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:52,040 - lava_callback - INFO - Received callback for node 69c0fe79acdb2e26c83cd36c INFO: 172.21.0.1:58076 - "POST /node/69c0fe79acdb2e26c83cd36c HTTP/1.0" 202 Accepted 2026-03-23 08:49:52,054 - lava_callback - INFO - Starting async job submit for node 69c0fe79acdb2e26c83cd36c 2026-03-23 08:49:52,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe78acdb2e26c83cd369 HTTP/1.1" 200 None 2026-03-23 08:49:52,070 - lava_callback - INFO - Completed processing callback for node 69c0fe78acdb2e26c83cd369 2026-03-23 08:49:52,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:52,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe79acdb2e26c83cd36c HTTP/1.1" 200 None 2026-03-23 08:49:52,180 - lava_callback - DEBUG - Processing node 69c0fe79acdb2e26c83cd36c: baseline-arm64-foundriesio 2026-03-23 08:49:52,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:52,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:52,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe79acdb2e26c83cd36c/log.txt.gz 2026-03-23 08:49:52,852 - lava_callback - INFO - Received callback for node 69c0fe4eacdb2e26c83cd2b3 INFO: 172.21.0.1:58082 - "POST /node/69c0fe4eacdb2e26c83cd2b3 HTTP/1.0" 202 Accepted 2026-03-23 08:49:52,874 - lava_callback - INFO - Starting async job submit for node 69c0fe4eacdb2e26c83cd2b3 2026-03-23 08:49:53,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:53,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4eacdb2e26c83cd2b3 HTTP/1.1" 200 None 2026-03-23 08:49:53,079 - lava_callback - DEBUG - Processing node 69c0fe4eacdb2e26c83cd2b3: baseline-nfs-arm64 2026-03-23 08:49:53,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:53,124 - lava_callback - INFO - Received callback for node 69c0fddfacdb2e26c83cd16e INFO: 172.21.0.1:58096 - "POST /node/69c0fddfacdb2e26c83cd16e HTTP/1.0" 202 Accepted 2026-03-23 08:49:53,134 - lava_callback - INFO - Starting async job submit for node 69c0fddfacdb2e26c83cd16e 2026-03-23 08:49:53,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:53,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fddfacdb2e26c83cd16e HTTP/1.1" 200 None 2026-03-23 08:49:53,299 - lava_callback - DEBUG - Processing node 69c0fddfacdb2e26c83cd16e: baseline-arm-clabbe 2026-03-23 08:49:53,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:53,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe79acdb2e26c83cd36c/lava-logs.yaml 2026-03-23 08:49:53,924 - lava_callback - INFO - Received callback for node 69c0fe49acdb2e26c83cd29c 2026-03-23 08:49:53,953 - lava_callback - INFO - Starting async job submit for node 69c0fe49acdb2e26c83cd29c INFO: 172.21.0.1:58098 - "POST /node/69c0fe49acdb2e26c83cd29c HTTP/1.0" 202 Accepted 2026-03-23 08:49:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:53,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:54,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:54,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:54,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe49acdb2e26c83cd29c HTTP/1.1" 200 None 2026-03-23 08:49:54,064 - lava_callback - DEBUG - Processing node 69c0fe49acdb2e26c83cd29c: baseline-nfs-arm64 2026-03-23 08:49:54,168 - lava_callback - INFO - Received callback for node 69c0fe65acdb2e26c83cd31b 2026-03-23 08:49:54,190 - lava_callback - INFO - Starting async job submit for node 69c0fe65acdb2e26c83cd31b INFO: 172.21.0.1:58106 - "POST /node/69c0fe65acdb2e26c83cd31b HTTP/1.0" 202 Accepted 2026-03-23 08:49:54,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:54,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe65acdb2e26c83cd31b HTTP/1.1" 200 None 2026-03-23 08:49:54,348 - lava_callback - DEBUG - Processing node 69c0fe65acdb2e26c83cd31b: baseline-arm64-broonie 2026-03-23 08:49:54,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:54,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fddfacdb2e26c83cd16e/log.txt.gz 2026-03-23 08:49:54,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:54,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:54,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4eacdb2e26c83cd2b3/log.txt.gz 2026-03-23 08:49:54,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c0fe79acdb2e26c83cd36c/lava_callback.json.gz 2026-03-23 08:49:54,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:55,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe79acdb2e26c83cd36c HTTP/1.1" 200 None 2026-03-23 08:49:55,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:55,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:55,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:55,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:55,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:55,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe79acdb2e26c83cd36c HTTP/1.1" 200 None 2026-03-23 08:49:55,557 - lava_callback - INFO - Completed processing callback for node 69c0fe79acdb2e26c83cd36c 2026-03-23 08:49:55,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:55,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:55,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe65acdb2e26c83cd31b/log.txt.gz 2026-03-23 08:49:56,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:56,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fddfacdb2e26c83cd16e/lava-logs.yaml 2026-03-23 08:49:56,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:56,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:56,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4eacdb2e26c83cd2b3/lava-logs.yaml 2026-03-23 08:49:56,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:56,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe49acdb2e26c83cd29c/log.txt.gz 2026-03-23 08:49:56,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:56,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:56,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:49:56,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fddfacdb2e26c83cd16e/lava_callback.json.gz 2026-03-23 08:49:56,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:56,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4eacdb2e26c83cd2b3/lava_callback.json.gz 2026-03-23 08:49:56,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:56,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe65acdb2e26c83cd31b/lava-logs.yaml 2026-03-23 08:49:56,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:56,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:56,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fddfacdb2e26c83cd16e HTTP/1.1" 200 None 2026-03-23 08:49:56,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4eacdb2e26c83cd2b3 HTTP/1.1" 200 None 2026-03-23 08:49:56,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:49:56,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:56,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:56,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fddfacdb2e26c83cd16e HTTP/1.1" 200 None 2026-03-23 08:49:56,814 - lava_callback - INFO - Completed processing callback for node 69c0fddfacdb2e26c83cd16e 2026-03-23 08:49:56,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe4eacdb2e26c83cd2b3 HTTP/1.1" 200 None 2026-03-23 08:49:56,870 - lava_callback - INFO - Completed processing callback for node 69c0fe4eacdb2e26c83cd2b3 2026-03-23 08:49:57,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:57,125 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe65acdb2e26c83cd31b/lava_callback.json.gz 2026-03-23 08:49:57,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:57,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe49acdb2e26c83cd29c/lava-logs.yaml 2026-03-23 08:49:57,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:49:57,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe65acdb2e26c83cd31b HTTP/1.1" 200 None 2026-03-23 08:49:57,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe65acdb2e26c83cd31b HTTP/1.1" 200 None 2026-03-23 08:49:57,264 - lava_callback - INFO - Completed processing callback for node 69c0fe65acdb2e26c83cd31b 2026-03-23 08:49:57,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:49:57,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe49acdb2e26c83cd29c/lava_callback.json.gz 2026-03-23 08:49:57,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe49acdb2e26c83cd29c HTTP/1.1" 200 None 2026-03-23 08:49:57,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:49:57,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:57,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe49acdb2e26c83cd29c HTTP/1.1" 200 None 2026-03-23 08:49:57,615 - lava_callback - INFO - Completed processing callback for node 69c0fe49acdb2e26c83cd29c 2026-03-23 08:49:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:49:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:50:00,988 - lava_callback - INFO - Received callback for node 69c0fe4cacdb2e26c83cd2ac INFO: 172.21.0.1:34604 - "POST /node/69c0fe4cacdb2e26c83cd2ac HTTP/1.0" 202 Accepted 2026-03-23 08:50:00,999 - lava_callback - INFO - Starting async job submit for node 69c0fe4cacdb2e26c83cd2ac 2026-03-23 08:50:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:01,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4cacdb2e26c83cd2ac HTTP/1.1" 200 None 2026-03-23 08:50:01,069 - lava_callback - DEBUG - Processing node 69c0fe4cacdb2e26c83cd2ac: baseline-nfs-arm64 2026-03-23 08:50:01,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:01,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:01,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4cacdb2e26c83cd2ac/log.txt.gz 2026-03-23 08:50:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:02,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:02,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4cacdb2e26c83cd2ac/lava-logs.yaml 2026-03-23 08:50:02,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:02,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:02,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4cacdb2e26c83cd2ac/lava_callback.json.gz 2026-03-23 08:50:02,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:02,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4cacdb2e26c83cd2ac HTTP/1.1" 200 None 2026-03-23 08:50:02,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:02,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:02,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:02,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe4cacdb2e26c83cd2ac HTTP/1.1" 200 None 2026-03-23 08:50:02,545 - lava_callback - INFO - Completed processing callback for node 69c0fe4cacdb2e26c83cd2ac INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:07,745 - lava_callback - INFO - Received callback for node 69c0fe50acdb2e26c83cd2ba INFO: 172.21.0.1:34618 - "POST /node/69c0fe50acdb2e26c83cd2ba HTTP/1.0" 202 Accepted 2026-03-23 08:50:07,755 - lava_callback - INFO - Starting async job submit for node 69c0fe50acdb2e26c83cd2ba 2026-03-23 08:50:07,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:07,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe50acdb2e26c83cd2ba HTTP/1.1" 200 None 2026-03-23 08:50:07,815 - lava_callback - DEBUG - Processing node 69c0fe50acdb2e26c83cd2ba: baseline-nfs-arm64 2026-03-23 08:50:08,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:08,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:08,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe50acdb2e26c83cd2ba/log.txt.gz 2026-03-23 08:50:08,737 - lava_callback - INFO - Received callback for node 69c0fe74acdb2e26c83cd360 INFO: 172.21.0.1:34634 - "POST /node/69c0fe74acdb2e26c83cd360 HTTP/1.0" 202 Accepted 2026-03-23 08:50:08,749 - lava_callback - INFO - Starting async job submit for node 69c0fe74acdb2e26c83cd360 2026-03-23 08:50:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:08,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:08,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe74acdb2e26c83cd360 HTTP/1.1" 200 None 2026-03-23 08:50:08,847 - lava_callback - DEBUG - Processing node 69c0fe74acdb2e26c83cd360: baseline-arm64-pengutronix 2026-03-23 08:50:09,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:09,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe50acdb2e26c83cd2ba/lava-logs.yaml 2026-03-23 08:50:09,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:09,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:09,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:09,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe74acdb2e26c83cd360/log.txt.gz 2026-03-23 08:50:09,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:09,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe50acdb2e26c83cd2ba/lava_callback.json.gz 2026-03-23 08:50:09,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:09,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe50acdb2e26c83cd2ba HTTP/1.1" 200 None 2026-03-23 08:50:09,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:09,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:09,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:09,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:09,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe50acdb2e26c83cd2ba HTTP/1.1" 200 None 2026-03-23 08:50:09,808 - lava_callback - INFO - Completed processing callback for node 69c0fe50acdb2e26c83cd2ba 2026-03-23 08:50:10,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:10,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe74acdb2e26c83cd360/lava-logs.yaml 2026-03-23 08:50:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:10,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:10,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe74acdb2e26c83cd360/lava_callback.json.gz 2026-03-23 08:50:10,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:10,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe74acdb2e26c83cd360 HTTP/1.1" 200 None 2026-03-23 08:50:10,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:10,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:10,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:10,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe74acdb2e26c83cd360 HTTP/1.1" 200 None 2026-03-23 08:50:10,339 - lava_callback - INFO - Completed processing callback for node 69c0fe74acdb2e26c83cd360 2026-03-23 08:50:10,629 - lava_callback - INFO - Received callback for node 69c0fe75acdb2e26c83cd363 INFO: 172.21.0.1:35402 - "POST /node/69c0fe75acdb2e26c83cd363 HTTP/1.0" 202 Accepted 2026-03-23 08:50:10,637 - lava_callback - INFO - Starting async job submit for node 69c0fe75acdb2e26c83cd363 2026-03-23 08:50:10,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:10,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe75acdb2e26c83cd363 HTTP/1.1" 200 None 2026-03-23 08:50:10,681 - lava_callback - DEBUG - Processing node 69c0fe75acdb2e26c83cd363: baseline-arm64-pengutronix 2026-03-23 08:50:10,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:11,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:11,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe75acdb2e26c83cd363/log.txt.gz 2026-03-23 08:50:11,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:11,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:11,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe75acdb2e26c83cd363/lava-logs.yaml 2026-03-23 08:50:11,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:11,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:11,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe75acdb2e26c83cd363/lava_callback.json.gz 2026-03-23 08:50:11,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe75acdb2e26c83cd363 HTTP/1.1" 200 None 2026-03-23 08:50:11,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:11,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:11,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:11,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe75acdb2e26c83cd363 HTTP/1.1" 200 None 2026-03-23 08:50:11,861 - lava_callback - INFO - Completed processing callback for node 69c0fe75acdb2e26c83cd363 2026-03-23 08:50:14,382 - lava_callback - INFO - Received callback for node 69c0fe5cacdb2e26c83cd2f5 INFO: 172.21.0.1:35408 - "POST /node/69c0fe5cacdb2e26c83cd2f5 HTTP/1.0" 202 Accepted 2026-03-23 08:50:14,390 - lava_callback - INFO - Starting async job submit for node 69c0fe5cacdb2e26c83cd2f5 2026-03-23 08:50:14,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:14,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5cacdb2e26c83cd2f5 HTTP/1.1" 200 None 2026-03-23 08:50:14,437 - lava_callback - DEBUG - Processing node 69c0fe5cacdb2e26c83cd2f5: baseline-arm64-broonie 2026-03-23 08:50:14,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:14,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:14,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5cacdb2e26c83cd2f5/log.txt.gz 2026-03-23 08:50:15,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35422 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 08:50:15,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:15,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5cacdb2e26c83cd2f5/lava-logs.yaml 2026-03-23 08:50:15,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:15,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:15,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5cacdb2e26c83cd2f5/lava_callback.json.gz 2026-03-23 08:50:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5cacdb2e26c83cd2f5 HTTP/1.1" 200 None 2026-03-23 08:50:15,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:15,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:15,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:15,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe5cacdb2e26c83cd2f5 HTTP/1.1" 200 None 2026-03-23 08:50:15,550 - lava_callback - INFO - Completed processing callback for node 69c0fe5cacdb2e26c83cd2f5 2026-03-23 08:50:16,433 - lava_callback - INFO - Received callback for node 69c0fe77acdb2e26c83cd366 INFO: 172.21.0.1:35424 - "POST /node/69c0fe77acdb2e26c83cd366 HTTP/1.0" 202 Accepted 2026-03-23 08:50:16,442 - lava_callback - INFO - Starting async job submit for node 69c0fe77acdb2e26c83cd366 2026-03-23 08:50:16,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:16,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe77acdb2e26c83cd366 HTTP/1.1" 200 None 2026-03-23 08:50:16,485 - lava_callback - DEBUG - Processing node 69c0fe77acdb2e26c83cd366: baseline-arm64-pengutronix INFO: 172.21.0.1:35428 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:16,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:16,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe77acdb2e26c83cd366/log.txt.gz 2026-03-23 08:50:17,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:17,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:17,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe77acdb2e26c83cd366/lava-logs.yaml 2026-03-23 08:50:17,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:17,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:17,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c0fe77acdb2e26c83cd366/lava_callback.json.gz 2026-03-23 08:50:17,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:17,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe77acdb2e26c83cd366 HTTP/1.1" 200 None 2026-03-23 08:50:17,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:17,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:17,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:17,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe77acdb2e26c83cd366 HTTP/1.1" 200 None 2026-03-23 08:50:17,562 - lava_callback - INFO - Completed processing callback for node 69c0fe77acdb2e26c83cd366 2026-03-23 08:50:18,089 - lava_callback - INFO - Received callback for node 69c0fe2eacdb2e26c83cd22f INFO: 172.21.0.1:35430 - "POST /node/69c0fe2eacdb2e26c83cd22f HTTP/1.0" 202 Accepted 2026-03-23 08:50:18,102 - lava_callback - INFO - Starting async job submit for node 69c0fe2eacdb2e26c83cd22f 2026-03-23 08:50:18,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:18,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2eacdb2e26c83cd22f HTTP/1.1" 200 None 2026-03-23 08:50:18,165 - lava_callback - DEBUG - Processing node 69c0fe2eacdb2e26c83cd22f: baseline-arm64 2026-03-23 08:50:18,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:18,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:18,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2eacdb2e26c83cd22f/log.txt.gz 2026-03-23 08:50:18,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:19,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:19,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2eacdb2e26c83cd22f/lava-logs.yaml 2026-03-23 08:50:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:19,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:19,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe2eacdb2e26c83cd22f/lava_callback.json.gz 2026-03-23 08:50:19,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:19,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe2eacdb2e26c83cd22f HTTP/1.1" 200 None 2026-03-23 08:50:19,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:19,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:19,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:19,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe2eacdb2e26c83cd22f HTTP/1.1" 200 None 2026-03-23 08:50:19,459 - lava_callback - INFO - Completed processing callback for node 69c0fe2eacdb2e26c83cd22f 2026-03-23 08:50:24,731 - lava_callback - INFO - Received callback for node 69c0fe69acdb2e26c83cd323 INFO: 172.21.0.1:36016 - "POST /node/69c0fe69acdb2e26c83cd323 HTTP/1.0" 202 Accepted 2026-03-23 08:50:24,737 - lava_callback - INFO - Starting async job submit for node 69c0fe69acdb2e26c83cd323 2026-03-23 08:50:24,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe69acdb2e26c83cd323 HTTP/1.1" 200 None 2026-03-23 08:50:24,801 - lava_callback - DEBUG - Processing node 69c0fe69acdb2e26c83cd323: baseline-arm64-broonie 2026-03-23 08:50:25,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:25,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:25,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe69acdb2e26c83cd323/log.txt.gz 2026-03-23 08:50:25,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:25,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:25,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe69acdb2e26c83cd323/lava-logs.yaml 2026-03-23 08:50:25,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:25,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:25,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe69acdb2e26c83cd323/lava_callback.json.gz 2026-03-23 08:50:25,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:25,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe69acdb2e26c83cd323 HTTP/1.1" 200 None 2026-03-23 08:50:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:25,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:25,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:26,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe69acdb2e26c83cd323 HTTP/1.1" 200 None 2026-03-23 08:50:26,023 - lava_callback - INFO - Completed processing callback for node 69c0fe69acdb2e26c83cd323 INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:29,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:29,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:50:33,760 - lava_callback - INFO - Received callback for node 69c0fe5facdb2e26c83cd30f INFO: 172.21.0.1:58886 - "POST /node/69c0fe5facdb2e26c83cd30f HTTP/1.0" 202 Accepted 2026-03-23 08:50:33,767 - lava_callback - INFO - Starting async job submit for node 69c0fe5facdb2e26c83cd30f 2026-03-23 08:50:33,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:33,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5facdb2e26c83cd30f HTTP/1.1" 200 None 2026-03-23 08:50:33,803 - lava_callback - DEBUG - Processing node 69c0fe5facdb2e26c83cd30f: baseline-arm64-broonie 2026-03-23 08:50:34,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:35,231 - lava_callback - INFO - Received callback for node 69c0fe6aacdb2e26c83cd32a INFO: 172.21.0.1:58898 - "POST /node/69c0fe6aacdb2e26c83cd32a HTTP/1.0" 202 Accepted 2026-03-23 08:50:35,246 - lava_callback - INFO - Starting async job submit for node 69c0fe6aacdb2e26c83cd32a 2026-03-23 08:50:35,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:35,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe6aacdb2e26c83cd32a HTTP/1.1" 200 None 2026-03-23 08:50:35,319 - lava_callback - DEBUG - Processing node 69c0fe6aacdb2e26c83cd32a: baseline-arm64-broonie 2026-03-23 08:50:35,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:35,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5facdb2e26c83cd30f/log.txt.gz 2026-03-23 08:50:36,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:36,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:36,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:36,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe6aacdb2e26c83cd32a/log.txt.gz 2026-03-23 08:50:36,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:36,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5facdb2e26c83cd30f/lava-logs.yaml 2026-03-23 08:50:36,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:36,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:36,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:36,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5facdb2e26c83cd30f/lava_callback.json.gz 2026-03-23 08:50:36,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:36,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5facdb2e26c83cd30f HTTP/1.1" 200 None 2026-03-23 08:50:36,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:36,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:36,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe6aacdb2e26c83cd32a/lava-logs.yaml 2026-03-23 08:50:36,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:36,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:36,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:36,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe5facdb2e26c83cd30f HTTP/1.1" 200 None 2026-03-23 08:50:36,880 - lava_callback - INFO - Completed processing callback for node 69c0fe5facdb2e26c83cd30f 2026-03-23 08:50:37,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:37,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe6aacdb2e26c83cd32a/lava_callback.json.gz 2026-03-23 08:50:37,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:37,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe6aacdb2e26c83cd32a HTTP/1.1" 200 None 2026-03-23 08:50:37,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:37,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:37,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:37,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe6aacdb2e26c83cd32a HTTP/1.1" 200 None 2026-03-23 08:50:37,321 - lava_callback - INFO - Completed processing callback for node 69c0fe6aacdb2e26c83cd32a 2026-03-23 08:50:44,989 - lava_callback - INFO - Received callback for node 69c0fe60acdb2e26c83cd312 INFO: 172.21.0.1:34932 - "POST /node/69c0fe60acdb2e26c83cd312 HTTP/1.0" 202 Accepted 2026-03-23 08:50:44,995 - lava_callback - INFO - Starting async job submit for node 69c0fe60acdb2e26c83cd312 2026-03-23 08:50:45,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:45,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe60acdb2e26c83cd312 HTTP/1.1" 200 None 2026-03-23 08:50:45,035 - lava_callback - DEBUG - Processing node 69c0fe60acdb2e26c83cd312: baseline-arm64-broonie 2026-03-23 08:50:45,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:45,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:45,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe60acdb2e26c83cd312/log.txt.gz 2026-03-23 08:50:45,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:45,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:45,996 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe60acdb2e26c83cd312/lava-logs.yaml 2026-03-23 08:50:46,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:46,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:46,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe60acdb2e26c83cd312/lava_callback.json.gz 2026-03-23 08:50:46,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:46,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe60acdb2e26c83cd312 HTTP/1.1" 200 None 2026-03-23 08:50:46,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:46,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:46,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:46,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe60acdb2e26c83cd312 HTTP/1.1" 200 None 2026-03-23 08:50:46,307 - lava_callback - INFO - Completed processing callback for node 69c0fe60acdb2e26c83cd312 INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:46,532 - lava_callback - INFO - Received callback for node 69c0fe66acdb2e26c83cd320 INFO: 172.21.0.1:34964 - "POST /node/69c0fe66acdb2e26c83cd320 HTTP/1.0" 202 Accepted 2026-03-23 08:50:46,543 - lava_callback - INFO - Starting async job submit for node 69c0fe66acdb2e26c83cd320 2026-03-23 08:50:46,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:46,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe66acdb2e26c83cd320 HTTP/1.1" 200 None 2026-03-23 08:50:46,622 - lava_callback - DEBUG - Processing node 69c0fe66acdb2e26c83cd320: baseline-arm64-broonie 2026-03-23 08:50:46,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:47,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:47,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe66acdb2e26c83cd320/log.txt.gz 2026-03-23 08:50:47,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:47,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:47,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe66acdb2e26c83cd320/lava-logs.yaml 2026-03-23 08:50:47,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:47,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:47,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe66acdb2e26c83cd320/lava_callback.json.gz 2026-03-23 08:50:47,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:47,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe66acdb2e26c83cd320 HTTP/1.1" 200 None 2026-03-23 08:50:47,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:47,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:50:47,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:47,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe66acdb2e26c83cd320 HTTP/1.1" 200 None 2026-03-23 08:50:47,869 - lava_callback - INFO - Completed processing callback for node 69c0fe66acdb2e26c83cd320 2026-03-23 08:50:54,107 - lava_callback - INFO - Received callback for node 69be5be8448e074b3ffe192b INFO: 172.21.0.1:60978 - "POST /node/69be5be8448e074b3ffe192b HTTP/1.0" 202 Accepted 2026-03-23 08:50:54,113 - lava_callback - INFO - Starting async job submit for node 69be5be8448e074b3ffe192b 2026-03-23 08:50:54,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:54,133 - lava_callback - INFO - Received callback for node 69c0fe0aacdb2e26c83cd1c6 INFO: 172.21.0.1:60982 - "POST /node/69c0fe0aacdb2e26c83cd1c6 HTTP/1.0" 202 Accepted 2026-03-23 08:50:54,140 - lava_callback - INFO - Starting async job submit for node 69c0fe0aacdb2e26c83cd1c6 2026-03-23 08:50:54,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5be8448e074b3ffe192b HTTP/1.1" 200 None 2026-03-23 08:50:54,152 - lava_callback - DEBUG - Processing node 69be5be8448e074b3ffe192b: baseline-arm-clabbe 2026-03-23 08:50:54,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5be8448e074b3ffe192b 2026-03-23 08:50:54,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:54,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:54,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5be8448e074b3ffe192b HTTP/1.1" 200 None 2026-03-23 08:50:54,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0aacdb2e26c83cd1c6 HTTP/1.1" 200 None 2026-03-23 08:50:54,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:54,188 - lava_callback - DEBUG - Processing node 69c0fe0aacdb2e26c83cd1c6: ltp-containers 2026-03-23 08:50:54,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:50:54,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:54,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5be8448e074b3ffe192b HTTP/1.1" 200 None 2026-03-23 08:50:54,425 - lava_callback - ERROR - Error processing callback for node 69be5be8448e074b3ffe192b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:54,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:54,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:54,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69c0fe0aacdb2e26c83cd1c6/log.txt.gz 2026-03-23 08:50:55,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:55,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:55,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69c0fe0aacdb2e26c83cd1c6/lava-logs.yaml 2026-03-23 08:50:55,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:50:55,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:50:55,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69c0fe0aacdb2e26c83cd1c6/lava_callback.json.gz 2026-03-23 08:50:55,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:55,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0aacdb2e26c83cd1c6 HTTP/1.1" 200 None 2026-03-23 08:50:55,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:55,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:50:55,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:55,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe0aacdb2e26c83cd1c6 HTTP/1.1" 200 None 2026-03-23 08:50:55,454 - lava_callback - INFO - Completed processing callback for node 69c0fe0aacdb2e26c83cd1c6 INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:50:59,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:50:59,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:51:04,825 - lava_callback - INFO - Received callback for node 69c0fe62acdb2e26c83cd315 INFO: 172.21.0.1:56210 - "POST /node/69c0fe62acdb2e26c83cd315 HTTP/1.0" 202 Accepted 2026-03-23 08:51:04,831 - lava_callback - INFO - Starting async job submit for node 69c0fe62acdb2e26c83cd315 2026-03-23 08:51:04,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:04,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe62acdb2e26c83cd315 HTTP/1.1" 200 None 2026-03-23 08:51:04,878 - lava_callback - DEBUG - Processing node 69c0fe62acdb2e26c83cd315: baseline-arm64-broonie 2026-03-23 08:51:05,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:05,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:05,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe62acdb2e26c83cd315/log.txt.gz 2026-03-23 08:51:05,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:05,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:05,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe62acdb2e26c83cd315/lava-logs.yaml 2026-03-23 08:51:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:05,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:05,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe62acdb2e26c83cd315/lava_callback.json.gz 2026-03-23 08:51:05,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:05,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe62acdb2e26c83cd315 HTTP/1.1" 200 None 2026-03-23 08:51:05,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:05,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:05,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:05,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe62acdb2e26c83cd315 HTTP/1.1" 200 None 2026-03-23 08:51:05,917 - lava_callback - INFO - Completed processing callback for node 69c0fe62acdb2e26c83cd315 INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:12,771 - lava_callback - INFO - Received callback for node 69c0fe11acdb2e26c83cd1d3 INFO: 172.21.0.1:42598 - "POST /node/69c0fe11acdb2e26c83cd1d3 HTTP/1.0" 202 Accepted 2026-03-23 08:51:12,778 - lava_callback - INFO - Starting async job submit for node 69c0fe11acdb2e26c83cd1d3 2026-03-23 08:51:12,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:12,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe11acdb2e26c83cd1d3 HTTP/1.1" 200 None 2026-03-23 08:51:12,818 - lava_callback - DEBUG - Processing node 69c0fe11acdb2e26c83cd1d3: ltp-dio 2026-03-23 08:51:13,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:13,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:13,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c0fe11acdb2e26c83cd1d3/log.txt.gz 2026-03-23 08:51:13,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:13,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:13,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c0fe11acdb2e26c83cd1d3/lava-logs.yaml 2026-03-23 08:51:13,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:13,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:13,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c0fe11acdb2e26c83cd1d3/lava_callback.json.gz 2026-03-23 08:51:14,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:14,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe11acdb2e26c83cd1d3 HTTP/1.1" 200 None 2026-03-23 08:51:14,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:14,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:51:14,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:14,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe11acdb2e26c83cd1d3 HTTP/1.1" 200 None 2026-03-23 08:51:14,079 - lava_callback - INFO - Completed processing callback for node 69c0fe11acdb2e26c83cd1d3 2026-03-23 08:51:14,966 - lava_callback - INFO - Received callback for node 69c0fe5dacdb2e26c83cd30a INFO: 172.21.0.1:42602 - "POST /node/69c0fe5dacdb2e26c83cd30a HTTP/1.0" 202 Accepted 2026-03-23 08:51:14,972 - lava_callback - INFO - Starting async job submit for node 69c0fe5dacdb2e26c83cd30a 2026-03-23 08:51:14,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5dacdb2e26c83cd30a HTTP/1.1" 200 None 2026-03-23 08:51:15,009 - lava_callback - DEBUG - Processing node 69c0fe5dacdb2e26c83cd30a: baseline-arm64-broonie INFO: 172.21.0.1:42618 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 08:51:15,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:15,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:15,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5dacdb2e26c83cd30a/log.txt.gz 2026-03-23 08:51:15,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:15,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:15,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5dacdb2e26c83cd30a/lava-logs.yaml 2026-03-23 08:51:15,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:15,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:15,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe5dacdb2e26c83cd30a/lava_callback.json.gz 2026-03-23 08:51:15,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:15,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe5dacdb2e26c83cd30a HTTP/1.1" 200 None 2026-03-23 08:51:15,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:15,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:15,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe5dacdb2e26c83cd30a HTTP/1.1" 200 None 2026-03-23 08:51:15,926 - lava_callback - INFO - Completed processing callback for node 69c0fe5dacdb2e26c83cd30a INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:24,916 - lava_callback - INFO - Received callback for node 69c0fe08acdb2e26c83cd1c3 INFO: 172.21.0.1:47400 - "POST /node/69c0fe08acdb2e26c83cd1c3 HTTP/1.0" 202 Accepted 2026-03-23 08:51:24,923 - lava_callback - INFO - Starting async job submit for node 69c0fe08acdb2e26c83cd1c3 2026-03-23 08:51:24,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:24,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe08acdb2e26c83cd1c3 HTTP/1.1" 200 None 2026-03-23 08:51:24,962 - lava_callback - DEBUG - Processing node 69c0fe08acdb2e26c83cd1c3: ltp-cap_bounds 2026-03-23 08:51:25,289 - lava_callback - INFO - Received callback for node 69c0fe32acdb2e26c83cd254 INFO: 172.21.0.1:47414 - "POST /node/69c0fe32acdb2e26c83cd254 HTTP/1.0" 202 Accepted 2026-03-23 08:51:25,321 - lava_callback - INFO - Starting async job submit for node 69c0fe32acdb2e26c83cd254 2026-03-23 08:51:25,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:25,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:25,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe32acdb2e26c83cd254 HTTP/1.1" 200 None 2026-03-23 08:51:25,379 - lava_callback - DEBUG - Processing node 69c0fe32acdb2e26c83cd254: baseline-arm64 2026-03-23 08:51:25,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:25,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c0fe08acdb2e26c83cd1c3/log.txt.gz 2026-03-23 08:51:25,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:25,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:26,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:26,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe32acdb2e26c83cd254/log.txt.gz 2026-03-23 08:51:26,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:26,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c0fe08acdb2e26c83cd1c3/lava-logs.yaml 2026-03-23 08:51:26,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:26,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:26,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c0fe08acdb2e26c83cd1c3/lava_callback.json.gz 2026-03-23 08:51:26,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:26,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe08acdb2e26c83cd1c3 HTTP/1.1" 200 None 2026-03-23 08:51:26,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:26,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:51:26,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:26,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:26,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe32acdb2e26c83cd254/lava-logs.yaml 2026-03-23 08:51:26,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:26,544 - lava_callback - INFO - Received callback for node 69c0fe0cacdb2e26c83cd1c9 INFO: 172.21.0.1:47440 - "POST /node/69c0fe0cacdb2e26c83cd1c9 HTTP/1.0" 202 Accepted 2026-03-23 08:51:26,552 - lava_callback - INFO - Starting async job submit for node 69c0fe0cacdb2e26c83cd1c9 2026-03-23 08:51:26,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe08acdb2e26c83cd1c3 HTTP/1.1" 200 None 2026-03-23 08:51:26,578 - lava_callback - INFO - Completed processing callback for node 69c0fe08acdb2e26c83cd1c3 2026-03-23 08:51:26,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:26,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0cacdb2e26c83cd1c9 HTTP/1.1" 200 None 2026-03-23 08:51:26,672 - lava_callback - DEBUG - Processing node 69c0fe0cacdb2e26c83cd1c9: ltp-controllers 2026-03-23 08:51:26,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:26,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe32acdb2e26c83cd254/lava_callback.json.gz 2026-03-23 08:51:26,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:27,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe32acdb2e26c83cd254 HTTP/1.1" 200 None 2026-03-23 08:51:27,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:27,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:27,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:27,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe32acdb2e26c83cd254 HTTP/1.1" 200 None 2026-03-23 08:51:27,258 - lava_callback - INFO - Completed processing callback for node 69c0fe32acdb2e26c83cd254 2026-03-23 08:51:27,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:27,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:27,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69c0fe0cacdb2e26c83cd1c9/log.txt.gz 2026-03-23 08:51:27,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:27,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:27,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69c0fe0cacdb2e26c83cd1c9/lava-logs.yaml 2026-03-23 08:51:27,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:28,133 - lava_callback - INFO - Received callback for node 69c0fe0facdb2e26c83cd1d0 INFO: 172.21.0.1:47442 - "POST /node/69c0fe0facdb2e26c83cd1d0 HTTP/1.0" 202 Accepted 2026-03-23 08:51:28,140 - lava_callback - INFO - Starting async job submit for node 69c0fe0facdb2e26c83cd1d0 2026-03-23 08:51:28,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:28,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:28,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69c0fe0cacdb2e26c83cd1c9/lava_callback.json.gz 2026-03-23 08:51:28,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:28,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0facdb2e26c83cd1d0 HTTP/1.1" 200 None 2026-03-23 08:51:28,218 - lava_callback - DEBUG - Processing node 69c0fe0facdb2e26c83cd1d0: ltp-cve 2026-03-23 08:51:28,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0cacdb2e26c83cd1c9 HTTP/1.1" 200 None 2026-03-23 08:51:28,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:28,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:51:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:28,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe0cacdb2e26c83cd1c9 HTTP/1.1" 200 None 2026-03-23 08:51:28,489 - lava_callback - INFO - Completed processing callback for node 69c0fe0cacdb2e26c83cd1c9 2026-03-23 08:51:28,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:28,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:28,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69c0fe0facdb2e26c83cd1d0/log.txt.gz 2026-03-23 08:51:29,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:29,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:29,394 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69c0fe0facdb2e26c83cd1d0/lava-logs.yaml 2026-03-23 08:51:29,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 08:51:29,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:29,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69c0fe0facdb2e26c83cd1d0/lava_callback.json.gz 2026-03-23 08:51:29,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:29,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe0facdb2e26c83cd1d0 HTTP/1.1" 200 None 2026-03-23 08:51:29,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:29,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:51:29,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:29,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe0facdb2e26c83cd1d0 HTTP/1.1" 200 None 2026-03-23 08:51:29,699 - lava_callback - INFO - Completed processing callback for node 69c0fe0facdb2e26c83cd1d0 2026-03-23 08:51:29,771 - lava_callback - INFO - Received callback for node 69c0fe1facdb2e26c83cd1fa INFO: 172.21.0.1:46782 - "POST /node/69c0fe1facdb2e26c83cd1fa HTTP/1.0" 202 Accepted 2026-03-23 08:51:29,778 - lava_callback - INFO - Starting async job submit for node 69c0fe1facdb2e26c83cd1fa 2026-03-23 08:51:29,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:29,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1facdb2e26c83cd1fa HTTP/1.1" 200 None 2026-03-23 08:51:29,830 - lava_callback - DEBUG - Processing node 69c0fe1facdb2e26c83cd1fa: ltp-syscalls 2026-03-23 08:51:30,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:30,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:30,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c0fe1facdb2e26c83cd1fa/log.txt.gz 2026-03-23 08:51:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:31,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:31,386 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c0fe1facdb2e26c83cd1fa/lava-logs.yaml 2026-03-23 08:51:31,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:31,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:31,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c0fe1facdb2e26c83cd1fa/lava_callback.json.gz 2026-03-23 08:51:31,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:31,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1facdb2e26c83cd1fa HTTP/1.1" 200 None 2026-03-23 08:51:31,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:31,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:51:31,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:31,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe1facdb2e26c83cd1fa HTTP/1.1" 200 None 2026-03-23 08:51:31,672 - lava_callback - INFO - Completed processing callback for node 69c0fe1facdb2e26c83cd1fa INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:45,446 - lava_callback - INFO - Received callback for node 69c0fe44acdb2e26c83cd288 INFO: 172.21.0.1:54506 - "POST /node/69c0fe44acdb2e26c83cd288 HTTP/1.0" 202 Accepted 2026-03-23 08:51:45,453 - lava_callback - INFO - Starting async job submit for node 69c0fe44acdb2e26c83cd288 2026-03-23 08:51:45,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:45,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe44acdb2e26c83cd288 HTTP/1.1" 200 None 2026-03-23 08:51:45,495 - lava_callback - DEBUG - Processing node 69c0fe44acdb2e26c83cd288: baseline-nfs-arm64 2026-03-23 08:51:45,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:46,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:46,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe44acdb2e26c83cd288/log.txt.gz 2026-03-23 08:51:46,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:46,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:46,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe44acdb2e26c83cd288/lava-logs.yaml 2026-03-23 08:51:46,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:46,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:46,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe44acdb2e26c83cd288/lava_callback.json.gz 2026-03-23 08:51:46,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:46,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe44acdb2e26c83cd288 HTTP/1.1" 200 None 2026-03-23 08:51:46,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:46,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:46,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:46,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe44acdb2e26c83cd288 HTTP/1.1" 200 None 2026-03-23 08:51:46,783 - lava_callback - INFO - Completed processing callback for node 69c0fe44acdb2e26c83cd288 2026-03-23 08:51:52,328 - lava_callback - INFO - Received callback for node 69c0fe70acdb2e26c83cd357 INFO: 172.21.0.1:41850 - "POST /node/69c0fe70acdb2e26c83cd357 HTTP/1.0" 202 Accepted 2026-03-23 08:51:52,334 - lava_callback - INFO - Starting async job submit for node 69c0fe70acdb2e26c83cd357 2026-03-23 08:51:52,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:52,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe70acdb2e26c83cd357 HTTP/1.1" 200 None 2026-03-23 08:51:52,376 - lava_callback - DEBUG - Processing node 69c0fe70acdb2e26c83cd357: baseline-arm64-clabbe 2026-03-23 08:51:52,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:52,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:52,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c0fe70acdb2e26c83cd357/log.txt.gz 2026-03-23 08:51:52,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:53,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:53,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c0fe70acdb2e26c83cd357/lava-logs.yaml 2026-03-23 08:51:53,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:53,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:53,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c0fe70acdb2e26c83cd357/lava_callback.json.gz 2026-03-23 08:51:53,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:53,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe70acdb2e26c83cd357 HTTP/1.1" 200 None 2026-03-23 08:51:53,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:53,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:53,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:53,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe70acdb2e26c83cd357 HTTP/1.1" 200 None 2026-03-23 08:51:53,309 - lava_callback - INFO - Completed processing callback for node 69c0fe70acdb2e26c83cd357 2026-03-23 08:51:53,869 - lava_callback - INFO - Received callback for node 69c0fe43acdb2e26c83cd285 INFO: 172.21.0.1:41856 - "POST /node/69c0fe43acdb2e26c83cd285 HTTP/1.0" 202 Accepted 2026-03-23 08:51:53,876 - lava_callback - INFO - Starting async job submit for node 69c0fe43acdb2e26c83cd285 2026-03-23 08:51:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:53,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe43acdb2e26c83cd285 HTTP/1.1" 200 None 2026-03-23 08:51:53,914 - lava_callback - DEBUG - Processing node 69c0fe43acdb2e26c83cd285: baseline-nfs-arm64 2026-03-23 08:51:54,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:54,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:54,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe43acdb2e26c83cd285/log.txt.gz 2026-03-23 08:51:54,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:54,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:54,765 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe43acdb2e26c83cd285/lava-logs.yaml 2026-03-23 08:51:54,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:51:54,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:51:54,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe43acdb2e26c83cd285/lava_callback.json.gz 2026-03-23 08:51:54,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:54,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe43acdb2e26c83cd285 HTTP/1.1" 200 None 2026-03-23 08:51:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:54,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:51:54,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:55,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe43acdb2e26c83cd285 HTTP/1.1" 200 None 2026-03-23 08:51:55,015 - lava_callback - INFO - Completed processing callback for node 69c0fe43acdb2e26c83cd285 INFO: 172.21.0.1:41862 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:51:59,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:51:59,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:52:14,023 - lava_callback - INFO - Received callback for node 69be5c32448e074b3ffe193e INFO: 172.21.0.1:53634 - "POST /node/69be5c32448e074b3ffe193e HTTP/1.0" 202 Accepted 2026-03-23 08:52:14,029 - lava_callback - INFO - Starting async job submit for node 69be5c32448e074b3ffe193e 2026-03-23 08:52:14,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:14,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5c32448e074b3ffe193e HTTP/1.1" 200 None 2026-03-23 08:52:14,063 - lava_callback - DEBUG - Processing node 69be5c32448e074b3ffe193e: baseline-arm-clabbe 2026-03-23 08:52:14,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5c32448e074b3ffe193e 2026-03-23 08:52:14,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:14,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5c32448e074b3ffe193e HTTP/1.1" 200 None 2026-03-23 08:52:14,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:14,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:52:14,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:14,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5c32448e074b3ffe193e HTTP/1.1" 200 None 2026-03-23 08:52:14,160 - lava_callback - ERROR - Error processing callback for node 69be5c32448e074b3ffe193e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:52:33,901 - lava_callback - INFO - Received callback for node 69c0fe63acdb2e26c83cd318 INFO: 172.21.0.1:35060 - "POST /node/69c0fe63acdb2e26c83cd318 HTTP/1.0" 202 Accepted 2026-03-23 08:52:33,908 - lava_callback - INFO - Starting async job submit for node 69c0fe63acdb2e26c83cd318 2026-03-23 08:52:33,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:33,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe63acdb2e26c83cd318 HTTP/1.1" 200 None 2026-03-23 08:52:33,945 - lava_callback - DEBUG - Processing node 69c0fe63acdb2e26c83cd318: baseline-arm64-broonie 2026-03-23 08:52:34,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:52:34,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:52:34,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe63acdb2e26c83cd318/log.txt.gz 2026-03-23 08:52:34,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:52:34,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:52:34,758 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe63acdb2e26c83cd318/lava-logs.yaml 2026-03-23 08:52:34,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:52:34,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:52:34,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c0fe63acdb2e26c83cd318/lava_callback.json.gz 2026-03-23 08:52:34,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:34,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe63acdb2e26c83cd318 HTTP/1.1" 200 None 2026-03-23 08:52:34,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:34,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:52:34,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:35,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe63acdb2e26c83cd318 HTTP/1.1" 200 None 2026-03-23 08:52:35,020 - lava_callback - INFO - Completed processing callback for node 69c0fe63acdb2e26c83cd318 INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:52:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:52:59,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:53:31,409 - lava_callback - INFO - Received callback for node 69c0fde8acdb2e26c83cd17f INFO: 172.21.0.1:50814 - "POST /node/69c0fde8acdb2e26c83cd17f HTTP/1.0" 202 Accepted 2026-03-23 08:53:31,415 - lava_callback - INFO - Starting async job submit for node 69c0fde8acdb2e26c83cd17f 2026-03-23 08:53:31,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:31,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fde8acdb2e26c83cd17f HTTP/1.1" 200 None 2026-03-23 08:53:31,455 - lava_callback - DEBUG - Processing node 69c0fde8acdb2e26c83cd17f: baseline-arm-clabbe 2026-03-23 08:53:31,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:31,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:31,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fde8acdb2e26c83cd17f/log.txt.gz 2026-03-23 08:53:31,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:32,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:32,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fde8acdb2e26c83cd17f/lava-logs.yaml 2026-03-23 08:53:32,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:32,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:32,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fde8acdb2e26c83cd17f/lava_callback.json.gz 2026-03-23 08:53:32,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fde8acdb2e26c83cd17f HTTP/1.1" 200 None 2026-03-23 08:53:32,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:32,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:53:32,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:32,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fde8acdb2e26c83cd17f HTTP/1.1" 200 None 2026-03-23 08:53:32,420 - lava_callback - INFO - Completed processing callback for node 69c0fde8acdb2e26c83cd17f 2026-03-23 08:53:34,181 - lava_callback - INFO - Received callback for node 69be5c7c448e074b3ffe1968 INFO: 172.21.0.1:50816 - "POST /node/69be5c7c448e074b3ffe1968 HTTP/1.0" 202 Accepted 2026-03-23 08:53:34,187 - lava_callback - INFO - Starting async job submit for node 69be5c7c448e074b3ffe1968 2026-03-23 08:53:34,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:34,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5c7c448e074b3ffe1968 HTTP/1.1" 200 None 2026-03-23 08:53:34,203 - lava_callback - DEBUG - Processing node 69be5c7c448e074b3ffe1968: baseline-arm-clabbe 2026-03-23 08:53:34,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5c7c448e074b3ffe1968 2026-03-23 08:53:34,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:34,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5c7c448e074b3ffe1968 HTTP/1.1" 200 None 2026-03-23 08:53:34,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:34,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:53:34,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:34,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5c7c448e074b3ffe1968 HTTP/1.1" 200 None 2026-03-23 08:53:34,254 - lava_callback - ERROR - Error processing callback for node 69be5c7c448e074b3ffe1968: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:53:44,998 - lava_callback - INFO - Received callback for node 69c0fe12acdb2e26c83cd1d6 INFO: 172.21.0.1:52138 - "POST /node/69c0fe12acdb2e26c83cd1d6 HTTP/1.0" 202 Accepted 2026-03-23 08:53:45,005 - lava_callback - INFO - Starting async job submit for node 69c0fe12acdb2e26c83cd1d6 2026-03-23 08:53:45,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:45,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe12acdb2e26c83cd1d6 HTTP/1.1" 200 None 2026-03-23 08:53:45,046 - lava_callback - DEBUG - Processing node 69c0fe12acdb2e26c83cd1d6: ltp-fs_bind 2026-03-23 08:53:45,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:45,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:45,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c0fe12acdb2e26c83cd1d6/log.txt.gz 2026-03-23 08:53:45,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:46,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:46,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c0fe12acdb2e26c83cd1d6/lava-logs.yaml 2026-03-23 08:53:46,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:53:46,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:53:46,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c0fe12acdb2e26c83cd1d6/lava_callback.json.gz 2026-03-23 08:53:46,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:46,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe12acdb2e26c83cd1d6 HTTP/1.1" 200 None 2026-03-23 08:53:46,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:46,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:53:46,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:46,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe12acdb2e26c83cd1d6 HTTP/1.1" 200 None 2026-03-23 08:53:46,381 - lava_callback - INFO - Completed processing callback for node 69c0fe12acdb2e26c83cd1d6 INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:53:59,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:53:59,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53832 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:54:14,069 - lava_callback - INFO - Received callback for node 69be5ca0448e074b3ffe197d INFO: 172.21.0.1:44358 - "POST /node/69be5ca0448e074b3ffe197d HTTP/1.0" 202 Accepted 2026-03-23 08:54:14,074 - lava_callback - INFO - Starting async job submit for node 69be5ca0448e074b3ffe197d 2026-03-23 08:54:14,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:14,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5ca0448e074b3ffe197d HTTP/1.1" 200 None 2026-03-23 08:54:14,091 - lava_callback - DEBUG - Processing node 69be5ca0448e074b3ffe197d: baseline-arm-clabbe 2026-03-23 08:54:14,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5ca0448e074b3ffe197d 2026-03-23 08:54:14,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:14,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5ca0448e074b3ffe197d HTTP/1.1" 200 None 2026-03-23 08:54:14,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:14,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:54:14,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:14,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5ca0448e074b3ffe197d HTTP/1.1" 200 None 2026-03-23 08:54:14,154 - lava_callback - ERROR - Error processing callback for node 69be5ca0448e074b3ffe197d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:54:41,199 - lava_callback - INFO - Received callback for node 69be5cbf448e074b3ffe198b INFO: 172.21.0.1:53590 - "POST /node/69be5cbf448e074b3ffe198b HTTP/1.0" 202 Accepted 2026-03-23 08:54:41,205 - lava_callback - INFO - Starting async job submit for node 69be5cbf448e074b3ffe198b 2026-03-23 08:54:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:41,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5cbf448e074b3ffe198b HTTP/1.1" 200 None 2026-03-23 08:54:41,221 - lava_callback - DEBUG - Processing node 69be5cbf448e074b3ffe198b: baseline-arm-baylibre 2026-03-23 08:54:41,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5cbf448e074b3ffe198b 2026-03-23 08:54:41,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:41,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5cbf448e074b3ffe198b HTTP/1.1" 200 None 2026-03-23 08:54:41,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:41,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:54:41,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:41,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5cbf448e074b3ffe198b HTTP/1.1" 200 None 2026-03-23 08:54:41,275 - lava_callback - ERROR - Error processing callback for node 69be5cbf448e074b3ffe198b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:54:54,143 - lava_callback - INFO - Received callback for node 69c0fe14acdb2e26c83cd1d9 INFO: 172.21.0.1:53376 - "POST /node/69c0fe14acdb2e26c83cd1d9 HTTP/1.0" 202 Accepted 2026-03-23 08:54:54,154 - lava_callback - INFO - Starting async job submit for node 69c0fe14acdb2e26c83cd1d9 2026-03-23 08:54:54,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:54,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe14acdb2e26c83cd1d9 HTTP/1.1" 200 None 2026-03-23 08:54:54,256 - lava_callback - DEBUG - Processing node 69c0fe14acdb2e26c83cd1d9: ltp-fsx INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:54:54,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:54:55,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:54:55,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69c0fe14acdb2e26c83cd1d9/log.txt.gz 2026-03-23 08:54:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:54:55,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:54:55,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69c0fe14acdb2e26c83cd1d9/lava-logs.yaml 2026-03-23 08:54:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:54:56,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:54:56,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69c0fe14acdb2e26c83cd1d9/lava_callback.json.gz 2026-03-23 08:54:56,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:56,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe14acdb2e26c83cd1d9 HTTP/1.1" 200 None 2026-03-23 08:54:56,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:56,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:54:56,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:56,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe14acdb2e26c83cd1d9 HTTP/1.1" 200 None 2026-03-23 08:54:56,166 - lava_callback - INFO - Completed processing callback for node 69c0fe14acdb2e26c83cd1d9 INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:54:59,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:54:59,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:14,807 - lava_callback - INFO - Received callback for node 69c0fdeaacdb2e26c83cd182 INFO: 172.21.0.1:49950 - "POST /node/69c0fdeaacdb2e26c83cd182 HTTP/1.0" 202 Accepted 2026-03-23 08:55:14,816 - lava_callback - INFO - Starting async job submit for node 69c0fdeaacdb2e26c83cd182 2026-03-23 08:55:14,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:14,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdeaacdb2e26c83cd182 HTTP/1.1" 200 None 2026-03-23 08:55:14,866 - lava_callback - DEBUG - Processing node 69c0fdeaacdb2e26c83cd182: baseline-arm-clabbe 2026-03-23 08:55:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49954 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 08:55:15,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:15,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdeaacdb2e26c83cd182/log.txt.gz 2026-03-23 08:55:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:16,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:16,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdeaacdb2e26c83cd182/lava-logs.yaml 2026-03-23 08:55:16,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:16,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:16,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c0fdeaacdb2e26c83cd182/lava_callback.json.gz 2026-03-23 08:55:16,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:16,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdeaacdb2e26c83cd182 HTTP/1.1" 200 None 2026-03-23 08:55:16,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:16,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:55:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:16,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdeaacdb2e26c83cd182 HTTP/1.1" 200 None 2026-03-23 08:55:16,339 - lava_callback - INFO - Completed processing callback for node 69c0fdeaacdb2e26c83cd182 INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:21,182 - lava_callback - INFO - Received callback for node 69be5ce3448e074b3ffe1995 INFO: 172.21.0.1:58466 - "POST /node/69be5ce3448e074b3ffe1995 HTTP/1.0" 202 Accepted 2026-03-23 08:55:21,191 - lava_callback - INFO - Starting async job submit for node 69be5ce3448e074b3ffe1995 2026-03-23 08:55:21,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:21,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5ce3448e074b3ffe1995 HTTP/1.1" 200 None 2026-03-23 08:55:21,219 - lava_callback - DEBUG - Processing node 69be5ce3448e074b3ffe1995: baseline-arm-baylibre 2026-03-23 08:55:21,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5ce3448e074b3ffe1995 2026-03-23 08:55:21,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:21,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5ce3448e074b3ffe1995 HTTP/1.1" 200 None 2026-03-23 08:55:21,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:21,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:55:21,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:21,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5ce3448e074b3ffe1995 HTTP/1.1" 200 None 2026-03-23 08:55:21,341 - lava_callback - ERROR - Error processing callback for node 69be5ce3448e074b3ffe1995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:55:25,128 - lava_callback - INFO - Received callback for node 69c0fe16acdb2e26c83cd1e9 INFO: 172.21.0.1:58482 - "POST /node/69c0fe16acdb2e26c83cd1e9 HTTP/1.0" 202 Accepted 2026-03-23 08:55:25,138 - lava_callback - INFO - Starting async job submit for node 69c0fe16acdb2e26c83cd1e9 2026-03-23 08:55:25,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:25,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe16acdb2e26c83cd1e9 HTTP/1.1" 200 None 2026-03-23 08:55:25,247 - lava_callback - DEBUG - Processing node 69c0fe16acdb2e26c83cd1e9: ltp-input 2026-03-23 08:55:25,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:26,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:26,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69c0fe16acdb2e26c83cd1e9/log.txt.gz 2026-03-23 08:55:26,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:26,681 - lava_callback - INFO - Received callback for node 69c0fe18acdb2e26c83cd1ed INFO: 172.21.0.1:58504 - "POST /node/69c0fe18acdb2e26c83cd1ed HTTP/1.0" 202 Accepted 2026-03-23 08:55:26,691 - lava_callback - INFO - Starting async job submit for node 69c0fe18acdb2e26c83cd1ed 2026-03-23 08:55:26,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:26,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe18acdb2e26c83cd1ed HTTP/1.1" 200 None 2026-03-23 08:55:26,772 - lava_callback - DEBUG - Processing node 69c0fe18acdb2e26c83cd1ed: ltp-ipc 2026-03-23 08:55:26,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:26,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69c0fe16acdb2e26c83cd1e9/lava-logs.yaml 2026-03-23 08:55:26,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:27,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:27,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69c0fe16acdb2e26c83cd1e9/lava_callback.json.gz 2026-03-23 08:55:27,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:27,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:27,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe16acdb2e26c83cd1e9 HTTP/1.1" 200 None 2026-03-23 08:55:27,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:27,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:55:27,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:27,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe16acdb2e26c83cd1e9 HTTP/1.1" 200 None 2026-03-23 08:55:27,399 - lava_callback - INFO - Completed processing callback for node 69c0fe16acdb2e26c83cd1e9 2026-03-23 08:55:27,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:27,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69c0fe18acdb2e26c83cd1ed/log.txt.gz 2026-03-23 08:55:28,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:28,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:28,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69c0fe18acdb2e26c83cd1ed/lava-logs.yaml 2026-03-23 08:55:28,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:28,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:28,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69c0fe18acdb2e26c83cd1ed/lava_callback.json.gz 2026-03-23 08:55:28,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:28,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe18acdb2e26c83cd1ed HTTP/1.1" 200 None 2026-03-23 08:55:28,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:28,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:55:28,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:28,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe18acdb2e26c83cd1ed HTTP/1.1" 200 None 2026-03-23 08:55:28,940 - lava_callback - INFO - Completed processing callback for node 69c0fe18acdb2e26c83cd1ed 2026-03-23 08:55:29,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:29,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:55:29,696 - lava_callback - INFO - Received callback for node 69c0fe42acdb2e26c83cd282 INFO: 172.21.0.1:50226 - "POST /node/69c0fe42acdb2e26c83cd282 HTTP/1.0" 202 Accepted 2026-03-23 08:55:29,708 - lava_callback - INFO - Starting async job submit for node 69c0fe42acdb2e26c83cd282 2026-03-23 08:55:29,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:29,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe42acdb2e26c83cd282 HTTP/1.1" 200 None 2026-03-23 08:55:29,807 - lava_callback - DEBUG - Processing node 69c0fe42acdb2e26c83cd282: baseline-arm64 2026-03-23 08:55:30,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:30,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:30,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe42acdb2e26c83cd282/log.txt.gz 2026-03-23 08:55:31,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:31,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:31,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe42acdb2e26c83cd282/lava-logs.yaml 2026-03-23 08:55:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:31,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:31,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe42acdb2e26c83cd282/lava_callback.json.gz DEBUG: Setup failed for 69c0fe42acdb2e26c83cd282. Transitting job node result: incomplete -> fail 2026-03-23 08:55:31,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:31,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe42acdb2e26c83cd282 HTTP/1.1" 200 None 2026-03-23 08:55:31,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:31,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:55:31,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:31,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe42acdb2e26c83cd282 HTTP/1.1" 200 None 2026-03-23 08:55:31,939 - lava_callback - INFO - Completed processing callback for node 69c0fe42acdb2e26c83cd282 INFO: 172.21.0.1:50242 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:41,209 - lava_callback - INFO - Received callback for node 69be5d07448e074b3ffe199f INFO: 172.21.0.1:45084 - "POST /node/69be5d07448e074b3ffe199f HTTP/1.0" 202 Accepted 2026-03-23 08:55:41,218 - lava_callback - INFO - Starting async job submit for node 69be5d07448e074b3ffe199f 2026-03-23 08:55:41,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:41,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d07448e074b3ffe199f HTTP/1.1" 200 None 2026-03-23 08:55:41,252 - lava_callback - DEBUG - Processing node 69be5d07448e074b3ffe199f: baseline-arm-baylibre 2026-03-23 08:55:41,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5d07448e074b3ffe199f 2026-03-23 08:55:41,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:41,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d07448e074b3ffe199f HTTP/1.1" 200 None 2026-03-23 08:55:41,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:41,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:55:41,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:41,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5d07448e074b3ffe199f HTTP/1.1" 200 None 2026-03-23 08:55:41,351 - lava_callback - ERROR - Error processing callback for node 69be5d07448e074b3ffe199f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:55:45,510 - lava_callback - INFO - Received callback for node 69c0fe1aacdb2e26c83cd1f1 INFO: 172.21.0.1:45090 - "POST /node/69c0fe1aacdb2e26c83cd1f1 HTTP/1.0" 202 Accepted 2026-03-23 08:55:45,520 - lava_callback - INFO - Starting async job submit for node 69c0fe1aacdb2e26c83cd1f1 2026-03-23 08:55:45,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1aacdb2e26c83cd1f1 HTTP/1.1" 200 None 2026-03-23 08:55:45,616 - lava_callback - DEBUG - Processing node 69c0fe1aacdb2e26c83cd1f1: ltp-pty 2026-03-23 08:55:46,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:46,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:46,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c0fe1aacdb2e26c83cd1f1/log.txt.gz INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:46,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:46,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:46,819 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c0fe1aacdb2e26c83cd1f1/lava-logs.yaml 2026-03-23 08:55:46,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:55:47,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:55:47,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c0fe1aacdb2e26c83cd1f1/lava_callback.json.gz 2026-03-23 08:55:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:47,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1aacdb2e26c83cd1f1 HTTP/1.1" 200 None 2026-03-23 08:55:47,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:47,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:55:47,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:47,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe1aacdb2e26c83cd1f1 HTTP/1.1" 200 None 2026-03-23 08:55:47,254 - lava_callback - INFO - Completed processing callback for node 69c0fe1aacdb2e26c83cd1f1 INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:55,294 - lava_callback - INFO - Received callback for node 69c0fe48acdb2e26c83cd299 INFO: 172.21.0.1:41278 - "POST /node/69c0fe48acdb2e26c83cd299 HTTP/1.0" 202 Accepted 2026-03-23 08:55:55,388 - lava_callback - INFO - Starting async job submit for node 69c0fe48acdb2e26c83cd299 2026-03-23 08:55:55,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:55,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe48acdb2e26c83cd299 HTTP/1.1" 200 None 2026-03-23 08:55:55,487 - lava_callback - DEBUG - Processing node 69c0fe48acdb2e26c83cd299: baseline-nfs-arm64 INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:55:59,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:55:59,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:56:19,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:56:20,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:56:20,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe48acdb2e26c83cd299/log.txt.gz 2026-03-23 08:56:21,500 - lava_callback - INFO - Received callback for node 69be5d2b448e074b3ffe19b7 INFO: 172.21.0.1:44614 - "POST /node/69be5d2b448e074b3ffe19b7 HTTP/1.0" 202 Accepted 2026-03-23 08:56:21,523 - lava_callback - INFO - Starting async job submit for node 69be5d2b448e074b3ffe19b7 2026-03-23 08:56:21,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:21,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d2b448e074b3ffe19b7 HTTP/1.1" 200 None 2026-03-23 08:56:21,589 - lava_callback - DEBUG - Processing node 69be5d2b448e074b3ffe19b7: baseline-arm-baylibre 2026-03-23 08:56:21,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5d2b448e074b3ffe19b7 2026-03-23 08:56:21,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:21,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d2b448e074b3ffe19b7 HTTP/1.1" 200 None 2026-03-23 08:56:21,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:21,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:56:21,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:21,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5d2b448e074b3ffe19b7 HTTP/1.1" 200 None 2026-03-23 08:56:21,851 - lava_callback - ERROR - Error processing callback for node 69be5d2b448e074b3ffe19b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:56:30,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:56:31,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:56:31,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe48acdb2e26c83cd299/lava-logs.yaml 2026-03-23 08:56:31,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:56:32,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:56:32,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe48acdb2e26c83cd299/lava_callback.json.gz 2026-03-23 08:56:32,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:32,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe48acdb2e26c83cd299 HTTP/1.1" 200 None 2026-03-23 08:56:32,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:32,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:56:32,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:32,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe48acdb2e26c83cd299 HTTP/1.1" 200 None 2026-03-23 08:56:32,243 - lava_callback - INFO - Completed processing callback for node 69c0fe48acdb2e26c83cd299 INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:56:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:56:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:57:01,241 - lava_callback - INFO - Received callback for node 69be5d50448e074b3ffe19db INFO: 172.21.0.1:57266 - "POST /node/69be5d50448e074b3ffe19db HTTP/1.0" 202 Accepted 2026-03-23 08:57:01,247 - lava_callback - INFO - Starting async job submit for node 69be5d50448e074b3ffe19db 2026-03-23 08:57:01,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:01,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d50448e074b3ffe19db HTTP/1.1" 200 None 2026-03-23 08:57:01,263 - lava_callback - DEBUG - Processing node 69be5d50448e074b3ffe19db: baseline-arm-baylibre 2026-03-23 08:57:01,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5d50448e074b3ffe19db 2026-03-23 08:57:01,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:01,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d50448e074b3ffe19db HTTP/1.1" 200 None 2026-03-23 08:57:01,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:01,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:57:01,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:01,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5d50448e074b3ffe19db HTTP/1.1" 200 None 2026-03-23 08:57:01,335 - lava_callback - ERROR - Error processing callback for node 69be5d50448e074b3ffe19db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:57:34,264 - lava_callback - INFO - Received callback for node 69be5d75448e074b3ffe19e6 INFO: 172.21.0.1:47176 - "POST /node/69be5d75448e074b3ffe19e6 HTTP/1.0" 202 Accepted 2026-03-23 08:57:34,270 - lava_callback - INFO - Starting async job submit for node 69be5d75448e074b3ffe19e6 2026-03-23 08:57:34,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:34,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d75448e074b3ffe19e6 HTTP/1.1" 200 None 2026-03-23 08:57:34,286 - lava_callback - DEBUG - Processing node 69be5d75448e074b3ffe19e6: baseline-arm-clabbe 2026-03-23 08:57:34,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5d75448e074b3ffe19e6 2026-03-23 08:57:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:34,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d75448e074b3ffe19e6 HTTP/1.1" 200 None 2026-03-23 08:57:34,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:34,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 08:57:34,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:57:34,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5d75448e074b3ffe19e6 HTTP/1.1" 200 None 2026-03-23 08:57:34,350 - lava_callback - ERROR - Error processing callback for node 69be5d75448e074b3ffe19e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:14,283 - lava_callback - INFO - Received callback for node 69be5d99448e074b3ffe19f2 INFO: 172.21.0.1:42842 - "POST /node/69be5d99448e074b3ffe19f2 HTTP/1.0" 202 Accepted 2026-03-23 08:58:14,289 - lava_callback - INFO - Starting async job submit for node 69be5d99448e074b3ffe19f2 2026-03-23 08:58:14,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:14,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d99448e074b3ffe19f2 HTTP/1.1" 200 None 2026-03-23 08:58:14,306 - lava_callback - DEBUG - Processing node 69be5d99448e074b3ffe19f2: baseline-arm-clabbe 2026-03-23 08:58:14,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5d99448e074b3ffe19f2 2026-03-23 08:58:14,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:14,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5d99448e074b3ffe19f2 HTTP/1.1" 200 None 2026-03-23 08:58:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:14,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:58:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:14,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5d99448e074b3ffe19f2 HTTP/1.1" 200 None 2026-03-23 08:58:14,360 - lava_callback - ERROR - Error processing callback for node 69be5d99448e074b3ffe19f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:31,779 - lava_callback - INFO - Received callback for node 69c100abacdb2e26c83cd590 INFO: 172.21.0.1:54904 - "POST /node/69c100abacdb2e26c83cd590 HTTP/1.0" 202 Accepted 2026-03-23 08:58:31,785 - lava_callback - INFO - Starting async job submit for node 69c100abacdb2e26c83cd590 2026-03-23 08:58:31,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:31,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c100abacdb2e26c83cd590 HTTP/1.1" 200 None 2026-03-23 08:58:31,814 - lava_callback - DEBUG - Processing node 69c100abacdb2e26c83cd590: baseline-nfs-arm64 2026-03-23 08:58:31,815 - lava_callback - WARNING - Failed to upload log 2026-03-23 08:58:31,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:31,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:31,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c100abacdb2e26c83cd590/lava-logs.yaml 2026-03-23 08:58:31,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:32,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:32,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c100abacdb2e26c83cd590/lava_callback.json.gz 2026-03-23 08:58:32,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:32,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c100abacdb2e26c83cd590 HTTP/1.1" 200 None 2026-03-23 08:58:32,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:32,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:58:32,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:32,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c100abacdb2e26c83cd590 HTTP/1.1" 200 None 2026-03-23 08:58:32,199 - lava_callback - INFO - Completed processing callback for node 69c100abacdb2e26c83cd590 INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:41,408 - lava_callback - INFO - Received callback for node 69be5dbb448e074b3ffe19fd INFO: 172.21.0.1:38978 - "POST /node/69be5dbb448e074b3ffe19fd HTTP/1.0" 202 Accepted 2026-03-23 08:58:41,414 - lava_callback - INFO - Starting async job submit for node 69be5dbb448e074b3ffe19fd 2026-03-23 08:58:41,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:41,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5dbb448e074b3ffe19fd HTTP/1.1" 200 None 2026-03-23 08:58:41,431 - lava_callback - DEBUG - Processing node 69be5dbb448e074b3ffe19fd: baseline-arm-baylibre 2026-03-23 08:58:41,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5dbb448e074b3ffe19fd 2026-03-23 08:58:41,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:41,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5dbb448e074b3ffe19fd HTTP/1.1" 200 None 2026-03-23 08:58:41,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:41,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:58:41,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:41,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5dbb448e074b3ffe19fd HTTP/1.1" 200 None 2026-03-23 08:58:41,501 - lava_callback - ERROR - Error processing callback for node 69be5dbb448e074b3ffe19fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 08:58:44,331 - lava_callback - INFO - Received callback for node 69c0fe3cacdb2e26c83cd269 INFO: 172.21.0.1:38986 - "POST /node/69c0fe3cacdb2e26c83cd269 HTTP/1.0" 202 Accepted 2026-03-23 08:58:44,337 - lava_callback - INFO - Starting async job submit for node 69c0fe3cacdb2e26c83cd269 2026-03-23 08:58:44,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:44,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3cacdb2e26c83cd269 HTTP/1.1" 200 None 2026-03-23 08:58:44,384 - lava_callback - DEBUG - Processing node 69c0fe3cacdb2e26c83cd269: baseline-arm64 2026-03-23 08:58:44,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:45,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:45,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3cacdb2e26c83cd269/log.txt.gz 2026-03-23 08:58:45,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:45,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:45,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3cacdb2e26c83cd269/lava-logs.yaml 2026-03-23 08:58:45,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:45,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:45,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c0fe3cacdb2e26c83cd269/lava_callback.json.gz 2026-03-23 08:58:45,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:45,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe3cacdb2e26c83cd269 HTTP/1.1" 200 None 2026-03-23 08:58:45,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:45,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 08:58:45,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:45,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe3cacdb2e26c83cd269 HTTP/1.1" 200 None 2026-03-23 08:58:45,816 - lava_callback - INFO - Completed processing callback for node 69c0fe3cacdb2e26c83cd269 INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:54,238 - lava_callback - INFO - Received callback for node 69c0fe1eacdb2e26c83cd1f7 INFO: 172.21.0.1:51644 - "POST /node/69c0fe1eacdb2e26c83cd1f7 HTTP/1.0" 202 Accepted 2026-03-23 08:58:54,245 - lava_callback - INFO - Starting async job submit for node 69c0fe1eacdb2e26c83cd1f7 2026-03-23 08:58:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:54,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1eacdb2e26c83cd1f7 HTTP/1.1" 200 None 2026-03-23 08:58:54,287 - lava_callback - DEBUG - Processing node 69c0fe1eacdb2e26c83cd1f7: ltp-smoke 2026-03-23 08:58:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:54,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:54,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fe1eacdb2e26c83cd1f7/log.txt.gz 2026-03-23 08:58:55,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:55,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:55,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fe1eacdb2e26c83cd1f7/lava-logs.yaml 2026-03-23 08:58:55,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:58:55,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:58:55,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c0fe1eacdb2e26c83cd1f7/lava_callback.json.gz 2026-03-23 08:58:55,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:55,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1eacdb2e26c83cd1f7 HTTP/1.1" 200 None 2026-03-23 08:58:55,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:55,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:58:55,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:55,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe1eacdb2e26c83cd1f7 HTTP/1.1" 200 None 2026-03-23 08:58:55,493 - lava_callback - INFO - Completed processing callback for node 69c0fe1eacdb2e26c83cd1f7 INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:58:59,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:58:59,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:59:25,269 - lava_callback - INFO - Received callback for node 69c0fe21acdb2e26c83cd203 INFO: 172.21.0.1:50106 - "POST /node/69c0fe21acdb2e26c83cd203 HTTP/1.0" 202 Accepted 2026-03-23 08:59:25,277 - lava_callback - INFO - Starting async job submit for node 69c0fe21acdb2e26c83cd203 2026-03-23 08:59:25,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:25,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe21acdb2e26c83cd203 HTTP/1.1" 200 None 2026-03-23 08:59:25,321 - lava_callback - DEBUG - Processing node 69c0fe21acdb2e26c83cd203: ltp-syscalls-ipc 2026-03-23 08:59:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:25,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:25,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c0fe21acdb2e26c83cd203/log.txt.gz 2026-03-23 08:59:26,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:26,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:26,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c0fe21acdb2e26c83cd203/lava-logs.yaml 2026-03-23 08:59:26,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:26,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:26,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c0fe21acdb2e26c83cd203/lava_callback.json.gz 2026-03-23 08:59:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:26,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe21acdb2e26c83cd203 HTTP/1.1" 200 None 2026-03-23 08:59:26,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:59:26,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:59:26,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:26,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe21acdb2e26c83cd203 HTTP/1.1" 200 None 2026-03-23 08:59:26,610 - lava_callback - INFO - Completed processing callback for node 69c0fe21acdb2e26c83cd203 2026-03-23 08:59:26,836 - lava_callback - INFO - Received callback for node 69c0fe23acdb2e26c83cd208 INFO: 172.21.0.1:50136 - "POST /node/69c0fe23acdb2e26c83cd208 HTTP/1.0" 202 Accepted 2026-03-23 08:59:26,842 - lava_callback - INFO - Starting async job submit for node 69c0fe23acdb2e26c83cd208 2026-03-23 08:59:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:26,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe23acdb2e26c83cd208 HTTP/1.1" 200 None 2026-03-23 08:59:26,884 - lava_callback - DEBUG - Processing node 69c0fe23acdb2e26c83cd208: ltp-timers 2026-03-23 08:59:27,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:27,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:27,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69c0fe23acdb2e26c83cd208/log.txt.gz 2026-03-23 08:59:27,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:27,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:27,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69c0fe23acdb2e26c83cd208/lava-logs.yaml 2026-03-23 08:59:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 08:59:27,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 08:59:27,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69c0fe23acdb2e26c83cd208/lava_callback.json.gz 2026-03-23 08:59:27,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:28,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe23acdb2e26c83cd208 HTTP/1.1" 200 None 2026-03-23 08:59:28,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:28,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 08:59:28,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:28,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe23acdb2e26c83cd208 HTTP/1.1" 200 None 2026-03-23 08:59:28,052 - lava_callback - INFO - Completed processing callback for node 69c0fe23acdb2e26c83cd208 2026-03-23 08:59:29,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:29,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 08:59:34,365 - lava_callback - INFO - Received callback for node 69be5de0448e074b3ffe1a0c INFO: 172.21.0.1:49898 - "POST /node/69be5de0448e074b3ffe1a0c HTTP/1.0" 202 Accepted 2026-03-23 08:59:34,371 - lava_callback - INFO - Starting async job submit for node 69be5de0448e074b3ffe1a0c 2026-03-23 08:59:34,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:34,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5de0448e074b3ffe1a0c HTTP/1.1" 200 None 2026-03-23 08:59:34,387 - lava_callback - DEBUG - Processing node 69be5de0448e074b3ffe1a0c: baseline-arm-clabbe 2026-03-23 08:59:34,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5de0448e074b3ffe1a0c 2026-03-23 08:59:34,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:34,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5de0448e074b3ffe1a0c HTTP/1.1" 200 None 2026-03-23 08:59:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:34,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:59:34,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:34,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5de0448e074b3ffe1a0c HTTP/1.1" 200 None 2026-03-23 08:59:34,451 - lava_callback - ERROR - Error processing callback for node 69be5de0448e074b3ffe1a0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK 2026-03-23 08:59:54,357 - lava_callback - INFO - Received callback for node 69be5e05448e074b3ffe1a1a INFO: 172.21.0.1:34266 - "POST /node/69be5e05448e074b3ffe1a1a HTTP/1.0" 202 Accepted 2026-03-23 08:59:54,366 - lava_callback - INFO - Starting async job submit for node 69be5e05448e074b3ffe1a1a 2026-03-23 08:59:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:54,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e05448e074b3ffe1a1a HTTP/1.1" 200 None 2026-03-23 08:59:54,395 - lava_callback - DEBUG - Processing node 69be5e05448e074b3ffe1a1a: baseline-arm-clabbe 2026-03-23 08:59:54,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5e05448e074b3ffe1a1a 2026-03-23 08:59:54,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:54,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e05448e074b3ffe1a1a HTTP/1.1" 200 None 2026-03-23 08:59:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:54,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 08:59:54,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 08:59:54,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5e05448e074b3ffe1a1a HTTP/1.1" 200 None 2026-03-23 08:59:54,453 - lava_callback - ERROR - Error processing callback for node 69be5e05448e074b3ffe1a1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:00:05,270 - lava_callback - INFO - Received callback for node 69c0fe24acdb2e26c83cd20c INFO: 172.21.0.1:42488 - "POST /node/69c0fe24acdb2e26c83cd20c HTTP/1.0" 202 Accepted 2026-03-23 09:00:05,277 - lava_callback - INFO - Starting async job submit for node 69c0fe24acdb2e26c83cd20c 2026-03-23 09:00:05,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:05,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe24acdb2e26c83cd20c HTTP/1.1" 200 None 2026-03-23 09:00:05,324 - lava_callback - DEBUG - Processing node 69c0fe24acdb2e26c83cd20c: ltp-watchqueue 2026-03-23 09:00:05,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:00:05,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:00:05,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c0fe24acdb2e26c83cd20c/log.txt.gz 2026-03-23 09:00:06,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:00:06,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:00:06,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c0fe24acdb2e26c83cd20c/lava-logs.yaml 2026-03-23 09:00:06,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:00:06,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:00:06,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c0fe24acdb2e26c83cd20c/lava_callback.json.gz INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:00:06,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:06,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe24acdb2e26c83cd20c HTTP/1.1" 200 None 2026-03-23 09:00:06,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:00:06,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe24acdb2e26c83cd20c HTTP/1.1" 200 None 2026-03-23 09:00:06,625 - lava_callback - INFO - Completed processing callback for node 69c0fe24acdb2e26c83cd20c 2026-03-23 09:00:09,587 - lava_callback - INFO - Received callback for node 69c100edacdb2e26c83cd5a7 INFO: 172.21.0.1:42500 - "POST /node/69c100edacdb2e26c83cd5a7 HTTP/1.0" 202 Accepted 2026-03-23 09:00:09,594 - lava_callback - INFO - Starting async job submit for node 69c100edacdb2e26c83cd5a7 2026-03-23 09:00:09,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:09,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c100edacdb2e26c83cd5a7 HTTP/1.1" 200 None 2026-03-23 09:00:09,640 - lava_callback - DEBUG - Processing node 69c100edacdb2e26c83cd5a7: baseline-arm64 2026-03-23 09:00:09,783 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:00:09,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:00:10,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:00:10,030 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c100edacdb2e26c83cd5a7/lava-logs.yaml 2026-03-23 09:00:10,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:00:10,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:00:10,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c100edacdb2e26c83cd5a7/lava_callback.json.gz 2026-03-23 09:00:10,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:10,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c100edacdb2e26c83cd5a7 HTTP/1.1" 200 None 2026-03-23 09:00:10,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:10,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:00:10,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:10,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c100edacdb2e26c83cd5a7 HTTP/1.1" 200 None 2026-03-23 09:00:10,338 - lava_callback - INFO - Completed processing callback for node 69c100edacdb2e26c83cd5a7 INFO: 172.21.0.1:57134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:00:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:29,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 09:00:34,391 - lava_callback - INFO - Received callback for node 69be5e29448e074b3ffe1a27 INFO: 172.21.0.1:60870 - "POST /node/69be5e29448e074b3ffe1a27 HTTP/1.0" 202 Accepted 2026-03-23 09:00:34,397 - lava_callback - INFO - Starting async job submit for node 69be5e29448e074b3ffe1a27 2026-03-23 09:00:34,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:34,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e29448e074b3ffe1a27 HTTP/1.1" 200 None 2026-03-23 09:00:34,433 - lava_callback - DEBUG - Processing node 69be5e29448e074b3ffe1a27: baseline-arm-clabbe 2026-03-23 09:00:34,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5e29448e074b3ffe1a27 2026-03-23 09:00:34,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e29448e074b3ffe1a27 HTTP/1.1" 200 None 2026-03-23 09:00:34,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:34,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 09:00:34,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:00:34,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5e29448e074b3ffe1a27 HTTP/1.1" 200 None 2026-03-23 09:00:34,495 - lava_callback - ERROR - Error processing callback for node 69be5e29448e074b3ffe1a27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:01:14,406 - lava_callback - INFO - Received callback for node 69be5e4d448e074b3ffe1a30 INFO: 172.21.0.1:58086 - "POST /node/69be5e4d448e074b3ffe1a30 HTTP/1.0" 202 Accepted 2026-03-23 09:01:14,412 - lava_callback - INFO - Starting async job submit for node 69be5e4d448e074b3ffe1a30 2026-03-23 09:01:14,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:14,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e4d448e074b3ffe1a30 HTTP/1.1" 200 None 2026-03-23 09:01:14,428 - lava_callback - DEBUG - Processing node 69be5e4d448e074b3ffe1a30: baseline-arm-clabbe 2026-03-23 09:01:14,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5e4d448e074b3ffe1a30 2026-03-23 09:01:14,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:14,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5e4d448e074b3ffe1a30 HTTP/1.1" 200 None 2026-03-23 09:01:14,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:14,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 09:01:14,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:14,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5e4d448e074b3ffe1a30 HTTP/1.1" 200 None 2026-03-23 09:01:14,489 - lava_callback - ERROR - Error processing callback for node 69be5e4d448e074b3ffe1a30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:01:29,183 - lava_callback - INFO - Received callback for node 69c1015dacdb2e26c83cd5d8 INFO: 172.21.0.1:52250 - "POST /node/69c1015dacdb2e26c83cd5d8 HTTP/1.0" 202 Accepted 2026-03-23 09:01:29,189 - lava_callback - INFO - Starting async job submit for node 69c1015dacdb2e26c83cd5d8 2026-03-23 09:01:29,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:29,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1015dacdb2e26c83cd5d8 HTTP/1.1" 200 None 2026-03-23 09:01:29,206 - lava_callback - DEBUG - Processing node 69c1015dacdb2e26c83cd5d8: baseline-arm 2026-03-23 09:01:29,211 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:01:29,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:01:29,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:01:29,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c1015dacdb2e26c83cd5d8/lava-logs.yaml 2026-03-23 09:01:29,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:01:29,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:01:29,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c1015dacdb2e26c83cd5d8/lava_callback.json.gz 2026-03-23 09:01:29,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:29,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1015dacdb2e26c83cd5d8 HTTP/1.1" 200 None 2026-03-23 09:01:29,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:01:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:29,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1015dacdb2e26c83cd5d8 HTTP/1.1" 200 None 2026-03-23 09:01:29,585 - lava_callback - INFO - Completed processing callback for node 69c1015dacdb2e26c83cd5d8 2026-03-23 09:01:29,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:29,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:01:56,577 - lava_callback - INFO - Received callback for node 69c10143acdb2e26c83cd5d1 INFO: 172.21.0.1:41928 - "POST /node/69c10143acdb2e26c83cd5d1 HTTP/1.0" 202 Accepted 2026-03-23 09:01:56,583 - lava_callback - INFO - Starting async job submit for node 69c10143acdb2e26c83cd5d1 2026-03-23 09:01:56,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:56,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10143acdb2e26c83cd5d1 HTTP/1.1" 200 None 2026-03-23 09:01:56,617 - lava_callback - DEBUG - Processing node 69c10143acdb2e26c83cd5d1: baseline-arm-pengutronix 2026-03-23 09:01:56,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:01:56,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:01:56,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10143acdb2e26c83cd5d1/log.txt.gz 2026-03-23 09:01:57,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:01:57,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:01:57,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10143acdb2e26c83cd5d1/lava-logs.yaml 2026-03-23 09:01:57,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:01:57,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:01:57,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10143acdb2e26c83cd5d1/lava_callback.json.gz 2026-03-23 09:01:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:57,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10143acdb2e26c83cd5d1 HTTP/1.1" 200 None 2026-03-23 09:01:57,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:57,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:01:57,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:57,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10143acdb2e26c83cd5d1 HTTP/1.1" 200 None 2026-03-23 09:01:57,445 - lava_callback - INFO - Completed processing callback for node 69c10143acdb2e26c83cd5d1 2026-03-23 09:01:59,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:01:59,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:03:46,637 - lava_callback - INFO - Received callback for node 69c0fdb0acdb2e26c83cd0ff INFO: 172.21.0.1:49266 - "POST /node/69c0fdb0acdb2e26c83cd0ff HTTP/1.0" 202 Accepted 2026-03-23 09:03:46,644 - lava_callback - INFO - Starting async job submit for node 69c0fdb0acdb2e26c83cd0ff 2026-03-23 09:03:46,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:03:46,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb0acdb2e26c83cd0ff HTTP/1.1" 200 None 2026-03-23 09:03:46,735 - lava_callback - DEBUG - Processing node 69c0fdb0acdb2e26c83cd0ff: baseline-arm 2026-03-23 09:03:47,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:03:47,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:03:47,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb0acdb2e26c83cd0ff/log.txt.gz 2026-03-23 09:03:47,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:03:48,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:03:48,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb0acdb2e26c83cd0ff/lava-logs.yaml 2026-03-23 09:03:48,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:03:48,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:03:48,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c0fdb0acdb2e26c83cd0ff/lava_callback.json.gz DEBUG: Setup failed for 69c0fdb0acdb2e26c83cd0ff. Transitting job node result: incomplete -> fail 2026-03-23 09:03:48,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:03:48,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdb0acdb2e26c83cd0ff HTTP/1.1" 200 None 2026-03-23 09:03:48,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:03:48,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:03:48,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:03:48,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdb0acdb2e26c83cd0ff HTTP/1.1" 200 None 2026-03-23 09:03:48,633 - lava_callback - INFO - Completed processing callback for node 69c0fdb0acdb2e26c83cd0ff INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38304 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:03:59,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:03:59,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:04:12,008 - lava_callback - INFO - Received callback for node 69c10182acdb2e26c83cd5e8 INFO: 172.21.0.1:46288 - "POST /node/69c10182acdb2e26c83cd5e8 HTTP/1.0" 202 Accepted 2026-03-23 09:04:12,015 - lava_callback - INFO - Starting async job submit for node 69c10182acdb2e26c83cd5e8 2026-03-23 09:04:12,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:04:12,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10182acdb2e26c83cd5e8 HTTP/1.1" 200 None 2026-03-23 09:04:12,062 - lava_callback - DEBUG - Processing node 69c10182acdb2e26c83cd5e8: baseline-arm64 2026-03-23 09:04:12,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:04:12,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:04:12,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10182acdb2e26c83cd5e8/log.txt.gz 2026-03-23 09:04:12,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:04:12,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:04:12,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10182acdb2e26c83cd5e8/lava-logs.yaml 2026-03-23 09:04:12,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:04:12,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:04:12,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10182acdb2e26c83cd5e8/lava_callback.json.gz 2026-03-23 09:04:12,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:04:12,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10182acdb2e26c83cd5e8 HTTP/1.1" 200 None 2026-03-23 09:04:12,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:04:12,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:04:12,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:04:12,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10182acdb2e26c83cd5e8 HTTP/1.1" 200 None 2026-03-23 09:04:12,911 - lava_callback - INFO - Completed processing callback for node 69c10182acdb2e26c83cd5e8 INFO: 172.21.0.1:46304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:04:29,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:04:29,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:05:04,419 - lava_callback - INFO - Received callback for node 69c101d1acdb2e26c83cd5f6 INFO: 172.21.0.1:54518 - "POST /node/69c101d1acdb2e26c83cd5f6 HTTP/1.0" 202 Accepted 2026-03-23 09:05:04,425 - lava_callback - INFO - Starting async job submit for node 69c101d1acdb2e26c83cd5f6 2026-03-23 09:05:04,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:05:04,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c101d1acdb2e26c83cd5f6 HTTP/1.1" 200 None 2026-03-23 09:05:04,464 - lava_callback - DEBUG - Processing node 69c101d1acdb2e26c83cd5f6: baseline-arm64 2026-03-23 09:05:04,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:05:04,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:05:04,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c101d1acdb2e26c83cd5f6/log.txt.gz 2026-03-23 09:05:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:05:05,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:05:05,380 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c101d1acdb2e26c83cd5f6/lava-logs.yaml 2026-03-23 09:05:05,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:05:05,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:05:05,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c101d1acdb2e26c83cd5f6/lava_callback.json.gz 2026-03-23 09:05:05,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:05:05,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c101d1acdb2e26c83cd5f6 HTTP/1.1" 200 None 2026-03-23 09:05:05,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:05:05,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:05:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:05:05,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c101d1acdb2e26c83cd5f6 HTTP/1.1" 200 None 2026-03-23 09:05:05,724 - lava_callback - INFO - Completed processing callback for node 69c101d1acdb2e26c83cd5f6 INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:05:29,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:05:29,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:06:26,627 - lava_callback - INFO - Received callback for node 69c0fdf5acdb2e26c83cd198 INFO: 172.21.0.1:33148 - "POST /node/69c0fdf5acdb2e26c83cd198 HTTP/1.0" 202 Accepted 2026-03-23 09:06:26,673 - lava_callback - INFO - Starting async job submit for node 69c0fdf5acdb2e26c83cd198 2026-03-23 09:06:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf5acdb2e26c83cd198 HTTP/1.1" 200 None 2026-03-23 09:06:26,715 - lava_callback - DEBUG - Processing node 69c0fdf5acdb2e26c83cd198: baseline-arm-pengutronix 2026-03-23 09:06:26,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:06:26,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:06:26,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf5acdb2e26c83cd198/log.txt.gz 2026-03-23 09:06:27,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:06:27,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:06:27,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf5acdb2e26c83cd198/lava-logs.yaml 2026-03-23 09:06:27,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:06:27,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:06:27,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c0fdf5acdb2e26c83cd198/lava_callback.json.gz DEBUG: Setup failed for 69c0fdf5acdb2e26c83cd198. Transitting job node result: incomplete -> fail 2026-03-23 09:06:27,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:27,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fdf5acdb2e26c83cd198 HTTP/1.1" 200 None 2026-03-23 09:06:27,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:27,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:06:27,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fdf5acdb2e26c83cd198 HTTP/1.1" 200 None 2026-03-23 09:06:27,593 - lava_callback - INFO - Completed processing callback for node 69c0fdf5acdb2e26c83cd198 2026-03-23 09:06:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:30,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:06:41,795 - lava_callback - INFO - Received callback for node 69be5f93448e074b3ffe2071 INFO: 172.21.0.1:38670 - "POST /node/69be5f93448e074b3ffe2071 HTTP/1.0" 202 Accepted 2026-03-23 09:06:41,800 - lava_callback - INFO - Starting async job submit for node 69be5f93448e074b3ffe2071 2026-03-23 09:06:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:41,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5f93448e074b3ffe2071 HTTP/1.1" 200 None 2026-03-23 09:06:41,818 - lava_callback - DEBUG - Processing node 69be5f93448e074b3ffe2071: baseline-arm64-baylibre 2026-03-23 09:06:41,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5f93448e074b3ffe2071 2026-03-23 09:06:41,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:41,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5f93448e074b3ffe2071 HTTP/1.1" 200 None 2026-03-23 09:06:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:41,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:06:41,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:06:41,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5f93448e074b3ffe2071 HTTP/1.1" 200 None 2026-03-23 09:06:41,874 - lava_callback - ERROR - Error processing callback for node 69be5f93448e074b3ffe2071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:08:01,888 - lava_callback - INFO - Received callback for node 69be5fdf448e074b3ffe208d INFO: 172.21.0.1:44226 - "POST /node/69be5fdf448e074b3ffe208d HTTP/1.0" 202 Accepted 2026-03-23 09:08:01,894 - lava_callback - INFO - Starting async job submit for node 69be5fdf448e074b3ffe208d 2026-03-23 09:08:01,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:01,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5fdf448e074b3ffe208d HTTP/1.1" 200 None 2026-03-23 09:08:01,919 - lava_callback - DEBUG - Processing node 69be5fdf448e074b3ffe208d: baseline-arm64-baylibre 2026-03-23 09:08:01,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be5fdf448e074b3ffe208d 2026-03-23 09:08:01,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:01,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5fdf448e074b3ffe208d HTTP/1.1" 200 None 2026-03-23 09:08:01,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:01,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:08:01,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:01,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be5fdf448e074b3ffe208d HTTP/1.1" 200 None 2026-03-23 09:08:02,008 - lava_callback - ERROR - Error processing callback for node 69be5fdf448e074b3ffe208d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:08:10,527 - lava_callback - INFO - Received callback for node 69c0fe47acdb2e26c83cd296 INFO: 172.21.0.1:33158 - "POST /node/69c0fe47acdb2e26c83cd296 HTTP/1.0" 202 Accepted 2026-03-23 09:08:10,535 - lava_callback - INFO - Starting async job submit for node 69c0fe47acdb2e26c83cd296 2026-03-23 09:08:10,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:10,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe47acdb2e26c83cd296 HTTP/1.1" 200 None 2026-03-23 09:08:10,597 - lava_callback - DEBUG - Processing node 69c0fe47acdb2e26c83cd296: baseline-nfs-arm64 2026-03-23 09:08:11,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:08:11,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:08:11,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe47acdb2e26c83cd296/log.txt.gz 2026-03-23 09:08:12,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:08:12,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:08:12,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe47acdb2e26c83cd296/lava-logs.yaml 2026-03-23 09:08:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:08:12,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:08:12,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe47acdb2e26c83cd296/lava_callback.json.gz DEBUG: Setup failed for 69c0fe47acdb2e26c83cd296. Transitting job node result: incomplete -> fail 2026-03-23 09:08:12,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:13,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe47acdb2e26c83cd296 HTTP/1.1" 200 None 2026-03-23 09:08:13,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:13,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:08:13,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:13,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe47acdb2e26c83cd296 HTTP/1.1" 200 None 2026-03-23 09:08:13,156 - lava_callback - INFO - Completed processing callback for node 69c0fe47acdb2e26c83cd296 INFO: 172.21.0.1:33170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:08:30,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:08:30,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:09:01,855 - lava_callback - INFO - Received callback for node 69be6027448e074b3ffe2094 INFO: 172.21.0.1:53778 - "POST /node/69be6027448e074b3ffe2094 HTTP/1.0" 202 Accepted 2026-03-23 09:09:01,861 - lava_callback - INFO - Starting async job submit for node 69be6027448e074b3ffe2094 2026-03-23 09:09:01,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:01,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6027448e074b3ffe2094 HTTP/1.1" 200 None 2026-03-23 09:09:01,877 - lava_callback - DEBUG - Processing node 69be6027448e074b3ffe2094: baseline-arm64-baylibre 2026-03-23 09:09:01,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6027448e074b3ffe2094 2026-03-23 09:09:01,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:01,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6027448e074b3ffe2094 HTTP/1.1" 200 None 2026-03-23 09:09:01,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:01,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:09:01,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:01,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6027448e074b3ffe2094 HTTP/1.1" 200 None 2026-03-23 09:09:01,946 - lava_callback - ERROR - Error processing callback for node 69be6027448e074b3ffe2094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:09:09,720 - lava_callback - INFO - Received callback for node 69c102d5acdb2e26c83cd649 INFO: 172.21.0.1:37644 - "POST /node/69c102d5acdb2e26c83cd649 HTTP/1.0" 202 Accepted 2026-03-23 09:09:09,727 - lava_callback - INFO - Starting async job submit for node 69c102d5acdb2e26c83cd649 2026-03-23 09:09:09,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:09,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c102d5acdb2e26c83cd649 HTTP/1.1" 200 None 2026-03-23 09:09:09,786 - lava_callback - DEBUG - Processing node 69c102d5acdb2e26c83cd649: baseline-arm64 2026-03-23 09:09:10,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:09:10,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:09:10,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c102d5acdb2e26c83cd649/log.txt.gz 2026-03-23 09:09:10,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:09:10,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:09:10,523 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c102d5acdb2e26c83cd649/lava-logs.yaml 2026-03-23 09:09:10,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:09:10,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:09:10,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c102d5acdb2e26c83cd649/lava_callback.json.gz 2026-03-23 09:09:10,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c102d5acdb2e26c83cd649 HTTP/1.1" 200 None 2026-03-23 09:09:10,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:10,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:09:10,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:10,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c102d5acdb2e26c83cd649 HTTP/1.1" 200 None 2026-03-23 09:09:10,765 - lava_callback - INFO - Completed processing callback for node 69c102d5acdb2e26c83cd649 INFO: 172.21.0.1:37652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:09:30,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:09:30,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:10:22,013 - lava_callback - INFO - Received callback for node 69be6075448e074b3ffe209f INFO: 172.21.0.1:43360 - "POST /node/69be6075448e074b3ffe209f HTTP/1.0" 202 Accepted 2026-03-23 09:10:22,019 - lava_callback - INFO - Starting async job submit for node 69be6075448e074b3ffe209f 2026-03-23 09:10:22,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:10:22,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6075448e074b3ffe209f HTTP/1.1" 200 None 2026-03-23 09:10:22,034 - lava_callback - DEBUG - Processing node 69be6075448e074b3ffe209f: baseline-arm64-baylibre 2026-03-23 09:10:22,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6075448e074b3ffe209f 2026-03-23 09:10:22,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:10:22,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6075448e074b3ffe209f HTTP/1.1" 200 None 2026-03-23 09:10:22,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:10:22,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:10:22,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:10:22,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6075448e074b3ffe209f HTTP/1.1" 200 None 2026-03-23 09:10:22,122 - lava_callback - ERROR - Error processing callback for node 69be6075448e074b3ffe209f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:11:26,804 - lava_callback - INFO - Received callback for node 69c0fe4dacdb2e26c83cd2b0 INFO: 172.21.0.1:34834 - "POST /node/69c0fe4dacdb2e26c83cd2b0 HTTP/1.0" 202 Accepted 2026-03-23 09:11:26,811 - lava_callback - INFO - Starting async job submit for node 69c0fe4dacdb2e26c83cd2b0 2026-03-23 09:11:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:26,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4dacdb2e26c83cd2b0 HTTP/1.1" 200 None 2026-03-23 09:11:26,852 - lava_callback - DEBUG - Processing node 69c0fe4dacdb2e26c83cd2b0: baseline-nfs-arm64 2026-03-23 09:11:27,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:11:27,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:11:27,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4dacdb2e26c83cd2b0/log.txt.gz 2026-03-23 09:11:27,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:11:27,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:11:27,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4dacdb2e26c83cd2b0/lava-logs.yaml 2026-03-23 09:11:28,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:11:28,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:11:28,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c0fe4dacdb2e26c83cd2b0/lava_callback.json.gz 2026-03-23 09:11:28,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:28,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe4dacdb2e26c83cd2b0 HTTP/1.1" 200 None 2026-03-23 09:11:28,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:28,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:11:28,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:28,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe4dacdb2e26c83cd2b0 HTTP/1.1" 200 None 2026-03-23 09:11:28,336 - lava_callback - INFO - Completed processing callback for node 69c0fe4dacdb2e26c83cd2b0 2026-03-23 09:11:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:30,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:11:55,095 - lava_callback - INFO - Received callback for node 69be60c5448e074b3ffe20a7 INFO: 172.21.0.1:39038 - "POST /node/69be60c5448e074b3ffe20a7 HTTP/1.0" 202 Accepted 2026-03-23 09:11:55,101 - lava_callback - INFO - Starting async job submit for node 69be60c5448e074b3ffe20a7 2026-03-23 09:11:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:55,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be60c5448e074b3ffe20a7 HTTP/1.1" 200 None 2026-03-23 09:11:55,116 - lava_callback - DEBUG - Processing node 69be60c5448e074b3ffe20a7: baseline-arm64-clabbe 2026-03-23 09:11:55,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be60c5448e074b3ffe20a7 2026-03-23 09:11:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:55,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be60c5448e074b3ffe20a7 HTTP/1.1" 200 None 2026-03-23 09:11:55,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:55,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:11:55,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:11:55,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be60c5448e074b3ffe20a7 HTTP/1.1" 200 None 2026-03-23 09:11:55,174 - lava_callback - ERROR - Error processing callback for node 69be60c5448e074b3ffe20a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:12:55,078 - lava_callback - INFO - Received callback for node 69be610f448e074b3ffe20b1 INFO: 172.21.0.1:54692 - "POST /node/69be610f448e074b3ffe20b1 HTTP/1.0" 202 Accepted 2026-03-23 09:12:55,084 - lava_callback - INFO - Starting async job submit for node 69be610f448e074b3ffe20b1 2026-03-23 09:12:55,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:12:55,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be610f448e074b3ffe20b1 HTTP/1.1" 200 None 2026-03-23 09:12:55,141 - lava_callback - DEBUG - Processing node 69be610f448e074b3ffe20b1: baseline-arm64-clabbe 2026-03-23 09:12:55,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be610f448e074b3ffe20b1 2026-03-23 09:12:55,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:12:55,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be610f448e074b3ffe20b1 HTTP/1.1" 200 None 2026-03-23 09:12:55,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:12:55,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:12:55,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:12:55,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be610f448e074b3ffe20b1 HTTP/1.1" 200 None 2026-03-23 09:12:55,249 - lava_callback - ERROR - Error processing callback for node 69be610f448e074b3ffe20b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:14:15,098 - lava_callback - INFO - Received callback for node 69be615a448e074b3ffe20ba INFO: 172.21.0.1:42122 - "POST /node/69be615a448e074b3ffe20ba HTTP/1.0" 202 Accepted 2026-03-23 09:14:15,104 - lava_callback - INFO - Starting async job submit for node 69be615a448e074b3ffe20ba 2026-03-23 09:14:15,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:14:15,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be615a448e074b3ffe20ba HTTP/1.1" 200 None 2026-03-23 09:14:15,119 - lava_callback - DEBUG - Processing node 69be615a448e074b3ffe20ba: baseline-arm64-clabbe 2026-03-23 09:14:15,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be615a448e074b3ffe20ba 2026-03-23 09:14:15,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:14:15,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be615a448e074b3ffe20ba HTTP/1.1" 200 None 2026-03-23 09:14:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:14:15,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:14:15,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42134 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 09:14:15,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be615a448e074b3ffe20ba HTTP/1.1" 200 None 2026-03-23 09:14:15,182 - lava_callback - ERROR - Error processing callback for node 69be615a448e074b3ffe20ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:15:35,192 - lava_callback - INFO - Received callback for node 69be61a4448e074b3ffe20c5 INFO: 172.21.0.1:44486 - "POST /node/69be61a4448e074b3ffe20c5 HTTP/1.0" 202 Accepted 2026-03-23 09:15:35,198 - lava_callback - INFO - Starting async job submit for node 69be61a4448e074b3ffe20c5 2026-03-23 09:15:35,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:35,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be61a4448e074b3ffe20c5 HTTP/1.1" 200 None 2026-03-23 09:15:35,215 - lava_callback - DEBUG - Processing node 69be61a4448e074b3ffe20c5: baseline-arm64-clabbe 2026-03-23 09:15:35,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be61a4448e074b3ffe20c5 2026-03-23 09:15:35,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:35,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be61a4448e074b3ffe20c5 HTTP/1.1" 200 None 2026-03-23 09:15:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:35,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:15:35,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be61a4448e074b3ffe20c5 HTTP/1.1" 200 None 2026-03-23 09:15:35,280 - lava_callback - ERROR - Error processing callback for node 69be61a4448e074b3ffe20c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:15:45,659 - lava_callback - INFO - Received callback for node 69c0fe1cacdb2e26c83cd1f4 INFO: 172.21.0.1:58034 - "POST /node/69c0fe1cacdb2e26c83cd1f4 HTTP/1.0" 202 Accepted 2026-03-23 09:15:45,705 - lava_callback - INFO - Starting async job submit for node 69c0fe1cacdb2e26c83cd1f4 2026-03-23 09:15:45,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:45,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1cacdb2e26c83cd1f4 HTTP/1.1" 200 None 2026-03-23 09:15:45,750 - lava_callback - DEBUG - Processing node 69c0fe1cacdb2e26c83cd1f4: ltp-sched 2026-03-23 09:15:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:15:45,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:15:45,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c0fe1cacdb2e26c83cd1f4/log.txt.gz 2026-03-23 09:15:46,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:15:46,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:15:46,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c0fe1cacdb2e26c83cd1f4/lava-logs.yaml 2026-03-23 09:15:46,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:15:46,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:15:46,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c0fe1cacdb2e26c83cd1f4/lava_callback.json.gz 2026-03-23 09:15:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:46,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fe1cacdb2e26c83cd1f4 HTTP/1.1" 200 None 2026-03-23 09:15:46,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:46,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:15:46,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:15:46,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fe1cacdb2e26c83cd1f4 HTTP/1.1" 200 None 2026-03-23 09:15:46,499 - lava_callback - INFO - Completed processing callback for node 69c0fe1cacdb2e26c83cd1f4 INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:16:00,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:16:00,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:16:35,235 - lava_callback - INFO - Received callback for node 69be61ee448e074b3ffe20ce INFO: 172.21.0.1:50792 - "POST /node/69be61ee448e074b3ffe20ce HTTP/1.0" 202 Accepted 2026-03-23 09:16:35,241 - lava_callback - INFO - Starting async job submit for node 69be61ee448e074b3ffe20ce 2026-03-23 09:16:35,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:16:35,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be61ee448e074b3ffe20ce HTTP/1.1" 200 None 2026-03-23 09:16:35,264 - lava_callback - DEBUG - Processing node 69be61ee448e074b3ffe20ce: baseline-arm64-clabbe 2026-03-23 09:16:35,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be61ee448e074b3ffe20ce 2026-03-23 09:16:35,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:16:35,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be61ee448e074b3ffe20ce HTTP/1.1" 200 None 2026-03-23 09:16:35,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:16:35,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:16:35,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:16:35,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be61ee448e074b3ffe20ce HTTP/1.1" 200 None 2026-03-23 09:16:35,329 - lava_callback - ERROR - Error processing callback for node 69be61ee448e074b3ffe20ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:17:55,254 - lava_callback - INFO - Received callback for node 69be6239448e074b3ffe20d7 INFO: 172.21.0.1:57460 - "POST /node/69be6239448e074b3ffe20d7 HTTP/1.0" 202 Accepted 2026-03-23 09:17:55,260 - lava_callback - INFO - Starting async job submit for node 69be6239448e074b3ffe20d7 2026-03-23 09:17:55,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:17:55,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6239448e074b3ffe20d7 HTTP/1.1" 200 None 2026-03-23 09:17:55,276 - lava_callback - DEBUG - Processing node 69be6239448e074b3ffe20d7: baseline-arm64-clabbe 2026-03-23 09:17:55,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6239448e074b3ffe20d7 2026-03-23 09:17:55,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:17:55,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6239448e074b3ffe20d7 HTTP/1.1" 200 None 2026-03-23 09:17:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:17:55,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 09:17:55,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:17:55,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6239448e074b3ffe20d7 HTTP/1.1" 200 None 2026-03-23 09:17:55,333 - lava_callback - ERROR - Error processing callback for node 69be6239448e074b3ffe20d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:22:42,789 - lava_callback - INFO - Received callback for node 69be6359448e074b3ffe217e INFO: 172.21.0.1:41244 - "POST /node/69be6359448e074b3ffe217e HTTP/1.0" 202 Accepted 2026-03-23 09:22:42,794 - lava_callback - INFO - Starting async job submit for node 69be6359448e074b3ffe217e 2026-03-23 09:22:42,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:42,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6359448e074b3ffe217e HTTP/1.1" 200 None 2026-03-23 09:22:42,820 - lava_callback - DEBUG - Processing node 69be6359448e074b3ffe217e: baseline-arm64-baylibre 2026-03-23 09:22:42,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6359448e074b3ffe217e 2026-03-23 09:22:42,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:42,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6359448e074b3ffe217e HTTP/1.1" 200 None 2026-03-23 09:22:42,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:42,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:42,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:42,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6359448e074b3ffe217e HTTP/1.1" 200 None 2026-03-23 09:22:42,876 - lava_callback - ERROR - Error processing callback for node 69be6359448e074b3ffe217e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:22:43,475 - lava_callback - INFO - Received callback for node 69be635a448e074b3ffe2181 INFO: 172.21.0.1:41260 - "POST /node/69be635a448e074b3ffe2181 HTTP/1.0" 202 Accepted 2026-03-23 09:22:43,481 - lava_callback - INFO - Starting async job submit for node 69be635a448e074b3ffe2181 2026-03-23 09:22:43,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:43,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635a448e074b3ffe2181 HTTP/1.1" 200 None 2026-03-23 09:22:43,497 - lava_callback - DEBUG - Processing node 69be635a448e074b3ffe2181: baseline-arm64-baylibre 2026-03-23 09:22:43,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be635a448e074b3ffe2181 2026-03-23 09:22:43,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:43,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635a448e074b3ffe2181 HTTP/1.1" 200 None 2026-03-23 09:22:43,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:43,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:43,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:43,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be635a448e074b3ffe2181 HTTP/1.1" 200 None 2026-03-23 09:22:43,554 - lava_callback - ERROR - Error processing callback for node 69be635a448e074b3ffe2181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:22:44,164 - lava_callback - INFO - Received callback for node 69be635f448e074b3ffe218e INFO: 172.21.0.1:41268 - "POST /node/69be635f448e074b3ffe218e HTTP/1.0" 202 Accepted 2026-03-23 09:22:44,170 - lava_callback - INFO - Starting async job submit for node 69be635f448e074b3ffe218e 2026-03-23 09:22:44,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635f448e074b3ffe218e HTTP/1.1" 200 None 2026-03-23 09:22:44,186 - lava_callback - DEBUG - Processing node 69be635f448e074b3ffe218e: baseline-arm64-baylibre 2026-03-23 09:22:44,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be635f448e074b3ffe218e 2026-03-23 09:22:44,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635f448e074b3ffe218e HTTP/1.1" 200 None 2026-03-23 09:22:44,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:44,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be635f448e074b3ffe218e HTTP/1.1" 200 None 2026-03-23 09:22:44,243 - lava_callback - ERROR - Error processing callback for node 69be635f448e074b3ffe218e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:22:44,821 - lava_callback - INFO - Received callback for node 69be6357448e074b3ffe217b INFO: 172.21.0.1:41270 - "POST /node/69be6357448e074b3ffe217b HTTP/1.0" 202 Accepted 2026-03-23 09:22:44,827 - lava_callback - INFO - Starting async job submit for node 69be6357448e074b3ffe217b 2026-03-23 09:22:44,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6357448e074b3ffe217b HTTP/1.1" 200 None 2026-03-23 09:22:44,843 - lava_callback - DEBUG - Processing node 69be6357448e074b3ffe217b: baseline-arm64-baylibre 2026-03-23 09:22:44,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6357448e074b3ffe217b 2026-03-23 09:22:44,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6357448e074b3ffe217b HTTP/1.1" 200 None 2026-03-23 09:22:44,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:44,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:44,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6357448e074b3ffe217b HTTP/1.1" 200 None 2026-03-23 09:22:44,897 - lava_callback - ERROR - Error processing callback for node 69be6357448e074b3ffe217b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:22:45,491 - lava_callback - INFO - Received callback for node 69be635c448e074b3ffe2188 INFO: 172.21.0.1:41274 - "POST /node/69be635c448e074b3ffe2188 HTTP/1.0" 202 Accepted 2026-03-23 09:22:45,497 - lava_callback - INFO - Starting async job submit for node 69be635c448e074b3ffe2188 2026-03-23 09:22:45,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:45,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635c448e074b3ffe2188 HTTP/1.1" 200 None 2026-03-23 09:22:45,513 - lava_callback - DEBUG - Processing node 69be635c448e074b3ffe2188: baseline-arm64-baylibre 2026-03-23 09:22:45,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be635c448e074b3ffe2188 2026-03-23 09:22:45,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:45,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635c448e074b3ffe2188 HTTP/1.1" 200 None 2026-03-23 09:22:45,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:45,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:45,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:45,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be635c448e074b3ffe2188 HTTP/1.1" 200 None 2026-03-23 09:22:45,578 - lava_callback - ERROR - Error processing callback for node 69be635c448e074b3ffe2188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:22:46,140 - lava_callback - INFO - Received callback for node 69be635e448e074b3ffe218b INFO: 172.21.0.1:41288 - "POST /node/69be635e448e074b3ffe218b HTTP/1.0" 202 Accepted 2026-03-23 09:22:46,146 - lava_callback - INFO - Starting async job submit for node 69be635e448e074b3ffe218b 2026-03-23 09:22:46,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:46,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635e448e074b3ffe218b HTTP/1.1" 200 None 2026-03-23 09:22:46,161 - lava_callback - DEBUG - Processing node 69be635e448e074b3ffe218b: baseline-arm64-baylibre 2026-03-23 09:22:46,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be635e448e074b3ffe218b 2026-03-23 09:22:46,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:46,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be635e448e074b3ffe218b HTTP/1.1" 200 None 2026-03-23 09:22:46,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:46,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:22:46,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:22:46,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be635e448e074b3ffe218b HTTP/1.1" 200 None 2026-03-23 09:22:46,226 - lava_callback - ERROR - Error processing callback for node 69be635e448e074b3ffe218b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 09:23:15,547 - lava_callback - INFO - Received callback for node 69be636f448e074b3ffe21d6 INFO: 172.21.0.1:60072 - "POST /node/69be636f448e074b3ffe21d6 HTTP/1.0" 202 Accepted 2026-03-23 09:23:15,553 - lava_callback - INFO - Starting async job submit for node 69be636f448e074b3ffe21d6 2026-03-23 09:23:15,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:15,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be636f448e074b3ffe21d6 HTTP/1.1" 200 None 2026-03-23 09:23:15,569 - lava_callback - DEBUG - Processing node 69be636f448e074b3ffe21d6: baseline-arm64-clabbe 2026-03-23 09:23:15,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be636f448e074b3ffe21d6 2026-03-23 09:23:15,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:15,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be636f448e074b3ffe21d6 HTTP/1.1" 200 None 2026-03-23 09:23:15,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:15,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:15,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:15,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be636f448e074b3ffe21d6 HTTP/1.1" 200 None 2026-03-23 09:23:15,634 - lava_callback - ERROR - Error processing callback for node 69be636f448e074b3ffe21d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:23:16,215 - lava_callback - INFO - Received callback for node 69be6371448e074b3ffe21d9 INFO: 172.21.0.1:60088 - "POST /node/69be6371448e074b3ffe21d9 HTTP/1.0" 202 Accepted 2026-03-23 09:23:16,221 - lava_callback - INFO - Starting async job submit for node 69be6371448e074b3ffe21d9 2026-03-23 09:23:16,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6371448e074b3ffe21d9 HTTP/1.1" 200 None 2026-03-23 09:23:16,236 - lava_callback - DEBUG - Processing node 69be6371448e074b3ffe21d9: baseline-arm64-clabbe 2026-03-23 09:23:16,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6371448e074b3ffe21d9 2026-03-23 09:23:16,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6371448e074b3ffe21d9 HTTP/1.1" 200 None 2026-03-23 09:23:16,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:16,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6371448e074b3ffe21d9 HTTP/1.1" 200 None 2026-03-23 09:23:16,292 - lava_callback - ERROR - Error processing callback for node 69be6371448e074b3ffe21d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:23:16,915 - lava_callback - INFO - Received callback for node 69be6372448e074b3ffe21dc INFO: 172.21.0.1:60106 - "POST /node/69be6372448e074b3ffe21dc HTTP/1.0" 202 Accepted 2026-03-23 09:23:16,921 - lava_callback - INFO - Starting async job submit for node 69be6372448e074b3ffe21dc 2026-03-23 09:23:16,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6372448e074b3ffe21dc HTTP/1.1" 200 None 2026-03-23 09:23:16,937 - lava_callback - DEBUG - Processing node 69be6372448e074b3ffe21dc: baseline-arm64-clabbe 2026-03-23 09:23:16,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6372448e074b3ffe21dc 2026-03-23 09:23:16,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6372448e074b3ffe21dc HTTP/1.1" 200 None 2026-03-23 09:23:16,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:16,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:16,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6372448e074b3ffe21dc HTTP/1.1" 200 None 2026-03-23 09:23:16,993 - lava_callback - ERROR - Error processing callback for node 69be6372448e074b3ffe21dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:23:17,565 - lava_callback - INFO - Received callback for node 69be6372448e074b3ffe21df INFO: 172.21.0.1:60118 - "POST /node/69be6372448e074b3ffe21df HTTP/1.0" 202 Accepted 2026-03-23 09:23:17,571 - lava_callback - INFO - Starting async job submit for node 69be6372448e074b3ffe21df 2026-03-23 09:23:17,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:17,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6372448e074b3ffe21df HTTP/1.1" 200 None 2026-03-23 09:23:17,594 - lava_callback - DEBUG - Processing node 69be6372448e074b3ffe21df: baseline-arm64-clabbe 2026-03-23 09:23:17,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6372448e074b3ffe21df 2026-03-23 09:23:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:17,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6372448e074b3ffe21df HTTP/1.1" 200 None 2026-03-23 09:23:17,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:17,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:17,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:17,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6372448e074b3ffe21df HTTP/1.1" 200 None 2026-03-23 09:23:17,652 - lava_callback - ERROR - Error processing callback for node 69be6372448e074b3ffe21df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:23:18,225 - lava_callback - INFO - Received callback for node 69be6374448e074b3ffe21e5 INFO: 172.21.0.1:60124 - "POST /node/69be6374448e074b3ffe21e5 HTTP/1.0" 202 Accepted 2026-03-23 09:23:18,231 - lava_callback - INFO - Starting async job submit for node 69be6374448e074b3ffe21e5 2026-03-23 09:23:18,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6374448e074b3ffe21e5 HTTP/1.1" 200 None 2026-03-23 09:23:18,249 - lava_callback - DEBUG - Processing node 69be6374448e074b3ffe21e5: baseline-arm64-clabbe 2026-03-23 09:23:18,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6374448e074b3ffe21e5 2026-03-23 09:23:18,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6374448e074b3ffe21e5 HTTP/1.1" 200 None 2026-03-23 09:23:18,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:18,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6374448e074b3ffe21e5 HTTP/1.1" 200 None 2026-03-23 09:23:18,318 - lava_callback - ERROR - Error processing callback for node 69be6374448e074b3ffe21e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 09:23:18,909 - lava_callback - INFO - Received callback for node 69be6375448e074b3ffe21ef INFO: 172.21.0.1:60136 - "POST /node/69be6375448e074b3ffe21ef HTTP/1.0" 202 Accepted 2026-03-23 09:23:18,915 - lava_callback - INFO - Starting async job submit for node 69be6375448e074b3ffe21ef 2026-03-23 09:23:18,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6375448e074b3ffe21ef HTTP/1.1" 200 None 2026-03-23 09:23:18,931 - lava_callback - DEBUG - Processing node 69be6375448e074b3ffe21ef: baseline-arm64-clabbe 2026-03-23 09:23:18,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6375448e074b3ffe21ef 2026-03-23 09:23:18,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6375448e074b3ffe21ef HTTP/1.1" 200 None 2026-03-23 09:23:18,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 09:23:18,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:18,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6375448e074b3ffe21ef HTTP/1.1" 200 None 2026-03-23 09:23:18,983 - lava_callback - ERROR - Error processing callback for node 69be6375448e074b3ffe21ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:23:40,177 - lava_callback - INFO - Received callback for node 69c1028bacdb2e26c83cd628 INFO: 172.21.0.1:37766 - "POST /node/69c1028bacdb2e26c83cd628 HTTP/1.0" 202 Accepted 2026-03-23 09:23:40,184 - lava_callback - INFO - Starting async job submit for node 69c1028bacdb2e26c83cd628 2026-03-23 09:23:40,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:40,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1028bacdb2e26c83cd628 HTTP/1.1" 200 None 2026-03-23 09:23:40,257 - lava_callback - DEBUG - Processing node 69c1028bacdb2e26c83cd628: ltp-smoke 2026-03-23 09:23:40,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:23:40,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:23:40,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c1028bacdb2e26c83cd628/log.txt.gz 2026-03-23 09:23:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:23:41,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:23:41,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c1028bacdb2e26c83cd628/lava-logs.yaml 2026-03-23 09:23:41,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:23:41,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:23:41,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c1028bacdb2e26c83cd628/lava_callback.json.gz 2026-03-23 09:23:41,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:41,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1028bacdb2e26c83cd628 HTTP/1.1" 200 None 2026-03-23 09:23:41,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:41,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f734acdb2e26c83cca26 HTTP/1.1" 200 None 2026-03-23 09:23:41,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:41,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1028bacdb2e26c83cd628 HTTP/1.1" 200 None 2026-03-23 09:23:41,953 - lava_callback - INFO - Completed processing callback for node 69c1028bacdb2e26c83cd628 2026-03-23 09:23:43,032 - lava_callback - INFO - Received callback for node 69c10685acdb2e26c83cd748 INFO: 172.21.0.1:37772 - "POST /node/69c10685acdb2e26c83cd748 HTTP/1.0" 202 Accepted 2026-03-23 09:23:43,037 - lava_callback - INFO - Starting async job submit for node 69c10685acdb2e26c83cd748 2026-03-23 09:23:43,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:43,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10685acdb2e26c83cd748 HTTP/1.1" 200 None 2026-03-23 09:23:43,055 - lava_callback - DEBUG - Processing node 69c10685acdb2e26c83cd748: baseline-nfs-arm64 2026-03-23 09:23:43,056 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:23:43,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:23:43,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:23:43,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c10685acdb2e26c83cd748/lava-logs.yaml 2026-03-23 09:23:43,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:23:43,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:23:43,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c10685acdb2e26c83cd748/lava_callback.json.gz 2026-03-23 09:23:43,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:43,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10685acdb2e26c83cd748 HTTP/1.1" 200 None 2026-03-23 09:23:43,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:43,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:23:43,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:23:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10685acdb2e26c83cd748 HTTP/1.1" 200 None 2026-03-23 09:23:43,379 - lava_callback - INFO - Completed processing callback for node 69c10685acdb2e26c83cd748 INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:24:00,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:24:00,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:25:04,262 - lava_callback - INFO - Received callback for node 69c1021facdb2e26c83cd60b INFO: 172.21.0.1:47434 - "POST /node/69c1021facdb2e26c83cd60b HTTP/1.0" 202 Accepted 2026-03-23 09:25:04,268 - lava_callback - INFO - Starting async job submit for node 69c1021facdb2e26c83cd60b 2026-03-23 09:25:04,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:04,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1021facdb2e26c83cd60b HTTP/1.1" 200 None 2026-03-23 09:25:04,323 - lava_callback - DEBUG - Processing node 69c1021facdb2e26c83cd60b: baseline-arm64 2026-03-23 09:25:04,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:05,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:05,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1021facdb2e26c83cd60b/log.txt.gz 2026-03-23 09:25:05,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:05,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:05,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1021facdb2e26c83cd60b/lava-logs.yaml 2026-03-23 09:25:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:05,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:05,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1021facdb2e26c83cd60b/lava_callback.json.gz DEBUG: Setup failed for 69c1021facdb2e26c83cd60b. Transitting job node result: incomplete -> fail 2026-03-23 09:25:05,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:05,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1021facdb2e26c83cd60b HTTP/1.1" 200 None 2026-03-23 09:25:05,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:25:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1021facdb2e26c83cd60b HTTP/1.1" 200 None 2026-03-23 09:25:05,953 - lava_callback - INFO - Completed processing callback for node 69c1021facdb2e26c83cd60b INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:25:30,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:30,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:25:47,653 - lava_callback - INFO - Received callback for node 69c10538acdb2e26c83cd6f1 INFO: 172.21.0.1:56330 - "POST /node/69c10538acdb2e26c83cd6f1 HTTP/1.0" 202 Accepted 2026-03-23 09:25:47,660 - lava_callback - INFO - Starting async job submit for node 69c10538acdb2e26c83cd6f1 2026-03-23 09:25:47,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:47,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10538acdb2e26c83cd6f1 HTTP/1.1" 200 None 2026-03-23 09:25:47,712 - lava_callback - DEBUG - Processing node 69c10538acdb2e26c83cd6f1: baseline-arm64 2026-03-23 09:25:48,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:48,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:48,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10538acdb2e26c83cd6f1/log.txt.gz 2026-03-23 09:25:48,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:48,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:48,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10538acdb2e26c83cd6f1/lava-logs.yaml 2026-03-23 09:25:48,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:25:48,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:25:48,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10538acdb2e26c83cd6f1/lava_callback.json.gz DEBUG: Setup failed for 69c10538acdb2e26c83cd6f1. Transitting job node result: incomplete -> fail 2026-03-23 09:25:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:48,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10538acdb2e26c83cd6f1 HTTP/1.1" 200 None 2026-03-23 09:25:48,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:48,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:25:48,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:25:48,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10538acdb2e26c83cd6f1 HTTP/1.1" 200 None 2026-03-23 09:25:49,041 - lava_callback - INFO - Completed processing callback for node 69c10538acdb2e26c83cd6f1 INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:26:00,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:26:00,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:28:18,777 - lava_callback - INFO - Received callback for node 69c10781acdb2e26c83cd796 INFO: 172.21.0.1:57304 - "POST /node/69c10781acdb2e26c83cd796 HTTP/1.0" 202 Accepted 2026-03-23 09:28:18,784 - lava_callback - INFO - Starting async job submit for node 69c10781acdb2e26c83cd796 2026-03-23 09:28:18,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:28:18,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10781acdb2e26c83cd796 HTTP/1.1" 200 None 2026-03-23 09:28:18,829 - lava_callback - DEBUG - Processing node 69c10781acdb2e26c83cd796: baseline-arm64 2026-03-23 09:28:18,960 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:28:19,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:28:19,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:28:19,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10781acdb2e26c83cd796/lava-logs.yaml 2026-03-23 09:28:19,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:28:19,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:28:19,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c10781acdb2e26c83cd796/lava_callback.json.gz 2026-03-23 09:28:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:28:19,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10781acdb2e26c83cd796 HTTP/1.1" 200 None 2026-03-23 09:28:19,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:28:19,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:28:19,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:28:19,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10781acdb2e26c83cd796 HTTP/1.1" 200 None 2026-03-23 09:28:19,529 - lava_callback - INFO - Completed processing callback for node 69c10781acdb2e26c83cd796 INFO: 172.21.0.1:57400 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:28:30,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:28:30,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:30:03,949 - lava_callback - INFO - Received callback for node 69c10815acdb2e26c83cd7b9 INFO: 172.21.0.1:51560 - "POST /node/69c10815acdb2e26c83cd7b9 HTTP/1.0" 202 Accepted 2026-03-23 09:30:03,955 - lava_callback - INFO - Starting async job submit for node 69c10815acdb2e26c83cd7b9 2026-03-23 09:30:03,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:30:03,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10815acdb2e26c83cd7b9 HTTP/1.1" 200 None 2026-03-23 09:30:03,973 - lava_callback - DEBUG - Processing node 69c10815acdb2e26c83cd7b9: baseline-arm 2026-03-23 09:30:03,978 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:30:03,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:30:04,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:30:04,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c10815acdb2e26c83cd7b9/lava-logs.yaml 2026-03-23 09:30:04,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:30:04,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:30:04,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c10815acdb2e26c83cd7b9/lava_callback.json.gz 2026-03-23 09:30:04,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:30:04,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10815acdb2e26c83cd7b9 HTTP/1.1" 200 None 2026-03-23 09:30:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:30:04,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:30:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:30:04,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10815acdb2e26c83cd7b9 HTTP/1.1" 200 None 2026-03-23 09:30:04,434 - lava_callback - INFO - Completed processing callback for node 69c10815acdb2e26c83cd7b9 INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:30:30,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:30:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:33:04,953 - lava_callback - INFO - Received callback for node 69c1085eacdb2e26c83cd7d0 INFO: 172.21.0.1:50740 - "POST /node/69c1085eacdb2e26c83cd7d0 HTTP/1.0" 202 Accepted 2026-03-23 09:33:04,960 - lava_callback - INFO - Starting async job submit for node 69c1085eacdb2e26c83cd7d0 2026-03-23 09:33:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:05,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1085eacdb2e26c83cd7d0 HTTP/1.1" 200 None 2026-03-23 09:33:05,006 - lava_callback - DEBUG - Processing node 69c1085eacdb2e26c83cd7d0: baseline-arm64 2026-03-23 09:33:05,205 - lava_callback - WARNING - Failed to upload log 2026-03-23 09:33:05,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:33:05,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:33:05,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1085eacdb2e26c83cd7d0/lava-logs.yaml 2026-03-23 09:33:05,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:33:05,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:33:05,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1085eacdb2e26c83cd7d0/lava_callback.json.gz 2026-03-23 09:33:05,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:05,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1085eacdb2e26c83cd7d0 HTTP/1.1" 200 None 2026-03-23 09:33:05,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:05,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:33:05,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:05,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1085eacdb2e26c83cd7d0 HTTP/1.1" 200 None 2026-03-23 09:33:05,822 - lava_callback - INFO - Completed processing callback for node 69c1085eacdb2e26c83cd7d0 INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:33:26,926 - lava_callback - INFO - Received callback for node 69c108aaacdb2e26c83cd7db INFO: 172.21.0.1:53666 - "POST /node/69c108aaacdb2e26c83cd7db HTTP/1.0" 202 Accepted 2026-03-23 09:33:26,932 - lava_callback - INFO - Starting async job submit for node 69c108aaacdb2e26c83cd7db 2026-03-23 09:33:26,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:26,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c108aaacdb2e26c83cd7db HTTP/1.1" 200 None 2026-03-23 09:33:26,969 - lava_callback - DEBUG - Processing node 69c108aaacdb2e26c83cd7db: baseline-arm64 2026-03-23 09:33:27,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:33:27,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:33:27,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c108aaacdb2e26c83cd7db/log.txt.gz 2026-03-23 09:33:27,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:33:27,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:33:27,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c108aaacdb2e26c83cd7db/lava-logs.yaml 2026-03-23 09:33:27,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:33:27,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:33:27,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c108aaacdb2e26c83cd7db/lava_callback.json.gz 2026-03-23 09:33:28,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:28,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c108aaacdb2e26c83cd7db HTTP/1.1" 200 None 2026-03-23 09:33:28,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:28,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:33:28,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:28,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c108aaacdb2e26c83cd7db HTTP/1.1" 200 None 2026-03-23 09:33:28,156 - lava_callback - INFO - Completed processing callback for node 69c108aaacdb2e26c83cd7db 2026-03-23 09:33:30,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:33:30,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:35:49,626 - lava_callback - INFO - Received callback for node 69c106efacdb2e26c83cd76e INFO: 172.21.0.1:34434 - "POST /node/69c106efacdb2e26c83cd76e HTTP/1.0" 202 Accepted 2026-03-23 09:35:49,633 - lava_callback - INFO - Starting async job submit for node 69c106efacdb2e26c83cd76e 2026-03-23 09:35:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:35:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c106efacdb2e26c83cd76e HTTP/1.1" 200 None 2026-03-23 09:35:49,672 - lava_callback - DEBUG - Processing node 69c106efacdb2e26c83cd76e: baseline-arm64 2026-03-23 09:35:50,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:35:50,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:35:50,339 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c106efacdb2e26c83cd76e/log.txt.gz 2026-03-23 09:35:50,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:35:50,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:35:50,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c106efacdb2e26c83cd76e/lava-logs.yaml 2026-03-23 09:35:50,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:35:50,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:35:50,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c106efacdb2e26c83cd76e/lava_callback.json.gz 2026-03-23 09:35:51,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:35:51,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c106efacdb2e26c83cd76e HTTP/1.1" 200 None 2026-03-23 09:35:51,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:35:51,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:35:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:35:51,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c106efacdb2e26c83cd76e HTTP/1.1" 200 None 2026-03-23 09:35:51,103 - lava_callback - INFO - Completed processing callback for node 69c106efacdb2e26c83cd76e INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:36:00,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:36:00,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:44:24,150 - lava_callback - INFO - Received callback for node 69be6866448e074b3ffe2404 INFO: 172.21.0.1:57344 - "POST /node/69be6866448e074b3ffe2404 HTTP/1.0" 202 Accepted 2026-03-23 09:44:24,156 - lava_callback - INFO - Starting async job submit for node 69be6866448e074b3ffe2404 2026-03-23 09:44:24,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:44:24,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6866448e074b3ffe2404 HTTP/1.1" 200 None 2026-03-23 09:44:24,181 - lava_callback - DEBUG - Processing node 69be6866448e074b3ffe2404: baseline-arm64-baylibre 2026-03-23 09:44:24,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6866448e074b3ffe2404 2026-03-23 09:44:24,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:44:24,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6866448e074b3ffe2404 HTTP/1.1" 200 None 2026-03-23 09:44:24,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:44:24,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:44:24,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:44:24,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6866448e074b3ffe2404 HTTP/1.1" 200 None 2026-03-23 09:44:24,249 - lava_callback - ERROR - Error processing callback for node 69be6866448e074b3ffe2404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:45:23,859 - lava_callback - INFO - Received callback for node 69be68b1448e074b3ffe2416 INFO: 172.21.0.1:54296 - "POST /node/69be68b1448e074b3ffe2416 HTTP/1.0" 202 Accepted 2026-03-23 09:45:23,866 - lava_callback - INFO - Starting async job submit for node 69be68b1448e074b3ffe2416 2026-03-23 09:45:23,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:45:23,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be68b1448e074b3ffe2416 HTTP/1.1" 200 None 2026-03-23 09:45:23,882 - lava_callback - DEBUG - Processing node 69be68b1448e074b3ffe2416: baseline-arm64-baylibre 2026-03-23 09:45:23,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be68b1448e074b3ffe2416 2026-03-23 09:45:23,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:45:23,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be68b1448e074b3ffe2416 HTTP/1.1" 200 None 2026-03-23 09:45:23,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:45:23,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:45:23,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:45:23,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be68b1448e074b3ffe2416 HTTP/1.1" 200 None 2026-03-23 09:45:23,938 - lava_callback - ERROR - Error processing callback for node 69be68b1448e074b3ffe2416: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:46:44,033 - lava_callback - INFO - Received callback for node 69be68fc448e074b3ffe2423 INFO: 172.21.0.1:35764 - "POST /node/69be68fc448e074b3ffe2423 HTTP/1.0" 202 Accepted 2026-03-23 09:46:44,039 - lava_callback - INFO - Starting async job submit for node 69be68fc448e074b3ffe2423 2026-03-23 09:46:44,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:46:44,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be68fc448e074b3ffe2423 HTTP/1.1" 200 None 2026-03-23 09:46:44,060 - lava_callback - DEBUG - Processing node 69be68fc448e074b3ffe2423: baseline-arm64-baylibre 2026-03-23 09:46:44,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be68fc448e074b3ffe2423 2026-03-23 09:46:44,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:46:44,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be68fc448e074b3ffe2423 HTTP/1.1" 200 None 2026-03-23 09:46:44,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:46:44,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:46:44,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:46:44,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be68fc448e074b3ffe2423 HTTP/1.1" 200 None 2026-03-23 09:46:44,119 - lava_callback - ERROR - Error processing callback for node 69be68fc448e074b3ffe2423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:48:41,308 - lava_callback - INFO - Received callback for node 69c10839acdb2e26c83cd7c6 INFO: 172.21.0.1:34874 - "POST /node/69c10839acdb2e26c83cd7c6 HTTP/1.0" 202 Accepted 2026-03-23 09:48:41,315 - lava_callback - INFO - Starting async job submit for node 69c10839acdb2e26c83cd7c6 2026-03-23 09:48:41,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:48:41,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10839acdb2e26c83cd7c6 HTTP/1.1" 200 None 2026-03-23 09:48:41,387 - lava_callback - DEBUG - Processing node 69c10839acdb2e26c83cd7c6: baseline-arm 2026-03-23 09:48:42,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:48:42,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:48:42,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c10839acdb2e26c83cd7c6/log.txt.gz 2026-03-23 09:48:42,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:48:42,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:48:42,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c10839acdb2e26c83cd7c6/lava-logs.yaml 2026-03-23 09:48:42,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:48:43,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:48:43,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c10839acdb2e26c83cd7c6/lava_callback.json.gz DEBUG: Setup failed for 69c10839acdb2e26c83cd7c6. Transitting job node result: incomplete -> fail 2026-03-23 09:48:43,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:48:43,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10839acdb2e26c83cd7c6 HTTP/1.1" 200 None 2026-03-23 09:48:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:48:43,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:48:43,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:48:43,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10839acdb2e26c83cd7c6 HTTP/1.1" 200 None 2026-03-23 09:48:43,327 - lava_callback - INFO - Completed processing callback for node 69c10839acdb2e26c83cd7c6 INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:49:00,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:49:00,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:50:24,173 - lava_callback - INFO - Received callback for node 69be69d8448e074b3ffe2448 INFO: 172.21.0.1:41380 - "POST /node/69be69d8448e074b3ffe2448 HTTP/1.0" 202 Accepted 2026-03-23 09:50:24,179 - lava_callback - INFO - Starting async job submit for node 69be69d8448e074b3ffe2448 2026-03-23 09:50:24,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:50:24,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be69d8448e074b3ffe2448 HTTP/1.1" 200 None 2026-03-23 09:50:24,195 - lava_callback - DEBUG - Processing node 69be69d8448e074b3ffe2448: baseline-arm64-baylibre 2026-03-23 09:50:24,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be69d8448e074b3ffe2448 2026-03-23 09:50:24,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:50:24,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be69d8448e074b3ffe2448 HTTP/1.1" 200 None 2026-03-23 09:50:24,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:50:24,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:50:24,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:50:24,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be69d8448e074b3ffe2448 HTTP/1.1" 200 None 2026-03-23 09:50:24,246 - lava_callback - ERROR - Error processing callback for node 69be69d8448e074b3ffe2448: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:51:44,258 - lava_callback - INFO - Received callback for node 69be6a23448e074b3ffe244e INFO: 172.21.0.1:39672 - "POST /node/69be6a23448e074b3ffe244e HTTP/1.0" 202 Accepted 2026-03-23 09:51:44,263 - lava_callback - INFO - Starting async job submit for node 69be6a23448e074b3ffe244e 2026-03-23 09:51:44,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:51:44,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6a23448e074b3ffe244e HTTP/1.1" 200 None 2026-03-23 09:51:44,278 - lava_callback - DEBUG - Processing node 69be6a23448e074b3ffe244e: baseline-arm64-baylibre 2026-03-23 09:51:44,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6a23448e074b3ffe244e 2026-03-23 09:51:44,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:51:44,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6a23448e074b3ffe244e HTTP/1.1" 200 None 2026-03-23 09:51:44,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:51:44,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:51:44,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:51:44,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6a23448e074b3ffe244e HTTP/1.1" 200 None 2026-03-23 09:51:44,340 - lava_callback - ERROR - Error processing callback for node 69be6a23448e074b3ffe244e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47710 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:54:00,642 - lava_callback - INFO - Received callback for node 69c10920acdb2e26c83cd7ff INFO: 172.21.0.1:56078 - "POST /node/69c10920acdb2e26c83cd7ff HTTP/1.0" 202 Accepted 2026-03-23 09:54:00,689 - lava_callback - INFO - Starting async job submit for node 69c10920acdb2e26c83cd7ff 2026-03-23 09:54:00,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:00,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10920acdb2e26c83cd7ff HTTP/1.1" 200 None 2026-03-23 09:54:00,729 - lava_callback - DEBUG - Processing node 69c10920acdb2e26c83cd7ff: baseline-arm-pengutronix 2026-03-23 09:54:00,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:54:00,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:54:00,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10920acdb2e26c83cd7ff/log.txt.gz 2026-03-23 09:54:01,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:54:01,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:54:01,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10920acdb2e26c83cd7ff/lava-logs.yaml 2026-03-23 09:54:01,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:54:01,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:54:01,382 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c10920acdb2e26c83cd7ff/lava_callback.json.gz DEBUG: Setup failed for 69c10920acdb2e26c83cd7ff. Transitting job node result: incomplete -> fail 2026-03-23 09:54:01,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:01,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10920acdb2e26c83cd7ff HTTP/1.1" 200 None 2026-03-23 09:54:01,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:54:01,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:01,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10920acdb2e26c83cd7ff HTTP/1.1" 200 None 2026-03-23 09:54:01,566 - lava_callback - INFO - Completed processing callback for node 69c10920acdb2e26c83cd7ff INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:54:30,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:30,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:54:44,435 - lava_callback - INFO - Received callback for node 69be6ad9448e074b3ffe2472 INFO: 172.21.0.1:55096 - "POST /node/69be6ad9448e074b3ffe2472 HTTP/1.0" 202 Accepted 2026-03-23 09:54:44,444 - lava_callback - INFO - Starting async job submit for node 69be6ad9448e074b3ffe2472 2026-03-23 09:54:44,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:44,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6ad9448e074b3ffe2472 HTTP/1.1" 200 None 2026-03-23 09:54:44,459 - lava_callback - DEBUG - Processing node 69be6ad9448e074b3ffe2472: baseline-arm64-baylibre 2026-03-23 09:54:44,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6ad9448e074b3ffe2472 2026-03-23 09:54:44,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:44,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6ad9448e074b3ffe2472 HTTP/1.1" 200 None 2026-03-23 09:54:44,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:44,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:54:44,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:54:44,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6ad9448e074b3ffe2472 HTTP/1.1" 200 None 2026-03-23 09:54:44,514 - lava_callback - ERROR - Error processing callback for node 69be6ad9448e074b3ffe2472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:57:07,419 - lava_callback - INFO - Received callback for node 69c10d66acdb2e26c83cd8b3 INFO: 172.21.0.1:53506 - "POST /node/69c10d66acdb2e26c83cd8b3 HTTP/1.0" 202 Accepted 2026-03-23 09:57:07,426 - lava_callback - INFO - Starting async job submit for node 69c10d66acdb2e26c83cd8b3 2026-03-23 09:57:07,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:07,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10d66acdb2e26c83cd8b3 HTTP/1.1" 200 None 2026-03-23 09:57:07,471 - lava_callback - DEBUG - Processing node 69c10d66acdb2e26c83cd8b3: ltp-sched 2026-03-23 09:57:07,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:57:08,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:57:08,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c10d66acdb2e26c83cd8b3/log.txt.gz 2026-03-23 09:57:08,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:57:08,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:57:08,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c10d66acdb2e26c83cd8b3/lava-logs.yaml 2026-03-23 09:57:08,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:57:08,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:57:08,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c10d66acdb2e26c83cd8b3/lava_callback.json.gz 2026-03-23 09:57:08,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:08,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10d66acdb2e26c83cd8b3 HTTP/1.1" 200 None 2026-03-23 09:57:08,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:08,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 09:57:08,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:08,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10d66acdb2e26c83cd8b3 HTTP/1.1" 200 None 2026-03-23 09:57:08,766 - lava_callback - INFO - Completed processing callback for node 69c10d66acdb2e26c83cd8b3 INFO: 172.21.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:57:17,065 - lava_callback - INFO - Received callback for node 69be6b73448e074b3ffe2489 INFO: 172.21.0.1:43988 - "POST /node/69be6b73448e074b3ffe2489 HTTP/1.0" 202 Accepted 2026-03-23 09:57:17,071 - lava_callback - INFO - Starting async job submit for node 69be6b73448e074b3ffe2489 2026-03-23 09:57:17,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:17,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6b73448e074b3ffe2489 HTTP/1.1" 200 None 2026-03-23 09:57:17,092 - lava_callback - DEBUG - Processing node 69be6b73448e074b3ffe2489: baseline-arm64-clabbe 2026-03-23 09:57:17,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6b73448e074b3ffe2489 2026-03-23 09:57:17,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:17,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6b73448e074b3ffe2489 HTTP/1.1" 200 None 2026-03-23 09:57:17,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:17,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 09:57:17,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:17,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6b73448e074b3ffe2489 HTTP/1.1" 200 None 2026-03-23 09:57:17,150 - lava_callback - ERROR - Error processing callback for node 69be6b73448e074b3ffe2489: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:57:30,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:57:30,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:58:03,492 - lava_callback - INFO - Received callback for node 69c109fdacdb2e26c83cd825 INFO: 172.21.0.1:49886 - "POST /node/69c109fdacdb2e26c83cd825 HTTP/1.0" 202 Accepted 2026-03-23 09:58:03,499 - lava_callback - INFO - Starting async job submit for node 69c109fdacdb2e26c83cd825 2026-03-23 09:58:03,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:58:03,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c109fdacdb2e26c83cd825 HTTP/1.1" 200 None 2026-03-23 09:58:03,560 - lava_callback - DEBUG - Processing node 69c109fdacdb2e26c83cd825: baseline-nfs-arm64 2026-03-23 09:58:04,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:58:04,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:58:04,742 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c109fdacdb2e26c83cd825/log.txt.gz 2026-03-23 09:58:05,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:58:05,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:58:05,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c109fdacdb2e26c83cd825/lava-logs.yaml 2026-03-23 09:58:05,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 09:58:05,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 09:58:05,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c109fdacdb2e26c83cd825/lava_callback.json.gz DEBUG: Setup failed for 69c109fdacdb2e26c83cd825. Transitting job node result: incomplete -> fail 2026-03-23 09:58:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:58:05,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c109fdacdb2e26c83cd825 HTTP/1.1" 200 None 2026-03-23 09:58:05,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:58:06,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 09:58:06,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:58:06,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c109fdacdb2e26c83cd825 HTTP/1.1" 200 None 2026-03-23 09:58:06,119 - lava_callback - INFO - Completed processing callback for node 69c109fdacdb2e26c83cd825 INFO: 172.21.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK 2026-03-23 09:58:30,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 09:58:30,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:01:17,163 - lava_callback - INFO - Received callback for node 69be6c57448e074b3ffe24a7 INFO: 172.21.0.1:39090 - "POST /node/69be6c57448e074b3ffe24a7 HTTP/1.0" 202 Accepted 2026-03-23 10:01:17,169 - lava_callback - INFO - Starting async job submit for node 69be6c57448e074b3ffe24a7 2026-03-23 10:01:17,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:01:17,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6c57448e074b3ffe24a7 HTTP/1.1" 200 None 2026-03-23 10:01:17,184 - lava_callback - DEBUG - Processing node 69be6c57448e074b3ffe24a7: baseline-arm64-clabbe 2026-03-23 10:01:17,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6c57448e074b3ffe24a7 2026-03-23 10:01:17,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:01:17,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6c57448e074b3ffe24a7 HTTP/1.1" 200 None 2026-03-23 10:01:17,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:01:17,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 10:01:17,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:01:17,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6c57448e074b3ffe24a7 HTTP/1.1" 200 None 2026-03-23 10:01:17,259 - lava_callback - ERROR - Error processing callback for node 69be6c57448e074b3ffe24a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:02:17,233 - lava_callback - INFO - Received callback for node 69be6ca4448e074b3ffe24ac INFO: 172.21.0.1:40438 - "POST /node/69be6ca4448e074b3ffe24ac HTTP/1.0" 202 Accepted 2026-03-23 10:02:17,238 - lava_callback - INFO - Starting async job submit for node 69be6ca4448e074b3ffe24ac 2026-03-23 10:02:17,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:02:17,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6ca4448e074b3ffe24ac HTTP/1.1" 200 None 2026-03-23 10:02:17,254 - lava_callback - DEBUG - Processing node 69be6ca4448e074b3ffe24ac: baseline-arm64-clabbe 2026-03-23 10:02:17,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6ca4448e074b3ffe24ac 2026-03-23 10:02:17,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:02:17,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6ca4448e074b3ffe24ac HTTP/1.1" 200 None 2026-03-23 10:02:17,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:02:17,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 10:02:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:02:17,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6ca4448e074b3ffe24ac HTTP/1.1" 200 None 2026-03-23 10:02:17,308 - lava_callback - ERROR - Error processing callback for node 69be6ca4448e074b3ffe24ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:04:17,261 - lava_callback - INFO - Received callback for node 69be6d13448e074b3ffe24bf INFO: 172.21.0.1:35056 - "POST /node/69be6d13448e074b3ffe24bf HTTP/1.0" 202 Accepted 2026-03-23 10:04:17,267 - lava_callback - INFO - Starting async job submit for node 69be6d13448e074b3ffe24bf 2026-03-23 10:04:17,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:04:17,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6d13448e074b3ffe24bf HTTP/1.1" 200 None 2026-03-23 10:04:17,283 - lava_callback - DEBUG - Processing node 69be6d13448e074b3ffe24bf: baseline-arm64-clabbe 2026-03-23 10:04:17,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6d13448e074b3ffe24bf 2026-03-23 10:04:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:04:17,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6d13448e074b3ffe24bf HTTP/1.1" 200 None 2026-03-23 10:04:17,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:04:17,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 10:04:17,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:04:17,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6d13448e074b3ffe24bf HTTP/1.1" 200 None 2026-03-23 10:04:17,384 - lava_callback - ERROR - Error processing callback for node 69be6d13448e074b3ffe24bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:05:37,325 - lava_callback - INFO - Received callback for node 69be6d5e448e074b3ffe24ca INFO: 172.21.0.1:40226 - "POST /node/69be6d5e448e074b3ffe24ca HTTP/1.0" 202 Accepted 2026-03-23 10:05:37,330 - lava_callback - INFO - Starting async job submit for node 69be6d5e448e074b3ffe24ca 2026-03-23 10:05:37,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:05:37,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6d5e448e074b3ffe24ca HTTP/1.1" 200 None 2026-03-23 10:05:37,347 - lava_callback - DEBUG - Processing node 69be6d5e448e074b3ffe24ca: baseline-arm64-clabbe 2026-03-23 10:05:37,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6d5e448e074b3ffe24ca 2026-03-23 10:05:37,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:05:37,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6d5e448e074b3ffe24ca HTTP/1.1" 200 None 2026-03-23 10:05:37,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:05:37,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 10:05:37,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:05:37,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6d5e448e074b3ffe24ca HTTP/1.1" 200 None 2026-03-23 10:05:37,400 - lava_callback - ERROR - Error processing callback for node 69be6d5e448e074b3ffe24ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:05:58,805 - lava_callback - INFO - Received callback for node 69c10b55acdb2e26c83cd85a INFO: 172.21.0.1:55750 - "POST /node/69c10b55acdb2e26c83cd85a HTTP/1.0" 202 Accepted 2026-03-23 10:05:58,812 - lava_callback - INFO - Starting async job submit for node 69c10b55acdb2e26c83cd85a 2026-03-23 10:05:58,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:05:58,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10b55acdb2e26c83cd85a HTTP/1.1" 200 None 2026-03-23 10:05:58,863 - lava_callback - DEBUG - Processing node 69c10b55acdb2e26c83cd85a: baseline-nfs-arm64 2026-03-23 10:05:59,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:05:59,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:05:59,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c10b55acdb2e26c83cd85a/log.txt.gz 2026-03-23 10:05:59,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:05:59,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:05:59,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c10b55acdb2e26c83cd85a/lava-logs.yaml 2026-03-23 10:05:59,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:06:00,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:06:00,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c10b55acdb2e26c83cd85a/lava_callback.json.gz 2026-03-23 10:06:00,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:06:00,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c10b55acdb2e26c83cd85a HTTP/1.1" 200 None 2026-03-23 10:06:00,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:06:00,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:06:00,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:06:00,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c10b55acdb2e26c83cd85a HTTP/1.1" 200 None 2026-03-23 10:06:00,275 - lava_callback - INFO - Completed processing callback for node 69c10b55acdb2e26c83cd85a 2026-03-23 10:06:00,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:06:00,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:07:57,360 - lava_callback - INFO - Received callback for node 69be6df1448e074b3ffe24db INFO: 172.21.0.1:60170 - "POST /node/69be6df1448e074b3ffe24db HTTP/1.0" 202 Accepted 2026-03-23 10:07:57,366 - lava_callback - INFO - Starting async job submit for node 69be6df1448e074b3ffe24db 2026-03-23 10:07:57,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:07:57,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6df1448e074b3ffe24db HTTP/1.1" 200 None 2026-03-23 10:07:57,390 - lava_callback - DEBUG - Processing node 69be6df1448e074b3ffe24db: baseline-arm64-clabbe 2026-03-23 10:07:57,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be6df1448e074b3ffe24db 2026-03-23 10:07:57,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:07:57,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be6df1448e074b3ffe24db HTTP/1.1" 200 None 2026-03-23 10:07:57,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:07:57,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 10:07:57,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:07:57,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be6df1448e074b3ffe24db HTTP/1.1" 200 None 2026-03-23 10:07:57,442 - lava_callback - ERROR - Error processing callback for node 69be6df1448e074b3ffe24db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:13:14,299 - lava_callback - INFO - Received callback for node 69c11234acdb2e26c83cd960 INFO: 172.21.0.1:60302 - "POST /node/69c11234acdb2e26c83cd960 HTTP/1.0" 202 Accepted 2026-03-23 10:13:14,305 - lava_callback - INFO - Starting async job submit for node 69c11234acdb2e26c83cd960 2026-03-23 10:13:14,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:13:14,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11234acdb2e26c83cd960 HTTP/1.1" 200 None 2026-03-23 10:13:14,322 - lava_callback - DEBUG - Processing node 69c11234acdb2e26c83cd960: baseline-nfs-arm64 2026-03-23 10:13:14,323 - lava_callback - WARNING - Failed to upload log 2026-03-23 10:13:14,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:13:14,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:13:14,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11234acdb2e26c83cd960/lava-logs.yaml 2026-03-23 10:13:14,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:13:14,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:13:14,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11234acdb2e26c83cd960/lava_callback.json.gz 2026-03-23 10:13:14,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:13:14,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11234acdb2e26c83cd960 HTTP/1.1" 200 None 2026-03-23 10:13:14,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:13:14,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:13:14,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:13:14,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11234acdb2e26c83cd960 HTTP/1.1" 200 None 2026-03-23 10:13:14,691 - lava_callback - INFO - Completed processing callback for node 69c11234acdb2e26c83cd960 INFO: 172.21.0.1:60314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:13:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:13:30,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 10:15:15,493 - lava_callback - INFO - Received callback for node 69c1127aacdb2e26c83cd96a INFO: 172.21.0.1:40758 - "POST /node/69c1127aacdb2e26c83cd96a HTTP/1.0" 202 Accepted 2026-03-23 10:15:15,499 - lava_callback - INFO - Starting async job submit for node 69c1127aacdb2e26c83cd96a 2026-03-23 10:15:15,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:15:15,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1127aacdb2e26c83cd96a HTTP/1.1" 200 None 2026-03-23 10:15:15,543 - lava_callback - DEBUG - Processing node 69c1127aacdb2e26c83cd96a: baseline-arm64 2026-03-23 10:15:15,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:15:16,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:15:16,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1127aacdb2e26c83cd96a/log.txt.gz 2026-03-23 10:15:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:15:16,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:15:16,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1127aacdb2e26c83cd96a/lava-logs.yaml 2026-03-23 10:15:16,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:15:16,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:15:16,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1127aacdb2e26c83cd96a/lava_callback.json.gz 2026-03-23 10:15:16,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:15:16,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1127aacdb2e26c83cd96a HTTP/1.1" 200 None 2026-03-23 10:15:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:15:16,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:15:16,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:15:16,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1127aacdb2e26c83cd96a HTTP/1.1" 200 None 2026-03-23 10:15:16,747 - lava_callback - INFO - Completed processing callback for node 69c1127aacdb2e26c83cd96a INFO: 172.21.0.1:56024 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:15:30,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:15:30,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:17:33,592 - lava_callback - INFO - Received callback for node 69c1130dacdb2e26c83cd981 INFO: 172.21.0.1:52394 - "POST /node/69c1130dacdb2e26c83cd981 HTTP/1.0" 202 Accepted 2026-03-23 10:17:33,599 - lava_callback - INFO - Starting async job submit for node 69c1130dacdb2e26c83cd981 2026-03-23 10:17:33,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:17:33,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1130dacdb2e26c83cd981 HTTP/1.1" 200 None 2026-03-23 10:17:33,644 - lava_callback - DEBUG - Processing node 69c1130dacdb2e26c83cd981: baseline-arm64 2026-03-23 10:17:33,777 - lava_callback - WARNING - Failed to upload log 2026-03-23 10:17:33,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:17:34,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:17:34,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1130dacdb2e26c83cd981/lava-logs.yaml 2026-03-23 10:17:34,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:17:34,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:17:34,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1130dacdb2e26c83cd981/lava_callback.json.gz 2026-03-23 10:17:34,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:17:34,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1130dacdb2e26c83cd981 HTTP/1.1" 200 None 2026-03-23 10:17:34,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:17:34,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:17:34,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:17:34,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1130dacdb2e26c83cd981 HTTP/1.1" 200 None 2026-03-23 10:17:34,359 - lava_callback - INFO - Completed processing callback for node 69c1130dacdb2e26c83cd981 INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:18:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:18:00,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:19:39,868 - lava_callback - INFO - Received callback for node 69c11357acdb2e26c83cd98b INFO: 172.21.0.1:52378 - "POST /node/69c11357acdb2e26c83cd98b HTTP/1.0" 202 Accepted 2026-03-23 10:19:39,874 - lava_callback - INFO - Starting async job submit for node 69c11357acdb2e26c83cd98b 2026-03-23 10:19:39,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:19:39,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11357acdb2e26c83cd98b HTTP/1.1" 200 None 2026-03-23 10:19:39,951 - lava_callback - DEBUG - Processing node 69c11357acdb2e26c83cd98b: baseline-arm64 2026-03-23 10:19:40,153 - lava_callback - WARNING - Failed to upload log 2026-03-23 10:19:40,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:19:40,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:19:40,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c11357acdb2e26c83cd98b/lava-logs.yaml 2026-03-23 10:19:40,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:19:40,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:19:40,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c11357acdb2e26c83cd98b/lava_callback.json.gz 2026-03-23 10:19:40,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:19:40,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11357acdb2e26c83cd98b HTTP/1.1" 200 None 2026-03-23 10:19:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:19:40,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:19:40,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:19:40,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11357acdb2e26c83cd98b HTTP/1.1" 200 None 2026-03-23 10:19:40,787 - lava_callback - INFO - Completed processing callback for node 69c11357acdb2e26c83cd98b INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:20:00,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:00,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:20:25,699 - lava_callback - INFO - Received callback for node 69c113a3acdb2e26c83cd993 INFO: 172.21.0.1:49866 - "POST /node/69c113a3acdb2e26c83cd993 HTTP/1.0" 202 Accepted 2026-03-23 10:20:25,705 - lava_callback - INFO - Starting async job submit for node 69c113a3acdb2e26c83cd993 2026-03-23 10:20:25,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:25,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c113a3acdb2e26c83cd993 HTTP/1.1" 200 None 2026-03-23 10:20:25,742 - lava_callback - DEBUG - Processing node 69c113a3acdb2e26c83cd993: baseline-arm64 2026-03-23 10:20:26,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:20:26,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:20:26,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113a3acdb2e26c83cd993/log.txt.gz 2026-03-23 10:20:26,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:20:26,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:20:26,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113a3acdb2e26c83cd993/lava-logs.yaml 2026-03-23 10:20:26,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:20:26,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:20:26,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113a3acdb2e26c83cd993/lava_callback.json.gz 2026-03-23 10:20:26,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:26,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c113a3acdb2e26c83cd993 HTTP/1.1" 200 None 2026-03-23 10:20:26,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:26,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:20:26,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:26,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c113a3acdb2e26c83cd993 HTTP/1.1" 200 None 2026-03-23 10:20:26,984 - lava_callback - INFO - Completed processing callback for node 69c113a3acdb2e26c83cd993 2026-03-23 10:20:30,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:20:30,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:23:11,411 - lava_callback - INFO - Received callback for node 69c112c6acdb2e26c83cd97a INFO: 172.21.0.1:46968 - "POST /node/69c112c6acdb2e26c83cd97a HTTP/1.0" 202 Accepted 2026-03-23 10:23:11,419 - lava_callback - INFO - Starting async job submit for node 69c112c6acdb2e26c83cd97a 2026-03-23 10:23:11,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:23:11,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c112c6acdb2e26c83cd97a HTTP/1.1" 200 None 2026-03-23 10:23:11,472 - lava_callback - DEBUG - Processing node 69c112c6acdb2e26c83cd97a: baseline-arm64 2026-03-23 10:23:11,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:23:11,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:23:12,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c112c6acdb2e26c83cd97a/log.txt.gz 2026-03-23 10:23:12,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:23:12,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:23:12,464 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c112c6acdb2e26c83cd97a/lava-logs.yaml 2026-03-23 10:23:12,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:23:12,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:23:12,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c112c6acdb2e26c83cd97a/lava_callback.json.gz DEBUG: Setup failed for 69c112c6acdb2e26c83cd97a. Transitting job node result: incomplete -> fail 2026-03-23 10:23:12,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:23:12,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c112c6acdb2e26c83cd97a HTTP/1.1" 200 None 2026-03-23 10:23:12,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:23:12,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:23:12,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:23:12,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c112c6acdb2e26c83cd97a HTTP/1.1" 200 None 2026-03-23 10:23:12,846 - lava_callback - INFO - Completed processing callback for node 69c112c6acdb2e26c83cd97a INFO: 172.21.0.1:46980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:23:30,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:23:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:30:38,010 - lava_callback - INFO - Received callback for node 69c11229acdb2e26c83cd95d INFO: 172.21.0.1:55268 - "POST /node/69c11229acdb2e26c83cd95d HTTP/1.0" 202 Accepted 2026-03-23 10:30:38,017 - lava_callback - INFO - Starting async job submit for node 69c11229acdb2e26c83cd95d 2026-03-23 10:30:38,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:38,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11229acdb2e26c83cd95d HTTP/1.1" 200 None 2026-03-23 10:30:38,100 - lava_callback - DEBUG - Processing node 69c11229acdb2e26c83cd95d: ltp-smoke 2026-03-23 10:30:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:38,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:38,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c11229acdb2e26c83cd95d/log.txt.gz 2026-03-23 10:30:39,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:39,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:39,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c11229acdb2e26c83cd95d/lava-logs.yaml 2026-03-23 10:30:39,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:39,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:39,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c11229acdb2e26c83cd95d/lava_callback.json.gz 2026-03-23 10:30:39,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:39,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11229acdb2e26c83cd95d HTTP/1.1" 200 None 2026-03-23 10:30:39,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:39,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f734acdb2e26c83cca26 HTTP/1.1" 200 None 2026-03-23 10:30:39,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:39,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11229acdb2e26c83cd95d HTTP/1.1" 200 None 2026-03-23 10:30:39,766 - lava_callback - INFO - Completed processing callback for node 69c11229acdb2e26c83cd95d INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:30:51,643 - lava_callback - INFO - Received callback for node 69c113efacdb2e26c83cd9a5 INFO: 172.21.0.1:43442 - "POST /node/69c113efacdb2e26c83cd9a5 HTTP/1.0" 202 Accepted 2026-03-23 10:30:51,649 - lava_callback - INFO - Starting async job submit for node 69c113efacdb2e26c83cd9a5 2026-03-23 10:30:51,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:51,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c113efacdb2e26c83cd9a5 HTTP/1.1" 200 None 2026-03-23 10:30:51,700 - lava_callback - DEBUG - Processing node 69c113efacdb2e26c83cd9a5: baseline-arm64 2026-03-23 10:30:52,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:52,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:52,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113efacdb2e26c83cd9a5/log.txt.gz 2026-03-23 10:30:52,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:52,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:52,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113efacdb2e26c83cd9a5/lava-logs.yaml 2026-03-23 10:30:52,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:30:52,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:30:52,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c113efacdb2e26c83cd9a5/lava_callback.json.gz 2026-03-23 10:30:53,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:53,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c113efacdb2e26c83cd9a5 HTTP/1.1" 200 None 2026-03-23 10:30:53,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:53,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:30:53,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:30:53,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c113efacdb2e26c83cd9a5 HTTP/1.1" 200 None 2026-03-23 10:30:53,176 - lava_callback - INFO - Completed processing callback for node 69c113efacdb2e26c83cd9a5 INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:31:00,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:31:00,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:42:09,720 - lava_callback - INFO - Received callback for node 69c11516acdb2e26c83cd9cb INFO: 172.21.0.1:36388 - "POST /node/69c11516acdb2e26c83cd9cb HTTP/1.0" 202 Accepted 2026-03-23 10:42:09,727 - lava_callback - INFO - Starting async job submit for node 69c11516acdb2e26c83cd9cb 2026-03-23 10:42:09,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:42:09,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11516acdb2e26c83cd9cb HTTP/1.1" 200 None 2026-03-23 10:42:09,797 - lava_callback - DEBUG - Processing node 69c11516acdb2e26c83cd9cb: baseline-arm 2026-03-23 10:42:10,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:42:10,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:42:10,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c11516acdb2e26c83cd9cb/log.txt.gz 2026-03-23 10:42:10,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:42:11,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:42:11,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c11516acdb2e26c83cd9cb/lava-logs.yaml 2026-03-23 10:42:11,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:42:11,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:42:11,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c11516acdb2e26c83cd9cb/lava_callback.json.gz DEBUG: Setup failed for 69c11516acdb2e26c83cd9cb. Transitting job node result: incomplete -> fail 2026-03-23 10:42:11,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:42:11,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11516acdb2e26c83cd9cb HTTP/1.1" 200 None 2026-03-23 10:42:11,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:42:11,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 10:42:11,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:42:11,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11516acdb2e26c83cd9cb HTTP/1.1" 200 None 2026-03-23 10:42:11,712 - lava_callback - INFO - Completed processing callback for node 69c11516acdb2e26c83cd9cb INFO: 172.21.0.1:36396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:42:30,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:42:30,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:47:54,555 - lava_callback - INFO - Received callback for node 69c118a4acdb2e26c83cda41 INFO: 172.21.0.1:33102 - "POST /node/69c118a4acdb2e26c83cda41 HTTP/1.0" 202 Accepted 2026-03-23 10:47:54,563 - lava_callback - INFO - Starting async job submit for node 69c118a4acdb2e26c83cda41 2026-03-23 10:47:54,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:47:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118a4acdb2e26c83cda41 HTTP/1.1" 200 None 2026-03-23 10:47:54,635 - lava_callback - DEBUG - Processing node 69c118a4acdb2e26c83cda41: baseline-arm64 2026-03-23 10:47:55,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:47:55,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:47:55,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118a4acdb2e26c83cda41/log.txt.gz 2026-03-23 10:47:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:47:55,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:47:55,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118a4acdb2e26c83cda41/lava-logs.yaml 2026-03-23 10:47:55,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:47:55,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:47:55,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118a4acdb2e26c83cda41/lava_callback.json.gz DEBUG: Setup failed for 69c118a4acdb2e26c83cda41. Transitting job node result: incomplete -> fail 2026-03-23 10:47:55,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:47:55,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118a4acdb2e26c83cda41 HTTP/1.1" 200 None 2026-03-23 10:47:55,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:47:55,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:47:55,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:47:55,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c118a4acdb2e26c83cda41 HTTP/1.1" 200 None 2026-03-23 10:47:56,037 - lava_callback - INFO - Completed processing callback for node 69c118a4acdb2e26c83cda41 INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:48:00,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:00,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 10:48:02,251 - lava_callback - INFO - Received callback for node 69c115d7acdb2e26c83cd9e3 INFO: 172.21.0.1:36254 - "POST /node/69c115d7acdb2e26c83cd9e3 HTTP/1.0" 202 Accepted 2026-03-23 10:48:02,298 - lava_callback - INFO - Starting async job submit for node 69c115d7acdb2e26c83cd9e3 2026-03-23 10:48:02,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:02,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c115d7acdb2e26c83cd9e3 HTTP/1.1" 200 None 2026-03-23 10:48:02,343 - lava_callback - DEBUG - Processing node 69c115d7acdb2e26c83cd9e3: baseline-arm-pengutronix 2026-03-23 10:48:02,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:02,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:02,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c115d7acdb2e26c83cd9e3/log.txt.gz 2026-03-23 10:48:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:02,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:02,813 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c115d7acdb2e26c83cd9e3/lava-logs.yaml 2026-03-23 10:48:02,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:02,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:02,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c115d7acdb2e26c83cd9e3/lava_callback.json.gz DEBUG: Setup failed for 69c115d7acdb2e26c83cd9e3. Transitting job node result: incomplete -> fail 2026-03-23 10:48:02,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:03,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c115d7acdb2e26c83cd9e3 HTTP/1.1" 200 None 2026-03-23 10:48:03,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:03,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 10:48:03,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c115d7acdb2e26c83cd9e3 HTTP/1.1" 200 None 2026-03-23 10:48:03,113 - lava_callback - INFO - Completed processing callback for node 69c115d7acdb2e26c83cd9e3 INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:48:30,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:48:51,203 - lava_callback - INFO - Received callback for node 69c11810acdb2e26c83cda32 INFO: 172.21.0.1:49110 - "POST /node/69c11810acdb2e26c83cda32 HTTP/1.0" 202 Accepted 2026-03-23 10:48:51,210 - lava_callback - INFO - Starting async job submit for node 69c11810acdb2e26c83cda32 2026-03-23 10:48:51,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:51,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11810acdb2e26c83cda32 HTTP/1.1" 200 None 2026-03-23 10:48:51,252 - lava_callback - DEBUG - Processing node 69c11810acdb2e26c83cda32: baseline-nfs-arm64 2026-03-23 10:48:51,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:51,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:51,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11810acdb2e26c83cda32/log.txt.gz 2026-03-23 10:48:52,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:52,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:52,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11810acdb2e26c83cda32/lava-logs.yaml 2026-03-23 10:48:52,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:48:52,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:48:52,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11810acdb2e26c83cda32/lava_callback.json.gz 2026-03-23 10:48:52,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:52,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11810acdb2e26c83cda32 HTTP/1.1" 200 None 2026-03-23 10:48:52,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:52,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:48:52,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:48:52,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11810acdb2e26c83cda32 HTTP/1.1" 200 None 2026-03-23 10:48:52,738 - lava_callback - INFO - Completed processing callback for node 69c11810acdb2e26c83cda32 INFO: 172.21.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:49:00,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:49:00,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:51:31,683 - lava_callback - INFO - Received callback for node 69c11691acdb2e26c83cda08 INFO: 172.21.0.1:36574 - "POST /node/69c11691acdb2e26c83cda08 HTTP/1.0" 202 Accepted 2026-03-23 10:51:31,691 - lava_callback - INFO - Starting async job submit for node 69c11691acdb2e26c83cda08 2026-03-23 10:51:31,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:31,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11691acdb2e26c83cda08 HTTP/1.1" 200 None 2026-03-23 10:51:31,771 - lava_callback - DEBUG - Processing node 69c11691acdb2e26c83cda08: baseline-nfs-arm64 2026-03-23 10:51:32,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:33,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:33,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11691acdb2e26c83cda08/log.txt.gz 2026-03-23 10:51:33,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:33,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:33,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11691acdb2e26c83cda08/lava-logs.yaml 2026-03-23 10:51:33,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:34,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:34,099 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11691acdb2e26c83cda08/lava_callback.json.gz DEBUG: Setup failed for 69c11691acdb2e26c83cda08. Transitting job node result: incomplete -> fail 2026-03-23 10:51:34,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:34,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11691acdb2e26c83cda08 HTTP/1.1" 200 None 2026-03-23 10:51:34,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:34,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:51:34,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:34,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11691acdb2e26c83cda08 HTTP/1.1" 200 None 2026-03-23 10:51:34,326 - lava_callback - INFO - Completed processing callback for node 69c11691acdb2e26c83cda08 INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:51:52,260 - lava_callback - INFO - Received callback for node 69c0fc82acdb2e26c83cd07a INFO: 172.21.0.1:57552 - "POST /node/69c0fc82acdb2e26c83cd07a HTTP/1.0" 202 Accepted 2026-03-23 10:51:52,266 - lava_callback - INFO - Starting async job submit for node 69c0fc82acdb2e26c83cd07a 2026-03-23 10:51:52,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:52,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc82acdb2e26c83cd07a HTTP/1.1" 200 None 2026-03-23 10:51:52,298 - lava_callback - DEBUG - Processing node 69c0fc82acdb2e26c83cd07a: baseline-x86 2026-03-23 10:51:52,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:52,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:52,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc82acdb2e26c83cd07a/log.txt.gz 2026-03-23 10:51:52,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:53,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:53,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc82acdb2e26c83cd07a/lava-logs.yaml 2026-03-23 10:51:53,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:53,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:53,346 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c0fc82acdb2e26c83cd07a/lava_callback.json.gz 2026-03-23 10:51:53,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:53,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0fc82acdb2e26c83cd07a HTTP/1.1" 200 None 2026-03-23 10:51:53,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f74cacdb2e26c83cca4c HTTP/1.1" 200 None 2026-03-23 10:51:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:53,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c0fc82acdb2e26c83cd07a HTTP/1.1" 200 None 2026-03-23 10:51:53,427 - lava_callback - INFO - Completed processing callback for node 69c0fc82acdb2e26c83cd07a INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:51:57,154 - lava_callback - INFO - Received callback for node 69c118f0acdb2e26c83cda4f INFO: 172.21.0.1:57590 - "POST /node/69c118f0acdb2e26c83cda4f HTTP/1.0" 202 Accepted 2026-03-23 10:51:57,164 - lava_callback - INFO - Starting async job submit for node 69c118f0acdb2e26c83cda4f 2026-03-23 10:51:57,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:57,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118f0acdb2e26c83cda4f HTTP/1.1" 200 None 2026-03-23 10:51:57,205 - lava_callback - DEBUG - Processing node 69c118f0acdb2e26c83cda4f: baseline-arm64 2026-03-23 10:51:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:57,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:57,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118f0acdb2e26c83cda4f/log.txt.gz 2026-03-23 10:51:58,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:58,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:58,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118f0acdb2e26c83cda4f/lava-logs.yaml 2026-03-23 10:51:58,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:51:58,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:51:58,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c118f0acdb2e26c83cda4f/lava_callback.json.gz 2026-03-23 10:51:58,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:58,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118f0acdb2e26c83cda4f HTTP/1.1" 200 None 2026-03-23 10:51:58,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:58,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 10:51:58,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:51:58,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c118f0acdb2e26c83cda4f HTTP/1.1" 200 None 2026-03-23 10:51:58,688 - lava_callback - INFO - Completed processing callback for node 69c118f0acdb2e26c83cda4f 2026-03-23 10:52:00,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:52:00,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:59:00,174 - lava_callback - INFO - Received callback for node 69c118eaacdb2e26c83cda49 INFO: 172.21.0.1:38744 - "POST /node/69c118eaacdb2e26c83cda49 HTTP/1.0" 202 Accepted 2026-03-23 10:59:00,180 - lava_callback - INFO - Starting async job submit for node 69c118eaacdb2e26c83cda49 2026-03-23 10:59:00,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:59:00,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118eaacdb2e26c83cda49 HTTP/1.1" 200 None 2026-03-23 10:59:00,260 - lava_callback - DEBUG - Processing node 69c118eaacdb2e26c83cda49: ltp-smoke 2026-03-23 10:59:00,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:59:00,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:59:00,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c118eaacdb2e26c83cda49/log.txt.gz 2026-03-23 10:59:01,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:59:01,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:59:01,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c118eaacdb2e26c83cda49/lava-logs.yaml 2026-03-23 10:59:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 10:59:01,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 10:59:01,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c118eaacdb2e26c83cda49/lava_callback.json.gz 2026-03-23 10:59:01,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:59:01,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c118eaacdb2e26c83cda49 HTTP/1.1" 200 None 2026-03-23 10:59:01,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:59:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f734acdb2e26c83cca26 HTTP/1.1" 200 None 2026-03-23 10:59:01,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:59:01,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c118eaacdb2e26c83cda49 HTTP/1.1" 200 None 2026-03-23 10:59:02,025 - lava_callback - INFO - Completed processing callback for node 69c118eaacdb2e26c83cda49 INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK 2026-03-23 10:59:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 10:59:30,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:00:04,976 - lava_callback - INFO - Received callback for node 69c11ab4acdb2e26c83cda97 INFO: 172.21.0.1:49102 - "POST /node/69c11ab4acdb2e26c83cda97 HTTP/1.0" 202 Accepted 2026-03-23 11:00:04,982 - lava_callback - INFO - Starting async job submit for node 69c11ab4acdb2e26c83cda97 2026-03-23 11:00:05,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:05,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11ab4acdb2e26c83cda97 HTTP/1.1" 200 None 2026-03-23 11:00:05,029 - lava_callback - DEBUG - Processing node 69c11ab4acdb2e26c83cda97: baseline-nfs-arm64 2026-03-23 11:00:05,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:00:05,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:00:05,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11ab4acdb2e26c83cda97/log.txt.gz 2026-03-23 11:00:05,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:00:06,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:00:06,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11ab4acdb2e26c83cda97/lava-logs.yaml 2026-03-23 11:00:06,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:00:06,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:00:06,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11ab4acdb2e26c83cda97/lava_callback.json.gz 2026-03-23 11:00:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:06,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11ab4acdb2e26c83cda97 HTTP/1.1" 200 None 2026-03-23 11:00:06,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:06,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 11:00:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:06,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11ab4acdb2e26c83cda97 HTTP/1.1" 200 None INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:00:06,578 - lava_callback - INFO - Completed processing callback for node 69c11ab4acdb2e26c83cda97 INFO: 172.21.0.1:40634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:00:30,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:30,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:00:58,426 - lava_callback - INFO - Received callback for node 69c11937acdb2e26c83cda5e INFO: 172.21.0.1:49624 - "POST /node/69c11937acdb2e26c83cda5e HTTP/1.0" 202 Accepted 2026-03-23 11:00:58,434 - lava_callback - INFO - Starting async job submit for node 69c11937acdb2e26c83cda5e 2026-03-23 11:00:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:00:58,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11937acdb2e26c83cda5e HTTP/1.1" 200 None 2026-03-23 11:00:58,538 - lava_callback - DEBUG - Processing node 69c11937acdb2e26c83cda5e: baseline-arm 2026-03-23 11:00:59,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:00:59,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:00:59,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c11937acdb2e26c83cda5e/log.txt.gz 2026-03-23 11:00:59,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:00:59,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:00:59,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c11937acdb2e26c83cda5e/lava-logs.yaml 2026-03-23 11:00:59,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:01:00,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:01:00,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c11937acdb2e26c83cda5e/lava_callback.json.gz DEBUG: Setup failed for 69c11937acdb2e26c83cda5e. Transitting job node result: incomplete -> fail 2026-03-23 11:01:00,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:01:00,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11937acdb2e26c83cda5e HTTP/1.1" 200 None 2026-03-23 11:01:00,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:01:00,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 11:01:00,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:01:00,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11937acdb2e26c83cda5e HTTP/1.1" 200 None 2026-03-23 11:01:00,366 - lava_callback - INFO - Completed processing callback for node 69c11937acdb2e26c83cda5e 2026-03-23 11:01:00,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:01:00,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:08:23,008 - lava_callback - INFO - Received callback for node 69c11a90acdb2e26c83cda86 INFO: 172.21.0.1:47312 - "POST /node/69c11a90acdb2e26c83cda86 HTTP/1.0" 202 Accepted 2026-03-23 11:08:23,057 - lava_callback - INFO - Starting async job submit for node 69c11a90acdb2e26c83cda86 2026-03-23 11:08:23,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:08:23,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11a90acdb2e26c83cda86 HTTP/1.1" 200 None 2026-03-23 11:08:23,117 - lava_callback - DEBUG - Processing node 69c11a90acdb2e26c83cda86: baseline-arm-pengutronix 2026-03-23 11:08:23,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:08:23,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:08:23,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c11a90acdb2e26c83cda86/log.txt.gz 2026-03-23 11:08:23,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:08:23,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:08:23,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c11a90acdb2e26c83cda86/lava-logs.yaml 2026-03-23 11:08:23,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:08:23,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:08:23,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c11a90acdb2e26c83cda86/lava_callback.json.gz DEBUG: Setup failed for 69c11a90acdb2e26c83cda86. Transitting job node result: incomplete -> fail 2026-03-23 11:08:23,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:08:23,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11a90acdb2e26c83cda86 HTTP/1.1" 200 None 2026-03-23 11:08:23,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:08:23,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-23 11:08:23,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:08:23,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11a90acdb2e26c83cda86 HTTP/1.1" 200 None 2026-03-23 11:08:24,001 - lava_callback - INFO - Completed processing callback for node 69c11a90acdb2e26c83cda86 INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:08:30,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:08:30,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:12:52,072 - lava_callback - INFO - Received callback for node 69c11b8dacdb2e26c83cdadd INFO: 172.21.0.1:36278 - "POST /node/69c11b8dacdb2e26c83cdadd HTTP/1.0" 202 Accepted 2026-03-23 11:12:52,080 - lava_callback - INFO - Starting async job submit for node 69c11b8dacdb2e26c83cdadd 2026-03-23 11:12:52,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:12:52,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11b8dacdb2e26c83cdadd HTTP/1.1" 200 None 2026-03-23 11:12:52,180 - lava_callback - DEBUG - Processing node 69c11b8dacdb2e26c83cdadd: baseline-nfs-arm64 2026-03-23 11:12:53,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:12:53,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:12:53,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11b8dacdb2e26c83cdadd/log.txt.gz 2026-03-23 11:12:54,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:12:54,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:12:54,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11b8dacdb2e26c83cdadd/lava-logs.yaml 2026-03-23 11:12:54,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 11:12:54,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 11:12:54,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c11b8dacdb2e26c83cdadd/lava_callback.json.gz DEBUG: Setup failed for 69c11b8dacdb2e26c83cdadd. Transitting job node result: incomplete -> fail 2026-03-23 11:12:54,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:12:54,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c11b8dacdb2e26c83cdadd HTTP/1.1" 200 None 2026-03-23 11:12:54,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:12:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-23 11:12:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:12:54,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c11b8dacdb2e26c83cdadd HTTP/1.1" 200 None 2026-03-23 11:12:54,820 - lava_callback - INFO - Completed processing callback for node 69c11b8dacdb2e26c83cdadd INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:13:00,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:13:00,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:19:09,868 - lava_callback - INFO - Received callback for node 69be7eaa448e074b3ffe25e3 INFO: 172.21.0.1:56684 - "POST /node/69be7eaa448e074b3ffe25e3 HTTP/1.0" 202 Accepted 2026-03-23 11:19:09,874 - lava_callback - INFO - Starting async job submit for node 69be7eaa448e074b3ffe25e3 2026-03-23 11:19:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:19:09,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be7eaa448e074b3ffe25e3 HTTP/1.1" 200 None 2026-03-23 11:19:09,902 - lava_callback - DEBUG - Processing node 69be7eaa448e074b3ffe25e3: baseline-arm64-baylibre 2026-03-23 11:19:09,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be7eaa448e074b3ffe25e3 2026-03-23 11:19:09,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:19:09,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be7eaa448e074b3ffe25e3 HTTP/1.1" 200 None 2026-03-23 11:19:09,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:19:09,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:19:09,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:19:09,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be7eaa448e074b3ffe25e3 HTTP/1.1" 200 None 2026-03-23 11:19:09,963 - lava_callback - ERROR - Error processing callback for node 69be7eaa448e074b3ffe25e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:25:41,132 - lava_callback - INFO - Received callback for node 69be8024448e074b3ffe25f1 INFO: 172.21.0.1:41552 - "POST /node/69be8024448e074b3ffe25f1 HTTP/1.0" 202 Accepted 2026-03-23 11:25:41,138 - lava_callback - INFO - Starting async job submit for node 69be8024448e074b3ffe25f1 2026-03-23 11:25:41,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:25:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8024448e074b3ffe25f1 HTTP/1.1" 200 None 2026-03-23 11:25:41,154 - lava_callback - DEBUG - Processing node 69be8024448e074b3ffe25f1: baseline-arm64-clabbe 2026-03-23 11:25:41,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8024448e074b3ffe25f1 2026-03-23 11:25:41,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:25:41,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8024448e074b3ffe25f1 HTTP/1.1" 200 None 2026-03-23 11:25:41,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:25:41,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:25:41,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:25:41,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8024448e074b3ffe25f1 HTTP/1.1" 200 None 2026-03-23 11:25:41,221 - lava_callback - ERROR - Error processing callback for node 69be8024448e074b3ffe25f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:27:40,847 - lava_callback - INFO - Received callback for node 69be809c448e074b3ffe25fc INFO: 172.21.0.1:40532 - "POST /node/69be809c448e074b3ffe25fc HTTP/1.0" 202 Accepted 2026-03-23 11:27:40,852 - lava_callback - INFO - Starting async job submit for node 69be809c448e074b3ffe25fc 2026-03-23 11:27:40,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:27:40,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be809c448e074b3ffe25fc HTTP/1.1" 200 None 2026-03-23 11:27:40,869 - lava_callback - DEBUG - Processing node 69be809c448e074b3ffe25fc: baseline-arm64-clabbe 2026-03-23 11:27:40,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be809c448e074b3ffe25fc 2026-03-23 11:27:40,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:27:40,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be809c448e074b3ffe25fc HTTP/1.1" 200 None 2026-03-23 11:27:40,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:27:40,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:27:40,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:27:40,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be809c448e074b3ffe25fc HTTP/1.1" 200 None 2026-03-23 11:27:40,954 - lava_callback - ERROR - Error processing callback for node 69be809c448e074b3ffe25fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:29:41,017 - lava_callback - INFO - Received callback for node 69be8115448e074b3ffe2607 INFO: 172.21.0.1:52126 - "POST /node/69be8115448e074b3ffe2607 HTTP/1.0" 202 Accepted 2026-03-23 11:29:41,022 - lava_callback - INFO - Starting async job submit for node 69be8115448e074b3ffe2607 2026-03-23 11:29:41,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:29:41,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8115448e074b3ffe2607 HTTP/1.1" 200 None 2026-03-23 11:29:41,040 - lava_callback - DEBUG - Processing node 69be8115448e074b3ffe2607: baseline-arm64-clabbe 2026-03-23 11:29:41,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8115448e074b3ffe2607 2026-03-23 11:29:41,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:29:41,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8115448e074b3ffe2607 HTTP/1.1" 200 None 2026-03-23 11:29:41,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:29:41,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:29:41,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:29:41,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8115448e074b3ffe2607 HTTP/1.1" 200 None 2026-03-23 11:29:41,096 - lava_callback - ERROR - Error processing callback for node 69be8115448e074b3ffe2607: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:31:01,060 - lava_callback - INFO - Received callback for node 69be8165448e074b3ffe2612 INFO: 172.21.0.1:42362 - "POST /node/69be8165448e074b3ffe2612 HTTP/1.0" 202 Accepted 2026-03-23 11:31:01,066 - lava_callback - INFO - Starting async job submit for node 69be8165448e074b3ffe2612 2026-03-23 11:31:01,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:31:01,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8165448e074b3ffe2612 HTTP/1.1" 200 None 2026-03-23 11:31:01,082 - lava_callback - DEBUG - Processing node 69be8165448e074b3ffe2612: baseline-arm64-clabbe 2026-03-23 11:31:01,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8165448e074b3ffe2612 2026-03-23 11:31:01,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:31:01,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8165448e074b3ffe2612 HTTP/1.1" 200 None 2026-03-23 11:31:01,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:31:01,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:31:01,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:31:01,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8165448e074b3ffe2612 HTTP/1.1" 200 None 2026-03-23 11:31:01,168 - lava_callback - ERROR - Error processing callback for node 69be8165448e074b3ffe2612: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:32:41,166 - lava_callback - INFO - Received callback for node 69be81c9448e074b3ffe261e INFO: 172.21.0.1:51120 - "POST /node/69be81c9448e074b3ffe261e HTTP/1.0" 202 Accepted 2026-03-23 11:32:41,172 - lava_callback - INFO - Starting async job submit for node 69be81c9448e074b3ffe261e 2026-03-23 11:32:41,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:32:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be81c9448e074b3ffe261e HTTP/1.1" 200 None 2026-03-23 11:32:41,187 - lava_callback - DEBUG - Processing node 69be81c9448e074b3ffe261e: baseline-arm64-clabbe 2026-03-23 11:32:41,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be81c9448e074b3ffe261e 2026-03-23 11:32:41,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:32:41,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be81c9448e074b3ffe261e HTTP/1.1" 200 None 2026-03-23 11:32:41,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:32:41,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:32:41,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:32:41,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be81c9448e074b3ffe261e HTTP/1.1" 200 None 2026-03-23 11:32:41,245 - lava_callback - ERROR - Error processing callback for node 69be81c9448e074b3ffe261e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:34:41,263 - lava_callback - INFO - Received callback for node 69be8241448e074b3ffe2629 INFO: 172.21.0.1:57776 - "POST /node/69be8241448e074b3ffe2629 HTTP/1.0" 202 Accepted 2026-03-23 11:34:41,269 - lava_callback - INFO - Starting async job submit for node 69be8241448e074b3ffe2629 2026-03-23 11:34:41,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:34:41,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8241448e074b3ffe2629 HTTP/1.1" 200 None 2026-03-23 11:34:41,306 - lava_callback - DEBUG - Processing node 69be8241448e074b3ffe2629: baseline-arm64-clabbe 2026-03-23 11:34:41,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8241448e074b3ffe2629 2026-03-23 11:34:41,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:34:41,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8241448e074b3ffe2629 HTTP/1.1" 200 None 2026-03-23 11:34:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:34:41,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-23 11:34:41,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:34:41,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8241448e074b3ffe2629 HTTP/1.1" 200 None 2026-03-23 11:34:41,395 - lava_callback - ERROR - Error processing callback for node 69be8241448e074b3ffe2629: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:46:21,888 - lava_callback - INFO - Received callback for node 69be8504448e074b3ffe267c INFO: 172.21.0.1:50360 - "POST /node/69be8504448e074b3ffe267c HTTP/1.0" 202 Accepted 2026-03-23 11:46:21,893 - lava_callback - INFO - Starting async job submit for node 69be8504448e074b3ffe267c 2026-03-23 11:46:21,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:46:21,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8504448e074b3ffe267c HTTP/1.1" 200 None 2026-03-23 11:46:21,912 - lava_callback - DEBUG - Processing node 69be8504448e074b3ffe267c: baseline-arm-clabbe 2026-03-23 11:46:21,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8504448e074b3ffe267c 2026-03-23 11:46:21,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:46:21,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8504448e074b3ffe267c HTTP/1.1" 200 None 2026-03-23 11:46:21,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:46:21,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-23 11:46:21,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:46:21,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8504448e074b3ffe267c HTTP/1.1" 200 None 2026-03-23 11:46:21,987 - lava_callback - ERROR - Error processing callback for node 69be8504448e074b3ffe267c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:47:21,902 - lava_callback - INFO - Received callback for node 69be8541448e074b3ffe268b INFO: 172.21.0.1:56630 - "POST /node/69be8541448e074b3ffe268b HTTP/1.0" 202 Accepted 2026-03-23 11:47:21,908 - lava_callback - INFO - Starting async job submit for node 69be8541448e074b3ffe268b 2026-03-23 11:47:21,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:47:21,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8541448e074b3ffe268b HTTP/1.1" 200 None 2026-03-23 11:47:21,924 - lava_callback - DEBUG - Processing node 69be8541448e074b3ffe268b: baseline-arm-clabbe 2026-03-23 11:47:21,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be8541448e074b3ffe268b 2026-03-23 11:47:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:47:21,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be8541448e074b3ffe268b HTTP/1.1" 200 None 2026-03-23 11:47:21,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:47:21,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-23 11:47:21,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:47:21,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be8541448e074b3ffe268b HTTP/1.1" 200 None 2026-03-23 11:47:21,981 - lava_callback - ERROR - Error processing callback for node 69be8541448e074b3ffe268b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:49:22,011 - lava_callback - INFO - Received callback for node 69be85b9448e074b3ffe2697 INFO: 172.21.0.1:57290 - "POST /node/69be85b9448e074b3ffe2697 HTTP/1.0" 202 Accepted 2026-03-23 11:49:22,017 - lava_callback - INFO - Starting async job submit for node 69be85b9448e074b3ffe2697 2026-03-23 11:49:22,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:49:22,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be85b9448e074b3ffe2697 HTTP/1.1" 200 None 2026-03-23 11:49:22,099 - lava_callback - DEBUG - Processing node 69be85b9448e074b3ffe2697: baseline-arm-clabbe 2026-03-23 11:49:22,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be85b9448e074b3ffe2697 2026-03-23 11:49:22,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:49:22,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be85b9448e074b3ffe2697 HTTP/1.1" 200 None 2026-03-23 11:49:22,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:49:22,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-23 11:49:22,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:49:22,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be85b9448e074b3ffe2697 HTTP/1.1" 200 None 2026-03-23 11:49:22,158 - lava_callback - ERROR - Error processing callback for node 69be85b9448e074b3ffe2697: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:52:22,104 - lava_callback - INFO - Received callback for node 69be866d448e074b3ffe26a8 INFO: 172.21.0.1:37942 - "POST /node/69be866d448e074b3ffe26a8 HTTP/1.0" 202 Accepted 2026-03-23 11:52:22,109 - lava_callback - INFO - Starting async job submit for node 69be866d448e074b3ffe26a8 2026-03-23 11:52:22,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:52:22,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be866d448e074b3ffe26a8 HTTP/1.1" 200 None 2026-03-23 11:52:22,130 - lava_callback - DEBUG - Processing node 69be866d448e074b3ffe26a8: baseline-arm-clabbe 2026-03-23 11:52:22,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be866d448e074b3ffe26a8 2026-03-23 11:52:22,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:52:22,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be866d448e074b3ffe26a8 HTTP/1.1" 200 None 2026-03-23 11:52:22,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:52:22,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-23 11:52:22,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:52:22,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be866d448e074b3ffe26a8 HTTP/1.1" 200 None 2026-03-23 11:52:22,193 - lava_callback - ERROR - Error processing callback for node 69be866d448e074b3ffe26a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK 2026-03-23 11:53:22,218 - lava_callback - INFO - Received callback for node 69be86a9448e074b3ffe26b5 INFO: 172.21.0.1:46864 - "POST /node/69be86a9448e074b3ffe26b5 HTTP/1.0" 202 Accepted 2026-03-23 11:53:22,224 - lava_callback - INFO - Starting async job submit for node 69be86a9448e074b3ffe26b5 2026-03-23 11:53:22,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:53:22,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be86a9448e074b3ffe26b5 HTTP/1.1" 200 None 2026-03-23 11:53:22,239 - lava_callback - DEBUG - Processing node 69be86a9448e074b3ffe26b5: baseline-arm-clabbe 2026-03-23 11:53:22,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be86a9448e074b3ffe26b5 2026-03-23 11:53:22,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:53:22,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be86a9448e074b3ffe26b5 HTTP/1.1" 200 None 2026-03-23 11:53:22,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:53:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-23 11:53:22,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 11:53:22,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be86a9448e074b3ffe26b5 HTTP/1.1" 200 None 2026-03-23 11:53:22,299 - lava_callback - ERROR - Error processing callback for node 69be86a9448e074b3ffe26b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:43:04,349 - lava_callback - INFO - Received callback for node 69be924d448e074b3ffe272e INFO: 172.21.0.1:33990 - "POST /node/69be924d448e074b3ffe272e HTTP/1.0" 202 Accepted 2026-03-23 12:43:04,354 - lava_callback - INFO - Starting async job submit for node 69be924d448e074b3ffe272e 2026-03-23 12:43:04,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:04,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be924d448e074b3ffe272e HTTP/1.1" 200 None 2026-03-23 12:43:04,371 - lava_callback - DEBUG - Processing node 69be924d448e074b3ffe272e: baseline-arm-clabbe 2026-03-23 12:43:04,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be924d448e074b3ffe272e 2026-03-23 12:43:04,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:04,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be924d448e074b3ffe272e HTTP/1.1" 200 None 2026-03-23 12:43:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:04,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 12:43:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:04,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be924d448e074b3ffe272e HTTP/1.1" 200 None 2026-03-23 12:43:04,435 - lava_callback - ERROR - Error processing callback for node 69be924d448e074b3ffe272e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:43:44,338 - lava_callback - INFO - Received callback for node 69be9271448e074b3ffe2738 INFO: 172.21.0.1:34502 - "POST /node/69be9271448e074b3ffe2738 HTTP/1.0" 202 Accepted 2026-03-23 12:43:44,344 - lava_callback - INFO - Starting async job submit for node 69be9271448e074b3ffe2738 2026-03-23 12:43:44,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:44,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9271448e074b3ffe2738 HTTP/1.1" 200 None 2026-03-23 12:43:44,364 - lava_callback - DEBUG - Processing node 69be9271448e074b3ffe2738: baseline-arm-clabbe 2026-03-23 12:43:44,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9271448e074b3ffe2738 2026-03-23 12:43:44,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:44,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9271448e074b3ffe2738 HTTP/1.1" 200 None 2026-03-23 12:43:44,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:44,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 12:43:44,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:43:44,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9271448e074b3ffe2738 HTTP/1.1" 200 None 2026-03-23 12:43:44,420 - lava_callback - ERROR - Error processing callback for node 69be9271448e074b3ffe2738: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:44:24,364 - lava_callback - INFO - Received callback for node 69be92a2448e074b3ffe2749 INFO: 172.21.0.1:35964 - "POST /node/69be92a2448e074b3ffe2749 HTTP/1.0" 202 Accepted 2026-03-23 12:44:24,369 - lava_callback - INFO - Starting async job submit for node 69be92a2448e074b3ffe2749 2026-03-23 12:44:24,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:44:24,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92a2448e074b3ffe2749 HTTP/1.1" 200 None 2026-03-23 12:44:24,389 - lava_callback - DEBUG - Processing node 69be92a2448e074b3ffe2749: baseline-arm-clabbe 2026-03-23 12:44:24,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be92a2448e074b3ffe2749 2026-03-23 12:44:24,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:44:24,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92a2448e074b3ffe2749 HTTP/1.1" 200 None 2026-03-23 12:44:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:44:24,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 12:44:24,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:44:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be92a2448e074b3ffe2749 HTTP/1.1" 200 None 2026-03-23 12:44:24,452 - lava_callback - ERROR - Error processing callback for node 69be92a2448e074b3ffe2749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:45:04,344 - lava_callback - INFO - Received callback for node 69be92c6448e074b3ffe2750 INFO: 172.21.0.1:34530 - "POST /node/69be92c6448e074b3ffe2750 HTTP/1.0" 202 Accepted 2026-03-23 12:45:04,350 - lava_callback - INFO - Starting async job submit for node 69be92c6448e074b3ffe2750 2026-03-23 12:45:04,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:04,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92c6448e074b3ffe2750 HTTP/1.1" 200 None 2026-03-23 12:45:04,372 - lava_callback - DEBUG - Processing node 69be92c6448e074b3ffe2750: baseline-arm-clabbe 2026-03-23 12:45:04,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be92c6448e074b3ffe2750 2026-03-23 12:45:04,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:04,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92c6448e074b3ffe2750 HTTP/1.1" 200 None 2026-03-23 12:45:04,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:04,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 12:45:04,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:04,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be92c6448e074b3ffe2750 HTTP/1.1" 200 None 2026-03-23 12:45:04,435 - lava_callback - ERROR - Error processing callback for node 69be92c6448e074b3ffe2750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:45:44,687 - lava_callback - INFO - Received callback for node 69be92eb448e074b3ffe275c INFO: 172.21.0.1:46856 - "POST /node/69be92eb448e074b3ffe275c HTTP/1.0" 202 Accepted 2026-03-23 12:45:44,693 - lava_callback - INFO - Starting async job submit for node 69be92eb448e074b3ffe275c 2026-03-23 12:45:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:44,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92eb448e074b3ffe275c HTTP/1.1" 200 None 2026-03-23 12:45:44,722 - lava_callback - DEBUG - Processing node 69be92eb448e074b3ffe275c: baseline-arm-clabbe 2026-03-23 12:45:44,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be92eb448e074b3ffe275c 2026-03-23 12:45:44,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:44,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be92eb448e074b3ffe275c HTTP/1.1" 200 None 2026-03-23 12:45:44,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:44,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 12:45:44,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:45:44,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be92eb448e074b3ffe275c HTTP/1.1" 200 None 2026-03-23 12:45:44,794 - lava_callback - ERROR - Error processing callback for node 69be92eb448e074b3ffe275c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:48:34,614 - lava_callback - INFO - Received callback for node 69be938d448e074b3ffe2768 INFO: 172.21.0.1:46888 - "POST /node/69be938d448e074b3ffe2768 HTTP/1.0" 202 Accepted 2026-03-23 12:48:34,620 - lava_callback - INFO - Starting async job submit for node 69be938d448e074b3ffe2768 2026-03-23 12:48:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:34,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be938d448e074b3ffe2768 HTTP/1.1" 200 None 2026-03-23 12:48:34,636 - lava_callback - DEBUG - Processing node 69be938d448e074b3ffe2768: baseline-arm-baylibre 2026-03-23 12:48:34,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be938d448e074b3ffe2768 2026-03-23 12:48:34,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:34,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be938d448e074b3ffe2768 HTTP/1.1" 200 None 2026-03-23 12:48:34,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:34,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:48:34,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:34,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be938d448e074b3ffe2768 HTTP/1.1" 200 None 2026-03-23 12:48:34,701 - lava_callback - ERROR - Error processing callback for node 69be938d448e074b3ffe2768: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:48:54,219 - lava_callback - INFO - Received callback for node 69be93b2448e074b3ffe2773 INFO: 172.21.0.1:40404 - "POST /node/69be93b2448e074b3ffe2773 HTTP/1.0" 202 Accepted 2026-03-23 12:48:54,225 - lava_callback - INFO - Starting async job submit for node 69be93b2448e074b3ffe2773 2026-03-23 12:48:54,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:54,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93b2448e074b3ffe2773 HTTP/1.1" 200 None 2026-03-23 12:48:54,261 - lava_callback - DEBUG - Processing node 69be93b2448e074b3ffe2773: baseline-arm-baylibre 2026-03-23 12:48:54,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be93b2448e074b3ffe2773 2026-03-23 12:48:54,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:54,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93b2448e074b3ffe2773 HTTP/1.1" 200 None 2026-03-23 12:48:54,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:54,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:48:54,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:48:54,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be93b2448e074b3ffe2773 HTTP/1.1" 200 None 2026-03-23 12:48:54,323 - lava_callback - ERROR - Error processing callback for node 69be93b2448e074b3ffe2773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:49:34,241 - lava_callback - INFO - Received callback for node 69be93d5448e074b3ffe2782 INFO: 172.21.0.1:40294 - "POST /node/69be93d5448e074b3ffe2782 HTTP/1.0" 202 Accepted 2026-03-23 12:49:34,247 - lava_callback - INFO - Starting async job submit for node 69be93d5448e074b3ffe2782 2026-03-23 12:49:34,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:49:34,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93d5448e074b3ffe2782 HTTP/1.1" 200 None 2026-03-23 12:49:34,263 - lava_callback - DEBUG - Processing node 69be93d5448e074b3ffe2782: baseline-arm-baylibre 2026-03-23 12:49:34,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be93d5448e074b3ffe2782 2026-03-23 12:49:34,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:49:34,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93d5448e074b3ffe2782 HTTP/1.1" 200 None 2026-03-23 12:49:34,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:49:34,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:49:34,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:49:34,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be93d5448e074b3ffe2782 HTTP/1.1" 200 None 2026-03-23 12:49:34,314 - lava_callback - ERROR - Error processing callback for node 69be93d5448e074b3ffe2782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:50:14,350 - lava_callback - INFO - Received callback for node 69be93f9448e074b3ffe278b INFO: 172.21.0.1:59268 - "POST /node/69be93f9448e074b3ffe278b HTTP/1.0" 202 Accepted 2026-03-23 12:50:14,356 - lava_callback - INFO - Starting async job submit for node 69be93f9448e074b3ffe278b 2026-03-23 12:50:14,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:14,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93f9448e074b3ffe278b HTTP/1.1" 200 None 2026-03-23 12:50:14,371 - lava_callback - DEBUG - Processing node 69be93f9448e074b3ffe278b: baseline-arm-baylibre 2026-03-23 12:50:14,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be93f9448e074b3ffe278b 2026-03-23 12:50:14,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:14,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be93f9448e074b3ffe278b HTTP/1.1" 200 None 2026-03-23 12:50:14,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:14,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:50:14,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:14,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be93f9448e074b3ffe278b HTTP/1.1" 200 None 2026-03-23 12:50:14,431 - lava_callback - ERROR - Error processing callback for node 69be93f9448e074b3ffe278b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:50:54,328 - lava_callback - INFO - Received callback for node 69be941d448e074b3ffe2797 INFO: 172.21.0.1:59614 - "POST /node/69be941d448e074b3ffe2797 HTTP/1.0" 202 Accepted 2026-03-23 12:50:54,333 - lava_callback - INFO - Starting async job submit for node 69be941d448e074b3ffe2797 2026-03-23 12:50:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:54,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be941d448e074b3ffe2797 HTTP/1.1" 200 None 2026-03-23 12:50:54,360 - lava_callback - DEBUG - Processing node 69be941d448e074b3ffe2797: baseline-arm-baylibre 2026-03-23 12:50:54,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be941d448e074b3ffe2797 2026-03-23 12:50:54,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:54,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be941d448e074b3ffe2797 HTTP/1.1" 200 None 2026-03-23 12:50:54,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:54,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:50:54,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:50:54,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be941d448e074b3ffe2797 HTTP/1.1" 200 None 2026-03-23 12:50:54,419 - lava_callback - ERROR - Error processing callback for node 69be941d448e074b3ffe2797: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:51:34,564 - lava_callback - INFO - Received callback for node 69be9444448e074b3ffe27a5 INFO: 172.21.0.1:37184 - "POST /node/69be9444448e074b3ffe27a5 HTTP/1.0" 202 Accepted 2026-03-23 12:51:34,570 - lava_callback - INFO - Starting async job submit for node 69be9444448e074b3ffe27a5 2026-03-23 12:51:34,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:51:34,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9444448e074b3ffe27a5 HTTP/1.1" 200 None 2026-03-23 12:51:34,586 - lava_callback - DEBUG - Processing node 69be9444448e074b3ffe27a5: baseline-arm-baylibre 2026-03-23 12:51:34,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9444448e074b3ffe27a5 2026-03-23 12:51:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:51:34,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9444448e074b3ffe27a5 HTTP/1.1" 200 None 2026-03-23 12:51:34,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:51:34,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:51:34,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:51:34,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9444448e074b3ffe27a5 HTTP/1.1" 200 None 2026-03-23 12:51:34,653 - lava_callback - ERROR - Error processing callback for node 69be9444448e074b3ffe27a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:52:34,392 - lava_callback - INFO - Received callback for node 69be947e448e074b3ffe27b2 INFO: 172.21.0.1:54672 - "POST /node/69be947e448e074b3ffe27b2 HTTP/1.0" 202 Accepted 2026-03-23 12:52:34,398 - lava_callback - INFO - Starting async job submit for node 69be947e448e074b3ffe27b2 2026-03-23 12:52:34,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:34,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be947e448e074b3ffe27b2 HTTP/1.1" 200 None 2026-03-23 12:52:34,424 - lava_callback - DEBUG - Processing node 69be947e448e074b3ffe27b2: baseline-arm-baylibre 2026-03-23 12:52:34,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be947e448e074b3ffe27b2 2026-03-23 12:52:34,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be947e448e074b3ffe27b2 HTTP/1.1" 200 None 2026-03-23 12:52:34,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:34,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:52:34,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:34,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be947e448e074b3ffe27b2 HTTP/1.1" 200 None 2026-03-23 12:52:34,487 - lava_callback - ERROR - Error processing callback for node 69be947e448e074b3ffe27b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:52:54,471 - lava_callback - INFO - Received callback for node 69be94a1448e074b3ffe27bb INFO: 172.21.0.1:45690 - "POST /node/69be94a1448e074b3ffe27bb HTTP/1.0" 202 Accepted 2026-03-23 12:52:54,477 - lava_callback - INFO - Starting async job submit for node 69be94a1448e074b3ffe27bb 2026-03-23 12:52:54,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:54,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94a1448e074b3ffe27bb HTTP/1.1" 200 None 2026-03-23 12:52:54,495 - lava_callback - DEBUG - Processing node 69be94a1448e074b3ffe27bb: baseline-arm-baylibre 2026-03-23 12:52:54,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be94a1448e074b3ffe27bb 2026-03-23 12:52:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:54,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94a1448e074b3ffe27bb HTTP/1.1" 200 None 2026-03-23 12:52:54,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:54,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:52:54,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:52:54,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be94a1448e074b3ffe27bb HTTP/1.1" 200 None 2026-03-23 12:52:54,553 - lava_callback - ERROR - Error processing callback for node 69be94a1448e074b3ffe27bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:53:44,746 - lava_callback - INFO - Received callback for node 69be94c9448e074b3ffe27c7 INFO: 172.21.0.1:58164 - "POST /node/69be94c9448e074b3ffe27c7 HTTP/1.0" 202 Accepted 2026-03-23 12:53:44,752 - lava_callback - INFO - Starting async job submit for node 69be94c9448e074b3ffe27c7 2026-03-23 12:53:44,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:53:44,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94c9448e074b3ffe27c7 HTTP/1.1" 200 None 2026-03-23 12:53:44,768 - lava_callback - DEBUG - Processing node 69be94c9448e074b3ffe27c7: baseline-arm-clabbe 2026-03-23 12:53:44,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be94c9448e074b3ffe27c7 2026-03-23 12:53:44,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:53:44,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94c9448e074b3ffe27c7 HTTP/1.1" 200 None 2026-03-23 12:53:44,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:53:44,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:53:44,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:53:44,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be94c9448e074b3ffe27c7 HTTP/1.1" 200 None 2026-03-23 12:53:44,823 - lava_callback - ERROR - Error processing callback for node 69be94c9448e074b3ffe27c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:54:24,747 - lava_callback - INFO - Received callback for node 69be94ed448e074b3ffe27d2 INFO: 172.21.0.1:35428 - "POST /node/69be94ed448e074b3ffe27d2 HTTP/1.0" 202 Accepted 2026-03-23 12:54:24,752 - lava_callback - INFO - Starting async job submit for node 69be94ed448e074b3ffe27d2 2026-03-23 12:54:24,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:24,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94ed448e074b3ffe27d2 HTTP/1.1" 200 None 2026-03-23 12:54:24,768 - lava_callback - DEBUG - Processing node 69be94ed448e074b3ffe27d2: baseline-arm-clabbe 2026-03-23 12:54:24,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be94ed448e074b3ffe27d2 2026-03-23 12:54:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:24,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be94ed448e074b3ffe27d2 HTTP/1.1" 200 None 2026-03-23 12:54:24,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:24,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:54:24,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:24,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be94ed448e074b3ffe27d2 HTTP/1.1" 200 None 2026-03-23 12:54:24,833 - lava_callback - ERROR - Error processing callback for node 69be94ed448e074b3ffe27d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:54:54,741 - lava_callback - INFO - Received callback for node 69be950d448e074b3ffe27e2 INFO: 172.21.0.1:39616 - "POST /node/69be950d448e074b3ffe27e2 HTTP/1.0" 202 Accepted 2026-03-23 12:54:54,746 - lava_callback - INFO - Starting async job submit for node 69be950d448e074b3ffe27e2 2026-03-23 12:54:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:54,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be950d448e074b3ffe27e2 HTTP/1.1" 200 None 2026-03-23 12:54:54,763 - lava_callback - DEBUG - Processing node 69be950d448e074b3ffe27e2: baseline-arm-baylibre 2026-03-23 12:54:54,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be950d448e074b3ffe27e2 2026-03-23 12:54:54,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:54,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be950d448e074b3ffe27e2 HTTP/1.1" 200 None 2026-03-23 12:54:54,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:54,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:54:54,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:54:54,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be950d448e074b3ffe27e2 HTTP/1.1" 200 None 2026-03-23 12:54:54,822 - lava_callback - ERROR - Error processing callback for node 69be950d448e074b3ffe27e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:55:24,816 - lava_callback - INFO - Received callback for node 69be9534448e074b3ffe27f3 INFO: 172.21.0.1:49766 - "POST /node/69be9534448e074b3ffe27f3 HTTP/1.0" 202 Accepted 2026-03-23 12:55:24,822 - lava_callback - INFO - Starting async job submit for node 69be9534448e074b3ffe27f3 2026-03-23 12:55:24,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:55:24,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9534448e074b3ffe27f3 HTTP/1.1" 200 None 2026-03-23 12:55:24,838 - lava_callback - DEBUG - Processing node 69be9534448e074b3ffe27f3: baseline-arm-clabbe 2026-03-23 12:55:24,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9534448e074b3ffe27f3 2026-03-23 12:55:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:55:24,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9534448e074b3ffe27f3 HTTP/1.1" 200 None 2026-03-23 12:55:24,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:55:24,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:55:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:55:24,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9534448e074b3ffe27f3 HTTP/1.1" 200 None 2026-03-23 12:55:24,891 - lava_callback - ERROR - Error processing callback for node 69be9534448e074b3ffe27f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:56:04,810 - lava_callback - INFO - Received callback for node 69be9558448e074b3ffe2800 INFO: 172.21.0.1:50270 - "POST /node/69be9558448e074b3ffe2800 HTTP/1.0" 202 Accepted 2026-03-23 12:56:04,816 - lava_callback - INFO - Starting async job submit for node 69be9558448e074b3ffe2800 2026-03-23 12:56:04,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:04,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9558448e074b3ffe2800 HTTP/1.1" 200 None 2026-03-23 12:56:04,836 - lava_callback - DEBUG - Processing node 69be9558448e074b3ffe2800: baseline-arm-clabbe 2026-03-23 12:56:04,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9558448e074b3ffe2800 2026-03-23 12:56:04,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:04,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9558448e074b3ffe2800 HTTP/1.1" 200 None 2026-03-23 12:56:04,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:04,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:56:04,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:04,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9558448e074b3ffe2800 HTTP/1.1" 200 None 2026-03-23 12:56:04,899 - lava_callback - ERROR - Error processing callback for node 69be9558448e074b3ffe2800: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:56:34,684 - lava_callback - INFO - Received callback for node 69be9577448e074b3ffe280b INFO: 172.21.0.1:44034 - "POST /node/69be9577448e074b3ffe280b HTTP/1.0" 202 Accepted 2026-03-23 12:56:34,689 - lava_callback - INFO - Starting async job submit for node 69be9577448e074b3ffe280b 2026-03-23 12:56:34,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:34,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9577448e074b3ffe280b HTTP/1.1" 200 None 2026-03-23 12:56:34,705 - lava_callback - DEBUG - Processing node 69be9577448e074b3ffe280b: baseline-arm-baylibre 2026-03-23 12:56:34,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9577448e074b3ffe280b 2026-03-23 12:56:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:34,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9577448e074b3ffe280b HTTP/1.1" 200 None 2026-03-23 12:56:34,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:34,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:56:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:56:34,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9577448e074b3ffe280b HTTP/1.1" 200 None 2026-03-23 12:56:34,769 - lava_callback - ERROR - Error processing callback for node 69be9577448e074b3ffe280b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:57:04,916 - lava_callback - INFO - Received callback for node 69be959e448e074b3ffe2816 INFO: 172.21.0.1:33924 - "POST /node/69be959e448e074b3ffe2816 HTTP/1.0" 202 Accepted 2026-03-23 12:57:04,921 - lava_callback - INFO - Starting async job submit for node 69be959e448e074b3ffe2816 2026-03-23 12:57:04,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:04,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be959e448e074b3ffe2816 HTTP/1.1" 200 None 2026-03-23 12:57:04,938 - lava_callback - DEBUG - Processing node 69be959e448e074b3ffe2816: baseline-arm-clabbe 2026-03-23 12:57:04,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be959e448e074b3ffe2816 2026-03-23 12:57:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:04,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be959e448e074b3ffe2816 HTTP/1.1" 200 None 2026-03-23 12:57:04,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:05,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:57:05,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:05,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be959e448e074b3ffe2816 HTTP/1.1" 200 None 2026-03-23 12:57:05,042 - lava_callback - ERROR - Error processing callback for node 69be959e448e074b3ffe2816: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:57:44,879 - lava_callback - INFO - Received callback for node 69be95c2448e074b3ffe2826 INFO: 172.21.0.1:60372 - "POST /node/69be95c2448e074b3ffe2826 HTTP/1.0" 202 Accepted 2026-03-23 12:57:44,885 - lava_callback - INFO - Starting async job submit for node 69be95c2448e074b3ffe2826 2026-03-23 12:57:44,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:44,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be95c2448e074b3ffe2826 HTTP/1.1" 200 None 2026-03-23 12:57:44,900 - lava_callback - DEBUG - Processing node 69be95c2448e074b3ffe2826: baseline-arm-clabbe 2026-03-23 12:57:44,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be95c2448e074b3ffe2826 2026-03-23 12:57:44,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:44,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be95c2448e074b3ffe2826 HTTP/1.1" 200 None 2026-03-23 12:57:44,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:44,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:57:44,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:57:44,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be95c2448e074b3ffe2826 HTTP/1.1" 200 None 2026-03-23 12:57:44,972 - lava_callback - ERROR - Error processing callback for node 69be95c2448e074b3ffe2826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:58:24,942 - lava_callback - INFO - Received callback for node 69be95e7448e074b3ffe2835 INFO: 172.21.0.1:45632 - "POST /node/69be95e7448e074b3ffe2835 HTTP/1.0" 202 Accepted 2026-03-23 12:58:24,947 - lava_callback - INFO - Starting async job submit for node 69be95e7448e074b3ffe2835 2026-03-23 12:58:24,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:58:24,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be95e7448e074b3ffe2835 HTTP/1.1" 200 None 2026-03-23 12:58:24,963 - lava_callback - DEBUG - Processing node 69be95e7448e074b3ffe2835: baseline-arm-clabbe 2026-03-23 12:58:24,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be95e7448e074b3ffe2835 2026-03-23 12:58:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:58:24,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be95e7448e074b3ffe2835 HTTP/1.1" 200 None 2026-03-23 12:58:24,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:58:24,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:58:24,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:58:25,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be95e7448e074b3ffe2835 HTTP/1.1" 200 None 2026-03-23 12:58:25,025 - lava_callback - ERROR - Error processing callback for node 69be95e7448e074b3ffe2835: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:59:04,956 - lava_callback - INFO - Received callback for node 69be960b448e074b3ffe2842 INFO: 172.21.0.1:48732 - "POST /node/69be960b448e074b3ffe2842 HTTP/1.0" 202 Accepted 2026-03-23 12:59:04,962 - lava_callback - INFO - Starting async job submit for node 69be960b448e074b3ffe2842 2026-03-23 12:59:04,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:04,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be960b448e074b3ffe2842 HTTP/1.1" 200 None 2026-03-23 12:59:04,982 - lava_callback - DEBUG - Processing node 69be960b448e074b3ffe2842: baseline-arm-clabbe 2026-03-23 12:59:04,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be960b448e074b3ffe2842 2026-03-23 12:59:04,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be960b448e074b3ffe2842 HTTP/1.1" 200 None 2026-03-23 12:59:04,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:05,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:59:05,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:05,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be960b448e074b3ffe2842 HTTP/1.1" 200 None 2026-03-23 12:59:05,037 - lava_callback - ERROR - Error processing callback for node 69be960b448e074b3ffe2842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK 2026-03-23 12:59:34,848 - lava_callback - INFO - Received callback for node 69be962d448e074b3ffe284d INFO: 172.21.0.1:41452 - "POST /node/69be962d448e074b3ffe284d HTTP/1.0" 202 Accepted 2026-03-23 12:59:34,853 - lava_callback - INFO - Starting async job submit for node 69be962d448e074b3ffe284d 2026-03-23 12:59:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:34,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be962d448e074b3ffe284d HTTP/1.1" 200 None 2026-03-23 12:59:34,871 - lava_callback - DEBUG - Processing node 69be962d448e074b3ffe284d: baseline-arm-baylibre 2026-03-23 12:59:34,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be962d448e074b3ffe284d 2026-03-23 12:59:34,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:34,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be962d448e074b3ffe284d HTTP/1.1" 200 None 2026-03-23 12:59:34,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:34,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 12:59:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 12:59:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be962d448e074b3ffe284d HTTP/1.1" 200 None 2026-03-23 12:59:34,954 - lava_callback - ERROR - Error processing callback for node 69be962d448e074b3ffe284d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:00:05,300 - lava_callback - INFO - Received callback for node 69be9652448e074b3ffe2857 INFO: 172.21.0.1:53132 - "POST /node/69be9652448e074b3ffe2857 HTTP/1.0" 202 Accepted 2026-03-23 13:00:05,305 - lava_callback - INFO - Starting async job submit for node 69be9652448e074b3ffe2857 2026-03-23 13:00:05,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:05,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9652448e074b3ffe2857 HTTP/1.1" 200 None 2026-03-23 13:00:05,323 - lava_callback - DEBUG - Processing node 69be9652448e074b3ffe2857: baseline-arm-clabbe 2026-03-23 13:00:05,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9652448e074b3ffe2857 2026-03-23 13:00:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:05,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9652448e074b3ffe2857 HTTP/1.1" 200 None 2026-03-23 13:00:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:05,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:00:05,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9652448e074b3ffe2857 HTTP/1.1" 200 None 2026-03-23 13:00:05,380 - lava_callback - ERROR - Error processing callback for node 69be9652448e074b3ffe2857: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:00:45,060 - lava_callback - INFO - Received callback for node 69be9676448e074b3ffe2866 INFO: 172.21.0.1:32936 - "POST /node/69be9676448e074b3ffe2866 HTTP/1.0" 202 Accepted 2026-03-23 13:00:45,066 - lava_callback - INFO - Starting async job submit for node 69be9676448e074b3ffe2866 2026-03-23 13:00:45,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:45,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9676448e074b3ffe2866 HTTP/1.1" 200 None 2026-03-23 13:00:45,088 - lava_callback - DEBUG - Processing node 69be9676448e074b3ffe2866: baseline-arm-clabbe 2026-03-23 13:00:45,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9676448e074b3ffe2866 2026-03-23 13:00:45,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:45,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9676448e074b3ffe2866 HTTP/1.1" 200 None 2026-03-23 13:00:45,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:45,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:00:45,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:00:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9676448e074b3ffe2866 HTTP/1.1" 200 None 2026-03-23 13:00:45,142 - lava_callback - ERROR - Error processing callback for node 69be9676448e074b3ffe2866: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:01:25,144 - lava_callback - INFO - Received callback for node 69be969a448e074b3ffe2874 INFO: 172.21.0.1:50782 - "POST /node/69be969a448e074b3ffe2874 HTTP/1.0" 202 Accepted 2026-03-23 13:01:25,150 - lava_callback - INFO - Starting async job submit for node 69be969a448e074b3ffe2874 2026-03-23 13:01:25,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:01:25,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be969a448e074b3ffe2874 HTTP/1.1" 200 None 2026-03-23 13:01:25,185 - lava_callback - DEBUG - Processing node 69be969a448e074b3ffe2874: baseline-arm-clabbe 2026-03-23 13:01:25,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be969a448e074b3ffe2874 2026-03-23 13:01:25,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:01:25,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be969a448e074b3ffe2874 HTTP/1.1" 200 None 2026-03-23 13:01:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:01:25,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:01:25,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:01:25,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be969a448e074b3ffe2874 HTTP/1.1" 200 None 2026-03-23 13:01:25,243 - lava_callback - ERROR - Error processing callback for node 69be969a448e074b3ffe2874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:02:05,103 - lava_callback - INFO - Received callback for node 69be96be448e074b3ffe287f INFO: 172.21.0.1:59924 - "POST /node/69be96be448e074b3ffe287f HTTP/1.0" 202 Accepted 2026-03-23 13:02:05,108 - lava_callback - INFO - Starting async job submit for node 69be96be448e074b3ffe287f 2026-03-23 13:02:05,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:05,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be96be448e074b3ffe287f HTTP/1.1" 200 None 2026-03-23 13:02:05,141 - lava_callback - DEBUG - Processing node 69be96be448e074b3ffe287f: baseline-arm-clabbe 2026-03-23 13:02:05,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be96be448e074b3ffe287f 2026-03-23 13:02:05,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be96be448e074b3ffe287f HTTP/1.1" 200 None 2026-03-23 13:02:05,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:05,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:02:05,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:05,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be96be448e074b3ffe287f HTTP/1.1" 200 None 2026-03-23 13:02:05,202 - lava_callback - ERROR - Error processing callback for node 69be96be448e074b3ffe287f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:02:45,192 - lava_callback - INFO - Received callback for node 69be96e3448e074b3ffe2888 INFO: 172.21.0.1:42896 - "POST /node/69be96e3448e074b3ffe2888 HTTP/1.0" 202 Accepted 2026-03-23 13:02:45,198 - lava_callback - INFO - Starting async job submit for node 69be96e3448e074b3ffe2888 2026-03-23 13:02:45,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:45,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be96e3448e074b3ffe2888 HTTP/1.1" 200 None 2026-03-23 13:02:45,221 - lava_callback - DEBUG - Processing node 69be96e3448e074b3ffe2888: baseline-arm-clabbe 2026-03-23 13:02:45,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be96e3448e074b3ffe2888 2026-03-23 13:02:45,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:45,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be96e3448e074b3ffe2888 HTTP/1.1" 200 None 2026-03-23 13:02:45,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:45,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:02:45,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:02:45,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be96e3448e074b3ffe2888 HTTP/1.1" 200 None 2026-03-23 13:02:45,301 - lava_callback - ERROR - Error processing callback for node 69be96e3448e074b3ffe2888: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 13:03:15,233 - lava_callback - INFO - Received callback for node 69be9705448e074b3ffe2891 INFO: 172.21.0.1:37006 - "POST /node/69be9705448e074b3ffe2891 HTTP/1.0" 202 Accepted 2026-03-23 13:03:15,239 - lava_callback - INFO - Starting async job submit for node 69be9705448e074b3ffe2891 2026-03-23 13:03:15,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:15,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9705448e074b3ffe2891 HTTP/1.1" 200 None 2026-03-23 13:03:15,287 - lava_callback - DEBUG - Processing node 69be9705448e074b3ffe2891: baseline-arm-baylibre 2026-03-23 13:03:15,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9705448e074b3ffe2891 2026-03-23 13:03:15,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:15,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9705448e074b3ffe2891 HTTP/1.1" 200 None 2026-03-23 13:03:15,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:15,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:03:15,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:15,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9705448e074b3ffe2891 HTTP/1.1" 200 None 2026-03-23 13:03:15,362 - lava_callback - ERROR - Error processing callback for node 69be9705448e074b3ffe2891: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:03:45,234 - lava_callback - INFO - Received callback for node 69be972a448e074b3ffe28a0 INFO: 172.21.0.1:52164 - "POST /node/69be972a448e074b3ffe28a0 HTTP/1.0" 202 Accepted 2026-03-23 13:03:45,239 - lava_callback - INFO - Starting async job submit for node 69be972a448e074b3ffe28a0 2026-03-23 13:03:45,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:45,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be972a448e074b3ffe28a0 HTTP/1.1" 200 None 2026-03-23 13:03:45,265 - lava_callback - DEBUG - Processing node 69be972a448e074b3ffe28a0: baseline-arm-clabbe 2026-03-23 13:03:45,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be972a448e074b3ffe28a0 2026-03-23 13:03:45,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:45,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be972a448e074b3ffe28a0 HTTP/1.1" 200 None 2026-03-23 13:03:45,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:45,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:03:45,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:03:45,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be972a448e074b3ffe28a0 HTTP/1.1" 200 None 2026-03-23 13:03:45,344 - lava_callback - ERROR - Error processing callback for node 69be972a448e074b3ffe28a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:04:25,229 - lava_callback - INFO - Received callback for node 69be9755448e074b3ffe28b0 INFO: 172.21.0.1:34644 - "POST /node/69be9755448e074b3ffe28b0 HTTP/1.0" 202 Accepted 2026-03-23 13:04:25,235 - lava_callback - INFO - Starting async job submit for node 69be9755448e074b3ffe28b0 2026-03-23 13:04:25,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:04:25,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9755448e074b3ffe28b0 HTTP/1.1" 200 None 2026-03-23 13:04:25,253 - lava_callback - DEBUG - Processing node 69be9755448e074b3ffe28b0: baseline-arm-clabbe 2026-03-23 13:04:25,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9755448e074b3ffe28b0 2026-03-23 13:04:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:04:25,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9755448e074b3ffe28b0 HTTP/1.1" 200 None 2026-03-23 13:04:25,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:04:25,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40bca1e2bfb1b33443eb HTTP/1.1" 200 None 2026-03-23 13:04:25,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:04:25,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9755448e074b3ffe28b0 HTTP/1.1" 200 None 2026-03-23 13:04:25,312 - lava_callback - ERROR - Error processing callback for node 69be9755448e074b3ffe28b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:20:36,406 - lava_callback - INFO - Received callback for node 69be9b1d448e074b3ffe28fb INFO: 172.21.0.1:33160 - "POST /node/69be9b1d448e074b3ffe28fb HTTP/1.0" 202 Accepted 2026-03-23 13:20:36,415 - lava_callback - INFO - Starting async job submit for node 69be9b1d448e074b3ffe28fb 2026-03-23 13:20:36,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:20:36,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9b1d448e074b3ffe28fb HTTP/1.1" 200 None 2026-03-23 13:20:36,447 - lava_callback - DEBUG - Processing node 69be9b1d448e074b3ffe28fb: baseline-arm64-baylibre 2026-03-23 13:20:36,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9b1d448e074b3ffe28fb 2026-03-23 13:20:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:20:36,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9b1d448e074b3ffe28fb HTTP/1.1" 200 None 2026-03-23 13:20:36,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:20:36,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:20:36,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:20:36,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9b1d448e074b3ffe28fb HTTP/1.1" 200 None 2026-03-23 13:20:36,505 - lava_callback - ERROR - Error processing callback for node 69be9b1d448e074b3ffe28fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:21:56,069 - lava_callback - INFO - Received callback for node 69be9b6a448e074b3ffe2905 INFO: 172.21.0.1:40312 - "POST /node/69be9b6a448e074b3ffe2905 HTTP/1.0" 202 Accepted 2026-03-23 13:21:56,074 - lava_callback - INFO - Starting async job submit for node 69be9b6a448e074b3ffe2905 2026-03-23 13:21:56,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:21:56,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9b6a448e074b3ffe2905 HTTP/1.1" 200 None 2026-03-23 13:21:56,099 - lava_callback - DEBUG - Processing node 69be9b6a448e074b3ffe2905: baseline-arm64-baylibre 2026-03-23 13:21:56,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9b6a448e074b3ffe2905 2026-03-23 13:21:56,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:21:56,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9b6a448e074b3ffe2905 HTTP/1.1" 200 None 2026-03-23 13:21:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:21:56,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:21:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:21:56,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9b6a448e074b3ffe2905 HTTP/1.1" 200 None 2026-03-23 13:21:56,193 - lava_callback - ERROR - Error processing callback for node 69be9b6a448e074b3ffe2905: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:23:36,137 - lava_callback - INFO - Received callback for node 69be9bd0448e074b3ffe2913 INFO: 172.21.0.1:52472 - "POST /node/69be9bd0448e074b3ffe2913 HTTP/1.0" 202 Accepted 2026-03-23 13:23:36,142 - lava_callback - INFO - Starting async job submit for node 69be9bd0448e074b3ffe2913 2026-03-23 13:23:36,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:23:36,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9bd0448e074b3ffe2913 HTTP/1.1" 200 None 2026-03-23 13:23:36,159 - lava_callback - DEBUG - Processing node 69be9bd0448e074b3ffe2913: baseline-arm64-baylibre 2026-03-23 13:23:36,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9bd0448e074b3ffe2913 2026-03-23 13:23:36,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:23:36,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9bd0448e074b3ffe2913 HTTP/1.1" 200 None 2026-03-23 13:23:36,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:23:36,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:23:36,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:23:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9bd0448e074b3ffe2913 HTTP/1.1" 200 None 2026-03-23 13:23:36,215 - lava_callback - ERROR - Error processing callback for node 69be9bd0448e074b3ffe2913: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:24:56,164 - lava_callback - INFO - Received callback for node 69be9c1b448e074b3ffe291e INFO: 172.21.0.1:36674 - "POST /node/69be9c1b448e074b3ffe291e HTTP/1.0" 202 Accepted 2026-03-23 13:24:56,170 - lava_callback - INFO - Starting async job submit for node 69be9c1b448e074b3ffe291e 2026-03-23 13:24:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:24:56,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9c1b448e074b3ffe291e HTTP/1.1" 200 None 2026-03-23 13:24:56,199 - lava_callback - DEBUG - Processing node 69be9c1b448e074b3ffe291e: baseline-arm64-baylibre 2026-03-23 13:24:56,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9c1b448e074b3ffe291e 2026-03-23 13:24:56,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:24:56,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9c1b448e074b3ffe291e HTTP/1.1" 200 None 2026-03-23 13:24:56,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:24:56,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:24:56,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:24:56,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9c1b448e074b3ffe291e HTTP/1.1" 200 None 2026-03-23 13:24:56,292 - lava_callback - ERROR - Error processing callback for node 69be9c1b448e074b3ffe291e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 13:26:16,252 - lava_callback - INFO - Received callback for node 69be9c66448e074b3ffe292d INFO: 172.21.0.1:38554 - "POST /node/69be9c66448e074b3ffe292d HTTP/1.0" 202 Accepted 2026-03-23 13:26:16,258 - lava_callback - INFO - Starting async job submit for node 69be9c66448e074b3ffe292d 2026-03-23 13:26:16,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:26:16,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9c66448e074b3ffe292d HTTP/1.1" 200 None 2026-03-23 13:26:16,293 - lava_callback - DEBUG - Processing node 69be9c66448e074b3ffe292d: baseline-arm64-baylibre 2026-03-23 13:26:16,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9c66448e074b3ffe292d 2026-03-23 13:26:16,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:26:16,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9c66448e074b3ffe292d HTTP/1.1" 200 None 2026-03-23 13:26:16,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:26:16,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:26:16,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:26:16,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9c66448e074b3ffe292d HTTP/1.1" 200 None 2026-03-23 13:26:16,361 - lava_callback - ERROR - Error processing callback for node 69be9c66448e074b3ffe292d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 13:27:16,321 - lava_callback - INFO - Received callback for node 69be9cb0448e074b3ffe293d INFO: 172.21.0.1:53958 - "POST /node/69be9cb0448e074b3ffe293d HTTP/1.0" 202 Accepted 2026-03-23 13:27:16,326 - lava_callback - INFO - Starting async job submit for node 69be9cb0448e074b3ffe293d 2026-03-23 13:27:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:27:16,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9cb0448e074b3ffe293d HTTP/1.1" 200 None 2026-03-23 13:27:16,342 - lava_callback - DEBUG - Processing node 69be9cb0448e074b3ffe293d: baseline-arm64-baylibre 2026-03-23 13:27:16,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9cb0448e074b3ffe293d 2026-03-23 13:27:16,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:27:16,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9cb0448e074b3ffe293d HTTP/1.1" 200 None 2026-03-23 13:27:16,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:27:16,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:27:16,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:27:16,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9cb0448e074b3ffe293d HTTP/1.1" 200 None 2026-03-23 13:27:16,398 - lava_callback - ERROR - Error processing callback for node 69be9cb0448e074b3ffe293d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:28:36,368 - lava_callback - INFO - Received callback for node 69be9cfb448e074b3ffe294c INFO: 172.21.0.1:48998 - "POST /node/69be9cfb448e074b3ffe294c HTTP/1.0" 202 Accepted 2026-03-23 13:28:36,374 - lava_callback - INFO - Starting async job submit for node 69be9cfb448e074b3ffe294c 2026-03-23 13:28:36,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:28:36,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9cfb448e074b3ffe294c HTTP/1.1" 200 None 2026-03-23 13:28:36,390 - lava_callback - DEBUG - Processing node 69be9cfb448e074b3ffe294c: baseline-arm64-baylibre 2026-03-23 13:28:36,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9cfb448e074b3ffe294c 2026-03-23 13:28:36,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:28:36,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9cfb448e074b3ffe294c HTTP/1.1" 200 None 2026-03-23 13:28:36,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:28:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:28:36,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:28:36,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9cfb448e074b3ffe294c HTTP/1.1" 200 None 2026-03-23 13:28:36,448 - lava_callback - ERROR - Error processing callback for node 69be9cfb448e074b3ffe294c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:29:56,421 - lava_callback - INFO - Received callback for node 69be9d43448e074b3ffe2955 INFO: 172.21.0.1:45030 - "POST /node/69be9d43448e074b3ffe2955 HTTP/1.0" 202 Accepted 2026-03-23 13:29:56,426 - lava_callback - INFO - Starting async job submit for node 69be9d43448e074b3ffe2955 2026-03-23 13:29:56,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:29:56,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9d43448e074b3ffe2955 HTTP/1.1" 200 None 2026-03-23 13:29:56,442 - lava_callback - DEBUG - Processing node 69be9d43448e074b3ffe2955: baseline-arm64-baylibre 2026-03-23 13:29:56,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9d43448e074b3ffe2955 2026-03-23 13:29:56,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:29:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9d43448e074b3ffe2955 HTTP/1.1" 200 None 2026-03-23 13:29:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:29:56,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:29:56,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:29:56,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9d43448e074b3ffe2955 HTTP/1.1" 200 None 2026-03-23 13:29:56,519 - lava_callback - ERROR - Error processing callback for node 69be9d43448e074b3ffe2955: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:30:56,485 - lava_callback - INFO - Received callback for node 69be9d8e448e074b3ffe296a INFO: 172.21.0.1:59372 - "POST /node/69be9d8e448e074b3ffe296a HTTP/1.0" 202 Accepted 2026-03-23 13:30:56,490 - lava_callback - INFO - Starting async job submit for node 69be9d8e448e074b3ffe296a 2026-03-23 13:30:56,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:30:56,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9d8e448e074b3ffe296a HTTP/1.1" 200 None 2026-03-23 13:30:56,529 - lava_callback - DEBUG - Processing node 69be9d8e448e074b3ffe296a: baseline-arm64-baylibre 2026-03-23 13:30:56,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9d8e448e074b3ffe296a 2026-03-23 13:30:56,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:30:56,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9d8e448e074b3ffe296a HTTP/1.1" 200 None 2026-03-23 13:30:56,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:30:56,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:30:56,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:30:56,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9d8e448e074b3ffe296a HTTP/1.1" 200 None 2026-03-23 13:30:56,605 - lava_callback - ERROR - Error processing callback for node 69be9d8e448e074b3ffe296a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:32:16,545 - lava_callback - INFO - Received callback for node 69be9ddb448e074b3ffe2976 INFO: 172.21.0.1:35438 - "POST /node/69be9ddb448e074b3ffe2976 HTTP/1.0" 202 Accepted 2026-03-23 13:32:16,551 - lava_callback - INFO - Starting async job submit for node 69be9ddb448e074b3ffe2976 2026-03-23 13:32:16,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:32:16,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9ddb448e074b3ffe2976 HTTP/1.1" 200 None 2026-03-23 13:32:16,576 - lava_callback - DEBUG - Processing node 69be9ddb448e074b3ffe2976: baseline-arm64-baylibre 2026-03-23 13:32:16,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9ddb448e074b3ffe2976 2026-03-23 13:32:16,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:32:16,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9ddb448e074b3ffe2976 HTTP/1.1" 200 None 2026-03-23 13:32:16,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:32:16,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:32:16,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:32:16,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9ddb448e074b3ffe2976 HTTP/1.1" 200 None 2026-03-23 13:32:16,663 - lava_callback - ERROR - Error processing callback for node 69be9ddb448e074b3ffe2976: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:33:46,510 - lava_callback - INFO - Received callback for node 69be9e2c448e074b3ffe298a INFO: 172.21.0.1:40570 - "POST /node/69be9e2c448e074b3ffe298a HTTP/1.0" 202 Accepted 2026-03-23 13:33:46,516 - lava_callback - INFO - Starting async job submit for node 69be9e2c448e074b3ffe298a 2026-03-23 13:33:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:33:46,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9e2c448e074b3ffe298a HTTP/1.1" 200 None 2026-03-23 13:33:46,532 - lava_callback - DEBUG - Processing node 69be9e2c448e074b3ffe298a: baseline-arm64-clabbe 2026-03-23 13:33:46,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9e2c448e074b3ffe298a 2026-03-23 13:33:46,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:33:46,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9e2c448e074b3ffe298a HTTP/1.1" 200 None 2026-03-23 13:33:46,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:33:46,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:33:46,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:33:46,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9e2c448e074b3ffe298a HTTP/1.1" 200 None 2026-03-23 13:33:46,590 - lava_callback - ERROR - Error processing callback for node 69be9e2c448e074b3ffe298a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:34:56,902 - lava_callback - INFO - Received callback for node 69be9e70448e074b3ffe2994 INFO: 172.21.0.1:33428 - "POST /node/69be9e70448e074b3ffe2994 HTTP/1.0" 202 Accepted 2026-03-23 13:34:56,908 - lava_callback - INFO - Starting async job submit for node 69be9e70448e074b3ffe2994 2026-03-23 13:34:56,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:34:56,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9e70448e074b3ffe2994 HTTP/1.1" 200 None 2026-03-23 13:34:56,926 - lava_callback - DEBUG - Processing node 69be9e70448e074b3ffe2994: baseline-arm64-baylibre 2026-03-23 13:34:56,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9e70448e074b3ffe2994 2026-03-23 13:34:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:34:56,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9e70448e074b3ffe2994 HTTP/1.1" 200 None 2026-03-23 13:34:56,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:34:56,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:34:56,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:34:56,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9e70448e074b3ffe2994 HTTP/1.1" 200 None 2026-03-23 13:34:56,992 - lava_callback - ERROR - Error processing callback for node 69be9e70448e074b3ffe2994: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:36:06,560 - lava_callback - INFO - Received callback for node 69be9ec3448e074b3ffe29a1 INFO: 172.21.0.1:57306 - "POST /node/69be9ec3448e074b3ffe29a1 HTTP/1.0" 202 Accepted 2026-03-23 13:36:06,566 - lava_callback - INFO - Starting async job submit for node 69be9ec3448e074b3ffe29a1 2026-03-23 13:36:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:36:06,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9ec3448e074b3ffe29a1 HTTP/1.1" 200 None 2026-03-23 13:36:06,593 - lava_callback - DEBUG - Processing node 69be9ec3448e074b3ffe29a1: baseline-arm64-clabbe 2026-03-23 13:36:06,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9ec3448e074b3ffe29a1 2026-03-23 13:36:06,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:36:06,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9ec3448e074b3ffe29a1 HTTP/1.1" 200 None 2026-03-23 13:36:06,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:36:06,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:36:06,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:36:06,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9ec3448e074b3ffe29a1 HTTP/1.1" 200 None 2026-03-23 13:36:06,707 - lava_callback - ERROR - Error processing callback for node 69be9ec3448e074b3ffe29a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:37:26,580 - lava_callback - INFO - Received callback for node 69be9f10448e074b3ffe29b1 INFO: 172.21.0.1:56128 - "POST /node/69be9f10448e074b3ffe29b1 HTTP/1.0" 202 Accepted 2026-03-23 13:37:26,586 - lava_callback - INFO - Starting async job submit for node 69be9f10448e074b3ffe29b1 2026-03-23 13:37:26,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:37:26,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9f10448e074b3ffe29b1 HTTP/1.1" 200 None 2026-03-23 13:37:26,602 - lava_callback - DEBUG - Processing node 69be9f10448e074b3ffe29b1: baseline-arm64-clabbe 2026-03-23 13:37:26,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9f10448e074b3ffe29b1 2026-03-23 13:37:26,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:37:26,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9f10448e074b3ffe29b1 HTTP/1.1" 200 None 2026-03-23 13:37:26,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:37:26,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:37:26,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:37:26,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9f10448e074b3ffe29b1 HTTP/1.1" 200 None 2026-03-23 13:37:26,677 - lava_callback - ERROR - Error processing callback for node 69be9f10448e074b3ffe29b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:38:46,567 - lava_callback - INFO - Received callback for node 69be9f5a448e074b3ffe29bc INFO: 172.21.0.1:47534 - "POST /node/69be9f5a448e074b3ffe29bc HTTP/1.0" 202 Accepted 2026-03-23 13:38:46,572 - lava_callback - INFO - Starting async job submit for node 69be9f5a448e074b3ffe29bc 2026-03-23 13:38:46,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:38:46,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9f5a448e074b3ffe29bc HTTP/1.1" 200 None 2026-03-23 13:38:46,588 - lava_callback - DEBUG - Processing node 69be9f5a448e074b3ffe29bc: baseline-arm64-clabbe 2026-03-23 13:38:46,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9f5a448e074b3ffe29bc 2026-03-23 13:38:46,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:38:46,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9f5a448e074b3ffe29bc HTTP/1.1" 200 None 2026-03-23 13:38:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:38:46,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:38:46,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:38:46,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9f5a448e074b3ffe29bc HTTP/1.1" 200 None 2026-03-23 13:38:46,655 - lava_callback - ERROR - Error processing callback for node 69be9f5a448e074b3ffe29bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:40:06,737 - lava_callback - INFO - Received callback for node 69be9fa6448e074b3ffe29cb INFO: 172.21.0.1:42694 - "POST /node/69be9fa6448e074b3ffe29cb HTTP/1.0" 202 Accepted 2026-03-23 13:40:06,743 - lava_callback - INFO - Starting async job submit for node 69be9fa6448e074b3ffe29cb 2026-03-23 13:40:06,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:40:06,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9fa6448e074b3ffe29cb HTTP/1.1" 200 None 2026-03-23 13:40:06,759 - lava_callback - DEBUG - Processing node 69be9fa6448e074b3ffe29cb: baseline-arm64-clabbe 2026-03-23 13:40:06,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69be9fa6448e074b3ffe29cb 2026-03-23 13:40:06,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:40:06,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be9fa6448e074b3ffe29cb HTTP/1.1" 200 None 2026-03-23 13:40:06,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:40:06,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:40:06,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:40:06,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69be9fa6448e074b3ffe29cb HTTP/1.1" 200 None 2026-03-23 13:40:06,833 - lava_callback - ERROR - Error processing callback for node 69be9fa6448e074b3ffe29cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:42:26,836 - lava_callback - INFO - Received callback for node 69bea03a448e074b3ffe29e2 INFO: 172.21.0.1:39916 - "POST /node/69bea03a448e074b3ffe29e2 HTTP/1.0" 202 Accepted 2026-03-23 13:42:26,842 - lava_callback - INFO - Starting async job submit for node 69bea03a448e074b3ffe29e2 2026-03-23 13:42:26,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:42:26,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea03a448e074b3ffe29e2 HTTP/1.1" 200 None 2026-03-23 13:42:26,858 - lava_callback - DEBUG - Processing node 69bea03a448e074b3ffe29e2: baseline-arm64-clabbe 2026-03-23 13:42:26,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea03a448e074b3ffe29e2 2026-03-23 13:42:26,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:42:26,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea03a448e074b3ffe29e2 HTTP/1.1" 200 None 2026-03-23 13:42:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:42:26,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:42:26,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:42:26,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea03a448e074b3ffe29e2 HTTP/1.1" 200 None 2026-03-23 13:42:26,909 - lava_callback - ERROR - Error processing callback for node 69bea03a448e074b3ffe29e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:43:37,424 - lava_callback - INFO - Received callback for node 69bea07e448e074b3ffe29ed INFO: 172.21.0.1:43524 - "POST /node/69bea07e448e074b3ffe29ed HTTP/1.0" 202 Accepted 2026-03-23 13:43:37,430 - lava_callback - INFO - Starting async job submit for node 69bea07e448e074b3ffe29ed 2026-03-23 13:43:37,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:43:37,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea07e448e074b3ffe29ed HTTP/1.1" 200 None 2026-03-23 13:43:37,470 - lava_callback - DEBUG - Processing node 69bea07e448e074b3ffe29ed: baseline-arm64-baylibre 2026-03-23 13:43:37,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea07e448e074b3ffe29ed 2026-03-23 13:43:37,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:43:37,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea07e448e074b3ffe29ed HTTP/1.1" 200 None 2026-03-23 13:43:37,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:43:37,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:43:37,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:43:37,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea07e448e074b3ffe29ed HTTP/1.1" 200 None 2026-03-23 13:43:37,522 - lava_callback - ERROR - Error processing callback for node 69bea07e448e074b3ffe29ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:45:06,970 - lava_callback - INFO - Received callback for node 69bea0ce448e074b3ffe29f5 INFO: 172.21.0.1:38844 - "POST /node/69bea0ce448e074b3ffe29f5 HTTP/1.0" 202 Accepted 2026-03-23 13:45:06,976 - lava_callback - INFO - Starting async job submit for node 69bea0ce448e074b3ffe29f5 2026-03-23 13:45:06,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:45:06,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea0ce448e074b3ffe29f5 HTTP/1.1" 200 None 2026-03-23 13:45:06,992 - lava_callback - DEBUG - Processing node 69bea0ce448e074b3ffe29f5: baseline-arm64-clabbe 2026-03-23 13:45:06,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea0ce448e074b3ffe29f5 2026-03-23 13:45:06,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:45:07,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea0ce448e074b3ffe29f5 HTTP/1.1" 200 None 2026-03-23 13:45:07,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:45:07,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:45:07,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:45:07,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea0ce448e074b3ffe29f5 HTTP/1.1" 200 None 2026-03-23 13:45:07,057 - lava_callback - ERROR - Error processing callback for node 69bea0ce448e074b3ffe29f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:46:07,026 - lava_callback - INFO - Received callback for node 69bea118448e074b3ffe2a03 INFO: 172.21.0.1:43250 - "POST /node/69bea118448e074b3ffe2a03 HTTP/1.0" 202 Accepted 2026-03-23 13:46:07,032 - lava_callback - INFO - Starting async job submit for node 69bea118448e074b3ffe2a03 2026-03-23 13:46:07,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:46:07,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea118448e074b3ffe2a03 HTTP/1.1" 200 None 2026-03-23 13:46:07,048 - lava_callback - DEBUG - Processing node 69bea118448e074b3ffe2a03: baseline-arm64-clabbe 2026-03-23 13:46:07,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea118448e074b3ffe2a03 2026-03-23 13:46:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:46:07,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea118448e074b3ffe2a03 HTTP/1.1" 200 None 2026-03-23 13:46:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:46:07,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:46:07,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:46:07,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea118448e074b3ffe2a03 HTTP/1.1" 200 None 2026-03-23 13:46:07,109 - lava_callback - ERROR - Error processing callback for node 69bea118448e074b3ffe2a03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32810 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:47:17,414 - lava_callback - INFO - Received callback for node 69bea15c448e074b3ffe2a0d INFO: 172.21.0.1:32818 - "POST /node/69bea15c448e074b3ffe2a0d HTTP/1.0" 202 Accepted 2026-03-23 13:47:17,420 - lava_callback - INFO - Starting async job submit for node 69bea15c448e074b3ffe2a0d 2026-03-23 13:47:17,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:47:17,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea15c448e074b3ffe2a0d HTTP/1.1" 200 None 2026-03-23 13:47:17,437 - lava_callback - DEBUG - Processing node 69bea15c448e074b3ffe2a0d: baseline-arm64-baylibre 2026-03-23 13:47:17,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea15c448e074b3ffe2a0d 2026-03-23 13:47:17,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:47:17,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea15c448e074b3ffe2a0d HTTP/1.1" 200 None 2026-03-23 13:47:17,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:47:17,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:47:17,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:47:17,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea15c448e074b3ffe2a0d HTTP/1.1" 200 None 2026-03-23 13:47:17,501 - lava_callback - ERROR - Error processing callback for node 69bea15c448e074b3ffe2a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:48:47,152 - lava_callback - INFO - Received callback for node 69bea1ac448e074b3ffe2a1e INFO: 172.21.0.1:32928 - "POST /node/69bea1ac448e074b3ffe2a1e HTTP/1.0" 202 Accepted 2026-03-23 13:48:47,158 - lava_callback - INFO - Starting async job submit for node 69bea1ac448e074b3ffe2a1e 2026-03-23 13:48:47,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:48:47,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea1ac448e074b3ffe2a1e HTTP/1.1" 200 None 2026-03-23 13:48:47,173 - lava_callback - DEBUG - Processing node 69bea1ac448e074b3ffe2a1e: baseline-arm64-clabbe 2026-03-23 13:48:47,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea1ac448e074b3ffe2a1e 2026-03-23 13:48:47,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:48:47,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea1ac448e074b3ffe2a1e HTTP/1.1" 200 None 2026-03-23 13:48:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:48:47,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:48:47,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:48:47,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea1ac448e074b3ffe2a1e HTTP/1.1" 200 None 2026-03-23 13:48:47,226 - lava_callback - ERROR - Error processing callback for node 69bea1ac448e074b3ffe2a1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:49:38,001 - lava_callback - INFO - Received callback for node 69bea1ef448e074b3ffe2a26 INFO: 172.21.0.1:41064 - "POST /node/69bea1ef448e074b3ffe2a26 HTTP/1.0" 202 Accepted 2026-03-23 13:49:38,007 - lava_callback - INFO - Starting async job submit for node 69bea1ef448e074b3ffe2a26 2026-03-23 13:49:38,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:49:38,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea1ef448e074b3ffe2a26 HTTP/1.1" 200 None 2026-03-23 13:49:38,024 - lava_callback - DEBUG - Processing node 69bea1ef448e074b3ffe2a26: baseline-arm64-baylibre 2026-03-23 13:49:38,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea1ef448e074b3ffe2a26 2026-03-23 13:49:38,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:49:38,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea1ef448e074b3ffe2a26 HTTP/1.1" 200 None 2026-03-23 13:49:38,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:49:38,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:49:38,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:49:38,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea1ef448e074b3ffe2a26 HTTP/1.1" 200 None 2026-03-23 13:49:38,095 - lava_callback - ERROR - Error processing callback for node 69bea1ef448e074b3ffe2a26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:51:07,237 - lava_callback - INFO - Received callback for node 69bea23d448e074b3ffe2a33 INFO: 172.21.0.1:48096 - "POST /node/69bea23d448e074b3ffe2a33 HTTP/1.0" 202 Accepted 2026-03-23 13:51:07,243 - lava_callback - INFO - Starting async job submit for node 69bea23d448e074b3ffe2a33 2026-03-23 13:51:07,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:51:07,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea23d448e074b3ffe2a33 HTTP/1.1" 200 None 2026-03-23 13:51:07,259 - lava_callback - DEBUG - Processing node 69bea23d448e074b3ffe2a33: baseline-arm64-clabbe 2026-03-23 13:51:07,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea23d448e074b3ffe2a33 2026-03-23 13:51:07,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:51:07,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea23d448e074b3ffe2a33 HTTP/1.1" 200 None 2026-03-23 13:51:07,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:51:07,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:51:07,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:51:07,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea23d448e074b3ffe2a33 HTTP/1.1" 200 None 2026-03-23 13:51:07,333 - lava_callback - ERROR - Error processing callback for node 69bea23d448e074b3ffe2a33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:52:27,282 - lava_callback - INFO - Received callback for node 69bea286448e074b3ffe2a40 INFO: 172.21.0.1:51540 - "POST /node/69bea286448e074b3ffe2a40 HTTP/1.0" 202 Accepted 2026-03-23 13:52:27,290 - lava_callback - INFO - Starting async job submit for node 69bea286448e074b3ffe2a40 2026-03-23 13:52:27,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:52:27,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea286448e074b3ffe2a40 HTTP/1.1" 200 None 2026-03-23 13:52:27,309 - lava_callback - DEBUG - Processing node 69bea286448e074b3ffe2a40: baseline-arm64-clabbe 2026-03-23 13:52:27,309 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea286448e074b3ffe2a40 2026-03-23 13:52:27,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:52:27,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea286448e074b3ffe2a40 HTTP/1.1" 200 None 2026-03-23 13:52:27,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:52:27,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:52:27,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:52:27,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea286448e074b3ffe2a40 HTTP/1.1" 200 None 2026-03-23 13:52:27,373 - lava_callback - ERROR - Error processing callback for node 69bea286448e074b3ffe2a40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:53:27,307 - lava_callback - INFO - Received callback for node 69bea2d1448e074b3ffe2a50 INFO: 172.21.0.1:45052 - "POST /node/69bea2d1448e074b3ffe2a50 HTTP/1.0" 202 Accepted 2026-03-23 13:53:27,313 - lava_callback - INFO - Starting async job submit for node 69bea2d1448e074b3ffe2a50 2026-03-23 13:53:27,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:53:27,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea2d1448e074b3ffe2a50 HTTP/1.1" 200 None 2026-03-23 13:53:27,330 - lava_callback - DEBUG - Processing node 69bea2d1448e074b3ffe2a50: baseline-arm64-clabbe 2026-03-23 13:53:27,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea2d1448e074b3ffe2a50 2026-03-23 13:53:27,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:53:27,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea2d1448e074b3ffe2a50 HTTP/1.1" 200 None 2026-03-23 13:53:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:53:27,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:53:27,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:53:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea2d1448e074b3ffe2a50 HTTP/1.1" 200 None 2026-03-23 13:53:27,395 - lava_callback - ERROR - Error processing callback for node 69bea2d1448e074b3ffe2a50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:54:48,775 - lava_callback - INFO - Received callback for node 69bea31a448e074b3ffe2a59 INFO: 172.21.0.1:46122 - "POST /node/69bea31a448e074b3ffe2a59 HTTP/1.0" 202 Accepted 2026-03-23 13:54:48,780 - lava_callback - INFO - Starting async job submit for node 69bea31a448e074b3ffe2a59 2026-03-23 13:54:48,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:54:48,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea31a448e074b3ffe2a59 HTTP/1.1" 200 None 2026-03-23 13:54:48,799 - lava_callback - DEBUG - Processing node 69bea31a448e074b3ffe2a59: baseline-arm64-clabbe 2026-03-23 13:54:48,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea31a448e074b3ffe2a59 2026-03-23 13:54:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:54:48,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea31a448e074b3ffe2a59 HTTP/1.1" 200 None 2026-03-23 13:54:48,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:54:48,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:54:48,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:54:48,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea31a448e074b3ffe2a59 HTTP/1.1" 200 None 2026-03-23 13:54:48,880 - lava_callback - ERROR - Error processing callback for node 69bea31a448e074b3ffe2a59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:56:07,389 - lava_callback - INFO - Received callback for node 69bea365448e074b3ffe2a66 INFO: 172.21.0.1:48812 - "POST /node/69bea365448e074b3ffe2a66 HTTP/1.0" 202 Accepted 2026-03-23 13:56:07,394 - lava_callback - INFO - Starting async job submit for node 69bea365448e074b3ffe2a66 2026-03-23 13:56:07,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:56:07,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea365448e074b3ffe2a66 HTTP/1.1" 200 None 2026-03-23 13:56:07,412 - lava_callback - DEBUG - Processing node 69bea365448e074b3ffe2a66: baseline-arm64-clabbe 2026-03-23 13:56:07,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea365448e074b3ffe2a66 2026-03-23 13:56:07,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:56:07,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea365448e074b3ffe2a66 HTTP/1.1" 200 None 2026-03-23 13:56:07,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:56:07,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:56:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:56:07,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea365448e074b3ffe2a66 HTTP/1.1" 200 None 2026-03-23 13:56:07,466 - lava_callback - ERROR - Error processing callback for node 69bea365448e074b3ffe2a66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:57:07,440 - lava_callback - INFO - Received callback for node 69bea3ae448e074b3ffe2a71 INFO: 172.21.0.1:55234 - "POST /node/69bea3ae448e074b3ffe2a71 HTTP/1.0" 202 Accepted 2026-03-23 13:57:07,446 - lava_callback - INFO - Starting async job submit for node 69bea3ae448e074b3ffe2a71 2026-03-23 13:57:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:57:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea3ae448e074b3ffe2a71 HTTP/1.1" 200 None 2026-03-23 13:57:07,461 - lava_callback - DEBUG - Processing node 69bea3ae448e074b3ffe2a71: baseline-arm64-clabbe 2026-03-23 13:57:07,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea3ae448e074b3ffe2a71 2026-03-23 13:57:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:57:07,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea3ae448e074b3ffe2a71 HTTP/1.1" 200 None 2026-03-23 13:57:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:57:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:57:07,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:57:07,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea3ae448e074b3ffe2a71 HTTP/1.1" 200 None 2026-03-23 13:57:07,524 - lava_callback - ERROR - Error processing callback for node 69bea3ae448e074b3ffe2a71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:58:27,501 - lava_callback - INFO - Received callback for node 69bea3f8448e074b3ffe2a7b INFO: 172.21.0.1:54028 - "POST /node/69bea3f8448e074b3ffe2a7b HTTP/1.0" 202 Accepted 2026-03-23 13:58:27,507 - lava_callback - INFO - Starting async job submit for node 69bea3f8448e074b3ffe2a7b 2026-03-23 13:58:27,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:58:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea3f8448e074b3ffe2a7b HTTP/1.1" 200 None 2026-03-23 13:58:27,523 - lava_callback - DEBUG - Processing node 69bea3f8448e074b3ffe2a7b: baseline-arm64-clabbe 2026-03-23 13:58:27,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea3f8448e074b3ffe2a7b 2026-03-23 13:58:27,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:58:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea3f8448e074b3ffe2a7b HTTP/1.1" 200 None 2026-03-23 13:58:27,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:58:27,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:58:27,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:58:27,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea3f8448e074b3ffe2a7b HTTP/1.1" 200 None 2026-03-23 13:58:27,594 - lava_callback - ERROR - Error processing callback for node 69bea3f8448e074b3ffe2a7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK 2026-03-23 13:59:47,532 - lava_callback - INFO - Received callback for node 69bea441448e074b3ffe2a8b INFO: 172.21.0.1:53120 - "POST /node/69bea441448e074b3ffe2a8b HTTP/1.0" 202 Accepted 2026-03-23 13:59:47,538 - lava_callback - INFO - Starting async job submit for node 69bea441448e074b3ffe2a8b 2026-03-23 13:59:47,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:59:47,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea441448e074b3ffe2a8b HTTP/1.1" 200 None 2026-03-23 13:59:47,554 - lava_callback - DEBUG - Processing node 69bea441448e074b3ffe2a8b: baseline-arm64-clabbe 2026-03-23 13:59:47,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea441448e074b3ffe2a8b 2026-03-23 13:59:47,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:59:47,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea441448e074b3ffe2a8b HTTP/1.1" 200 None 2026-03-23 13:59:47,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:59:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 13:59:47,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 13:59:47,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea441448e074b3ffe2a8b HTTP/1.1" 200 None 2026-03-23 13:59:47,613 - lava_callback - ERROR - Error processing callback for node 69bea441448e074b3ffe2a8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:07:59,000 - lava_callback - INFO - Received callback for node 69bea639448e074b3ffe2ad9 INFO: 172.21.0.1:42534 - "POST /node/69bea639448e074b3ffe2ad9 HTTP/1.0" 202 Accepted 2026-03-23 14:07:59,005 - lava_callback - INFO - Starting async job submit for node 69bea639448e074b3ffe2ad9 2026-03-23 14:07:59,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:07:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea639448e074b3ffe2ad9 HTTP/1.1" 200 None 2026-03-23 14:07:59,023 - lava_callback - DEBUG - Processing node 69bea639448e074b3ffe2ad9: baseline-arm64-baylibre 2026-03-23 14:07:59,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea639448e074b3ffe2ad9 2026-03-23 14:07:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:07:59,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea639448e074b3ffe2ad9 HTTP/1.1" 200 None 2026-03-23 14:07:59,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:07:59,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:07:59,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:07:59,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea639448e074b3ffe2ad9 HTTP/1.1" 200 None 2026-03-23 14:07:59,091 - lava_callback - ERROR - Error processing callback for node 69bea639448e074b3ffe2ad9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:09:18,643 - lava_callback - INFO - Received callback for node 69bea682448e074b3ffe2ae0 INFO: 172.21.0.1:43192 - "POST /node/69bea682448e074b3ffe2ae0 HTTP/1.0" 202 Accepted 2026-03-23 14:09:18,649 - lava_callback - INFO - Starting async job submit for node 69bea682448e074b3ffe2ae0 2026-03-23 14:09:18,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:09:18,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea682448e074b3ffe2ae0 HTTP/1.1" 200 None 2026-03-23 14:09:18,665 - lava_callback - DEBUG - Processing node 69bea682448e074b3ffe2ae0: baseline-arm64-baylibre 2026-03-23 14:09:18,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea682448e074b3ffe2ae0 2026-03-23 14:09:18,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:09:18,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea682448e074b3ffe2ae0 HTTP/1.1" 200 None 2026-03-23 14:09:18,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:09:18,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:09:18,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:09:18,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea682448e074b3ffe2ae0 HTTP/1.1" 200 None 2026-03-23 14:09:18,723 - lava_callback - ERROR - Error processing callback for node 69bea682448e074b3ffe2ae0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:10:38,600 - lava_callback - INFO - Received callback for node 69bea6cc448e074b3ffe2af1 INFO: 172.21.0.1:50564 - "POST /node/69bea6cc448e074b3ffe2af1 HTTP/1.0" 202 Accepted 2026-03-23 14:10:38,605 - lava_callback - INFO - Starting async job submit for node 69bea6cc448e074b3ffe2af1 2026-03-23 14:10:38,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:10:38,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea6cc448e074b3ffe2af1 HTTP/1.1" 200 None 2026-03-23 14:10:38,622 - lava_callback - DEBUG - Processing node 69bea6cc448e074b3ffe2af1: baseline-arm64-baylibre 2026-03-23 14:10:38,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea6cc448e074b3ffe2af1 2026-03-23 14:10:38,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:10:38,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea6cc448e074b3ffe2af1 HTTP/1.1" 200 None 2026-03-23 14:10:38,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:10:38,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:10:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:10:38,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea6cc448e074b3ffe2af1 HTTP/1.1" 200 None 2026-03-23 14:10:38,685 - lava_callback - ERROR - Error processing callback for node 69bea6cc448e074b3ffe2af1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:11:38,613 - lava_callback - INFO - Received callback for node 69bea717448e074b3ffe2af8 INFO: 172.21.0.1:40342 - "POST /node/69bea717448e074b3ffe2af8 HTTP/1.0" 202 Accepted 2026-03-23 14:11:38,619 - lava_callback - INFO - Starting async job submit for node 69bea717448e074b3ffe2af8 2026-03-23 14:11:38,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:11:38,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea717448e074b3ffe2af8 HTTP/1.1" 200 None 2026-03-23 14:11:38,636 - lava_callback - DEBUG - Processing node 69bea717448e074b3ffe2af8: baseline-arm64-baylibre 2026-03-23 14:11:38,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea717448e074b3ffe2af8 2026-03-23 14:11:38,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:11:38,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea717448e074b3ffe2af8 HTTP/1.1" 200 None 2026-03-23 14:11:38,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:11:38,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:11:38,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:11:38,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea717448e074b3ffe2af8 HTTP/1.1" 200 None 2026-03-23 14:11:38,705 - lava_callback - ERROR - Error processing callback for node 69bea717448e074b3ffe2af8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:12:58,765 - lava_callback - INFO - Received callback for node 69bea760448e074b3ffe2b02 INFO: 172.21.0.1:52914 - "POST /node/69bea760448e074b3ffe2b02 HTTP/1.0" 202 Accepted 2026-03-23 14:12:58,771 - lava_callback - INFO - Starting async job submit for node 69bea760448e074b3ffe2b02 2026-03-23 14:12:58,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:12:58,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea760448e074b3ffe2b02 HTTP/1.1" 200 None 2026-03-23 14:12:58,790 - lava_callback - DEBUG - Processing node 69bea760448e074b3ffe2b02: baseline-arm64-baylibre 2026-03-23 14:12:58,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea760448e074b3ffe2b02 2026-03-23 14:12:58,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:12:58,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea760448e074b3ffe2b02 HTTP/1.1" 200 None 2026-03-23 14:12:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:12:58,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:12:58,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:12:58,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea760448e074b3ffe2b02 HTTP/1.1" 200 None 2026-03-23 14:12:58,873 - lava_callback - ERROR - Error processing callback for node 69bea760448e074b3ffe2b02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:14:18,902 - lava_callback - INFO - Received callback for node 69bea7a9448e074b3ffe2b0e INFO: 172.21.0.1:42708 - "POST /node/69bea7a9448e074b3ffe2b0e HTTP/1.0" 202 Accepted 2026-03-23 14:14:18,908 - lava_callback - INFO - Starting async job submit for node 69bea7a9448e074b3ffe2b0e 2026-03-23 14:14:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:14:18,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea7a9448e074b3ffe2b0e HTTP/1.1" 200 None 2026-03-23 14:14:18,924 - lava_callback - DEBUG - Processing node 69bea7a9448e074b3ffe2b0e: baseline-arm64-baylibre 2026-03-23 14:14:18,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea7a9448e074b3ffe2b0e 2026-03-23 14:14:18,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:14:18,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea7a9448e074b3ffe2b0e HTTP/1.1" 200 None 2026-03-23 14:14:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:14:18,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:14:18,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:14:19,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea7a9448e074b3ffe2b0e HTTP/1.1" 200 None 2026-03-23 14:14:19,012 - lava_callback - ERROR - Error processing callback for node 69bea7a9448e074b3ffe2b0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:15:28,285 - lava_callback - INFO - Received callback for node 69bea7f9448e074b3ffe2b1b INFO: 172.21.0.1:33080 - "POST /node/69bea7f9448e074b3ffe2b1b HTTP/1.0" 202 Accepted 2026-03-23 14:15:28,290 - lava_callback - INFO - Starting async job submit for node 69bea7f9448e074b3ffe2b1b 2026-03-23 14:15:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:15:28,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea7f9448e074b3ffe2b1b HTTP/1.1" 200 None 2026-03-23 14:15:28,306 - lava_callback - DEBUG - Processing node 69bea7f9448e074b3ffe2b1b: baseline-arm64-clabbe 2026-03-23 14:15:28,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea7f9448e074b3ffe2b1b 2026-03-23 14:15:28,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:15:28,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea7f9448e074b3ffe2b1b HTTP/1.1" 200 None 2026-03-23 14:15:28,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:15:28,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:15:28,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:15:28,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea7f9448e074b3ffe2b1b HTTP/1.1" 200 None 2026-03-23 14:15:28,357 - lava_callback - ERROR - Error processing callback for node 69bea7f9448e074b3ffe2b1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:16:48,304 - lava_callback - INFO - Received callback for node 69bea844448e074b3ffe2b23 INFO: 172.21.0.1:39688 - "POST /node/69bea844448e074b3ffe2b23 HTTP/1.0" 202 Accepted 2026-03-23 14:16:48,310 - lava_callback - INFO - Starting async job submit for node 69bea844448e074b3ffe2b23 2026-03-23 14:16:48,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:16:48,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea844448e074b3ffe2b23 HTTP/1.1" 200 None 2026-03-23 14:16:48,326 - lava_callback - DEBUG - Processing node 69bea844448e074b3ffe2b23: baseline-arm64-clabbe 2026-03-23 14:16:48,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea844448e074b3ffe2b23 2026-03-23 14:16:48,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:16:48,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea844448e074b3ffe2b23 HTTP/1.1" 200 None 2026-03-23 14:16:48,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:16:48,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:16:48,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:16:48,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea844448e074b3ffe2b23 HTTP/1.1" 200 None 2026-03-23 14:16:48,378 - lava_callback - ERROR - Error processing callback for node 69bea844448e074b3ffe2b23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:18:08,393 - lava_callback - INFO - Received callback for node 69bea88e448e074b3ffe2b2d INFO: 172.21.0.1:51762 - "POST /node/69bea88e448e074b3ffe2b2d HTTP/1.0" 202 Accepted 2026-03-23 14:18:08,399 - lava_callback - INFO - Starting async job submit for node 69bea88e448e074b3ffe2b2d 2026-03-23 14:18:08,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:18:08,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea88e448e074b3ffe2b2d HTTP/1.1" 200 None 2026-03-23 14:18:08,415 - lava_callback - DEBUG - Processing node 69bea88e448e074b3ffe2b2d: baseline-arm64-clabbe 2026-03-23 14:18:08,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea88e448e074b3ffe2b2d 2026-03-23 14:18:08,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:18:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea88e448e074b3ffe2b2d HTTP/1.1" 200 None 2026-03-23 14:18:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:18:08,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:18:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:18:08,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea88e448e074b3ffe2b2d HTTP/1.1" 200 None 2026-03-23 14:18:08,472 - lava_callback - ERROR - Error processing callback for node 69bea88e448e074b3ffe2b2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:19:08,471 - lava_callback - INFO - Received callback for node 69bea8d8448e074b3ffe2b35 INFO: 172.21.0.1:45704 - "POST /node/69bea8d8448e074b3ffe2b35 HTTP/1.0" 202 Accepted 2026-03-23 14:19:08,477 - lava_callback - INFO - Starting async job submit for node 69bea8d8448e074b3ffe2b35 2026-03-23 14:19:08,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:19:08,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea8d8448e074b3ffe2b35 HTTP/1.1" 200 None 2026-03-23 14:19:08,494 - lava_callback - DEBUG - Processing node 69bea8d8448e074b3ffe2b35: baseline-arm64-clabbe 2026-03-23 14:19:08,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea8d8448e074b3ffe2b35 2026-03-23 14:19:08,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:19:08,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea8d8448e074b3ffe2b35 HTTP/1.1" 200 None 2026-03-23 14:19:08,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:19:08,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:19:08,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:19:08,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea8d8448e074b3ffe2b35 HTTP/1.1" 200 None 2026-03-23 14:19:08,550 - lava_callback - ERROR - Error processing callback for node 69bea8d8448e074b3ffe2b35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:20:28,527 - lava_callback - INFO - Received callback for node 69bea923448e074b3ffe2b4a INFO: 172.21.0.1:37434 - "POST /node/69bea923448e074b3ffe2b4a HTTP/1.0" 202 Accepted 2026-03-23 14:20:28,533 - lava_callback - INFO - Starting async job submit for node 69bea923448e074b3ffe2b4a 2026-03-23 14:20:28,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:20:28,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea923448e074b3ffe2b4a HTTP/1.1" 200 None 2026-03-23 14:20:28,551 - lava_callback - DEBUG - Processing node 69bea923448e074b3ffe2b4a: baseline-arm64-clabbe 2026-03-23 14:20:28,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea923448e074b3ffe2b4a 2026-03-23 14:20:28,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:20:28,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea923448e074b3ffe2b4a HTTP/1.1" 200 None 2026-03-23 14:20:28,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:20:28,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:20:28,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:20:28,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea923448e074b3ffe2b4a HTTP/1.1" 200 None 2026-03-23 14:20:28,604 - lava_callback - ERROR - Error processing callback for node 69bea923448e074b3ffe2b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:21:48,611 - lava_callback - INFO - Received callback for node 69bea96d448e074b3ffe2b52 INFO: 172.21.0.1:46228 - "POST /node/69bea96d448e074b3ffe2b52 HTTP/1.0" 202 Accepted 2026-03-23 14:21:48,616 - lava_callback - INFO - Starting async job submit for node 69bea96d448e074b3ffe2b52 2026-03-23 14:21:48,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:21:48,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea96d448e074b3ffe2b52 HTTP/1.1" 200 None 2026-03-23 14:21:48,633 - lava_callback - DEBUG - Processing node 69bea96d448e074b3ffe2b52: baseline-arm64-clabbe 2026-03-23 14:21:48,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea96d448e074b3ffe2b52 2026-03-23 14:21:48,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:21:48,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea96d448e074b3ffe2b52 HTTP/1.1" 200 None 2026-03-23 14:21:48,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:21:48,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 14:21:48,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:21:48,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea96d448e074b3ffe2b52 HTTP/1.1" 200 None 2026-03-23 14:21:48,693 - lava_callback - ERROR - Error processing callback for node 69bea96d448e074b3ffe2b52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:23:08,645 - lava_callback - INFO - Received callback for node 69bea9b7448e074b3ffe2b58 INFO: 172.21.0.1:36142 - "POST /node/69bea9b7448e074b3ffe2b58 HTTP/1.0" 202 Accepted 2026-03-23 14:23:08,650 - lava_callback - INFO - Starting async job submit for node 69bea9b7448e074b3ffe2b58 2026-03-23 14:23:08,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:23:08,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea9b7448e074b3ffe2b58 HTTP/1.1" 200 None 2026-03-23 14:23:08,666 - lava_callback - DEBUG - Processing node 69bea9b7448e074b3ffe2b58: baseline-arm64-clabbe 2026-03-23 14:23:08,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bea9b7448e074b3ffe2b58 2026-03-23 14:23:08,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:23:08,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bea9b7448e074b3ffe2b58 HTTP/1.1" 200 None 2026-03-23 14:23:08,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:23:08,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40cfa1e2bfb1b33443fa HTTP/1.1" 200 None 2026-03-23 14:23:08,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:23:08,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bea9b7448e074b3ffe2b58 HTTP/1.1" 200 None 2026-03-23 14:23:08,720 - lava_callback - ERROR - Error processing callback for node 69bea9b7448e074b3ffe2b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:40:40,398 - lava_callback - INFO - Received callback for node 69beade5448e074b3ffe2b9e INFO: 172.21.0.1:51376 - "POST /node/69beade5448e074b3ffe2b9e HTTP/1.0" 202 Accepted 2026-03-23 14:40:40,404 - lava_callback - INFO - Starting async job submit for node 69beade5448e074b3ffe2b9e 2026-03-23 14:40:40,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:40:40,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beade5448e074b3ffe2b9e HTTP/1.1" 200 None 2026-03-23 14:40:40,420 - lava_callback - DEBUG - Processing node 69beade5448e074b3ffe2b9e: baseline-arm-baylibre 2026-03-23 14:40:40,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beade5448e074b3ffe2b9e 2026-03-23 14:40:40,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:40:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beade5448e074b3ffe2b9e HTTP/1.1" 200 None 2026-03-23 14:40:40,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:40:40,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:40:40,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:40:40,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beade5448e074b3ffe2b9e HTTP/1.1" 200 None 2026-03-23 14:40:40,509 - lava_callback - ERROR - Error processing callback for node 69beade5448e074b3ffe2b9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:41:20,219 - lava_callback - INFO - Received callback for node 69beae09448e074b3ffe2bb5 INFO: 172.21.0.1:37232 - "POST /node/69beae09448e074b3ffe2bb5 HTTP/1.0" 202 Accepted 2026-03-23 14:41:20,225 - lava_callback - INFO - Starting async job submit for node 69beae09448e074b3ffe2bb5 2026-03-23 14:41:20,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:41:20,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae09448e074b3ffe2bb5 HTTP/1.1" 200 None 2026-03-23 14:41:20,244 - lava_callback - DEBUG - Processing node 69beae09448e074b3ffe2bb5: baseline-arm-baylibre 2026-03-23 14:41:20,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beae09448e074b3ffe2bb5 2026-03-23 14:41:20,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:41:20,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae09448e074b3ffe2bb5 HTTP/1.1" 200 None 2026-03-23 14:41:20,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:41:20,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:41:20,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:41:20,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beae09448e074b3ffe2bb5 HTTP/1.1" 200 None 2026-03-23 14:41:20,307 - lava_callback - ERROR - Error processing callback for node 69beae09448e074b3ffe2bb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:42:00,316 - lava_callback - INFO - Received callback for node 69beae2d448e074b3ffe2bbf INFO: 172.21.0.1:38466 - "POST /node/69beae2d448e074b3ffe2bbf HTTP/1.0" 202 Accepted 2026-03-23 14:42:00,322 - lava_callback - INFO - Starting async job submit for node 69beae2d448e074b3ffe2bbf 2026-03-23 14:42:00,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:00,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae2d448e074b3ffe2bbf HTTP/1.1" 200 None 2026-03-23 14:42:00,338 - lava_callback - DEBUG - Processing node 69beae2d448e074b3ffe2bbf: baseline-arm-baylibre 2026-03-23 14:42:00,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beae2d448e074b3ffe2bbf 2026-03-23 14:42:00,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:00,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae2d448e074b3ffe2bbf HTTP/1.1" 200 None 2026-03-23 14:42:00,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:00,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:42:00,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:00,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beae2d448e074b3ffe2bbf HTTP/1.1" 200 None 2026-03-23 14:42:00,389 - lava_callback - ERROR - Error processing callback for node 69beae2d448e074b3ffe2bbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:42:40,315 - lava_callback - INFO - Received callback for node 69beae52448e074b3ffe2bcb INFO: 172.21.0.1:49082 - "POST /node/69beae52448e074b3ffe2bcb HTTP/1.0" 202 Accepted 2026-03-23 14:42:40,320 - lava_callback - INFO - Starting async job submit for node 69beae52448e074b3ffe2bcb 2026-03-23 14:42:40,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:40,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae52448e074b3ffe2bcb HTTP/1.1" 200 None 2026-03-23 14:42:40,336 - lava_callback - DEBUG - Processing node 69beae52448e074b3ffe2bcb: baseline-arm-baylibre 2026-03-23 14:42:40,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beae52448e074b3ffe2bcb 2026-03-23 14:42:40,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:40,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae52448e074b3ffe2bcb HTTP/1.1" 200 None 2026-03-23 14:42:40,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:40,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:42:40,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:42:40,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beae52448e074b3ffe2bcb HTTP/1.1" 200 None 2026-03-23 14:42:40,395 - lava_callback - ERROR - Error processing callback for node 69beae52448e074b3ffe2bcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:43:20,357 - lava_callback - INFO - Received callback for node 69beae75448e074b3ffe2bd4 INFO: 172.21.0.1:39428 - "POST /node/69beae75448e074b3ffe2bd4 HTTP/1.0" 202 Accepted 2026-03-23 14:43:20,362 - lava_callback - INFO - Starting async job submit for node 69beae75448e074b3ffe2bd4 2026-03-23 14:43:20,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae75448e074b3ffe2bd4 HTTP/1.1" 200 None 2026-03-23 14:43:20,379 - lava_callback - DEBUG - Processing node 69beae75448e074b3ffe2bd4: baseline-arm-baylibre 2026-03-23 14:43:20,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beae75448e074b3ffe2bd4 2026-03-23 14:43:20,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:20,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae75448e074b3ffe2bd4 HTTP/1.1" 200 None 2026-03-23 14:43:20,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:20,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:43:20,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:20,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beae75448e074b3ffe2bd4 HTTP/1.1" 200 None 2026-03-23 14:43:20,441 - lava_callback - ERROR - Error processing callback for node 69beae75448e074b3ffe2bd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:43:40,357 - lava_callback - INFO - Received callback for node 69beae99448e074b3ffe2bdd INFO: 172.21.0.1:43442 - "POST /node/69beae99448e074b3ffe2bdd HTTP/1.0" 202 Accepted 2026-03-23 14:43:40,362 - lava_callback - INFO - Starting async job submit for node 69beae99448e074b3ffe2bdd 2026-03-23 14:43:40,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:40,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae99448e074b3ffe2bdd HTTP/1.1" 200 None 2026-03-23 14:43:40,378 - lava_callback - DEBUG - Processing node 69beae99448e074b3ffe2bdd: baseline-arm-baylibre 2026-03-23 14:43:40,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beae99448e074b3ffe2bdd 2026-03-23 14:43:40,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:40,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beae99448e074b3ffe2bdd HTTP/1.1" 200 None 2026-03-23 14:43:40,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:40,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:43:40,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:43:40,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beae99448e074b3ffe2bdd HTTP/1.1" 200 None 2026-03-23 14:43:40,437 - lava_callback - ERROR - Error processing callback for node 69beae99448e074b3ffe2bdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:44:20,402 - lava_callback - INFO - Received callback for node 69beaebd448e074b3ffe2be6 INFO: 172.21.0.1:38308 - "POST /node/69beaebd448e074b3ffe2be6 HTTP/1.0" 202 Accepted 2026-03-23 14:44:20,408 - lava_callback - INFO - Starting async job submit for node 69beaebd448e074b3ffe2be6 2026-03-23 14:44:20,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:44:20,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaebd448e074b3ffe2be6 HTTP/1.1" 200 None 2026-03-23 14:44:20,423 - lava_callback - DEBUG - Processing node 69beaebd448e074b3ffe2be6: baseline-arm-baylibre 2026-03-23 14:44:20,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beaebd448e074b3ffe2be6 2026-03-23 14:44:20,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:44:20,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaebd448e074b3ffe2be6 HTTP/1.1" 200 None 2026-03-23 14:44:20,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:44:20,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:44:20,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:44:20,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beaebd448e074b3ffe2be6 HTTP/1.1" 200 None 2026-03-23 14:44:20,485 - lava_callback - ERROR - Error processing callback for node 69beaebd448e074b3ffe2be6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:46:09,655 - lava_callback - INFO - Received callback for node 69beaf29448e074b3ffe2c0d INFO: 172.21.0.1:33070 - "POST /node/69beaf29448e074b3ffe2c0d HTTP/1.0" 202 Accepted 2026-03-23 14:46:09,660 - lava_callback - INFO - Starting async job submit for node 69beaf29448e074b3ffe2c0d 2026-03-23 14:46:09,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf29448e074b3ffe2c0d HTTP/1.1" 200 None 2026-03-23 14:46:09,676 - lava_callback - DEBUG - Processing node 69beaf29448e074b3ffe2c0d: baseline-arm-clabbe 2026-03-23 14:46:09,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beaf29448e074b3ffe2c0d 2026-03-23 14:46:09,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:09,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf29448e074b3ffe2c0d HTTP/1.1" 200 None 2026-03-23 14:46:09,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:09,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:46:09,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:09,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beaf29448e074b3ffe2c0d HTTP/1.1" 200 None 2026-03-23 14:46:09,730 - lava_callback - ERROR - Error processing callback for node 69beaf29448e074b3ffe2c0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:46:49,647 - lava_callback - INFO - Received callback for node 69beaf4d448e074b3ffe2c18 INFO: 172.21.0.1:47744 - "POST /node/69beaf4d448e074b3ffe2c18 HTTP/1.0" 202 Accepted 2026-03-23 14:46:49,652 - lava_callback - INFO - Starting async job submit for node 69beaf4d448e074b3ffe2c18 2026-03-23 14:46:49,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:49,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf4d448e074b3ffe2c18 HTTP/1.1" 200 None 2026-03-23 14:46:49,668 - lava_callback - DEBUG - Processing node 69beaf4d448e074b3ffe2c18: baseline-arm-clabbe 2026-03-23 14:46:49,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beaf4d448e074b3ffe2c18 2026-03-23 14:46:49,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:49,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf4d448e074b3ffe2c18 HTTP/1.1" 200 None 2026-03-23 14:46:49,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:49,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:46:49,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:46:49,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beaf4d448e074b3ffe2c18 HTTP/1.1" 200 None 2026-03-23 14:46:49,731 - lava_callback - ERROR - Error processing callback for node 69beaf4d448e074b3ffe2c18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:47:29,727 - lava_callback - INFO - Received callback for node 69beaf72448e074b3ffe2c23 INFO: 172.21.0.1:56096 - "POST /node/69beaf72448e074b3ffe2c23 HTTP/1.0" 202 Accepted 2026-03-23 14:47:29,733 - lava_callback - INFO - Starting async job submit for node 69beaf72448e074b3ffe2c23 2026-03-23 14:47:29,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:47:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf72448e074b3ffe2c23 HTTP/1.1" 200 None 2026-03-23 14:47:29,748 - lava_callback - DEBUG - Processing node 69beaf72448e074b3ffe2c23: baseline-arm-clabbe 2026-03-23 14:47:29,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beaf72448e074b3ffe2c23 2026-03-23 14:47:29,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:47:29,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf72448e074b3ffe2c23 HTTP/1.1" 200 None 2026-03-23 14:47:29,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:47:29,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:47:29,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:47:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beaf72448e074b3ffe2c23 HTTP/1.1" 200 None 2026-03-23 14:47:29,807 - lava_callback - ERROR - Error processing callback for node 69beaf72448e074b3ffe2c23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:48:09,676 - lava_callback - INFO - Received callback for node 69beaf97448e074b3ffe2c33 INFO: 172.21.0.1:55502 - "POST /node/69beaf97448e074b3ffe2c33 HTTP/1.0" 202 Accepted 2026-03-23 14:48:09,682 - lava_callback - INFO - Starting async job submit for node 69beaf97448e074b3ffe2c33 2026-03-23 14:48:09,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:09,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf97448e074b3ffe2c33 HTTP/1.1" 200 None 2026-03-23 14:48:09,701 - lava_callback - DEBUG - Processing node 69beaf97448e074b3ffe2c33: baseline-arm-clabbe 2026-03-23 14:48:09,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beaf97448e074b3ffe2c33 2026-03-23 14:48:09,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:09,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beaf97448e074b3ffe2c33 HTTP/1.1" 200 None 2026-03-23 14:48:09,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:09,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:48:09,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:09,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beaf97448e074b3ffe2c33 HTTP/1.1" 200 None 2026-03-23 14:48:09,757 - lava_callback - ERROR - Error processing callback for node 69beaf97448e074b3ffe2c33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:48:49,804 - lava_callback - INFO - Received callback for node 69beafbc448e074b3ffe2c3c INFO: 172.21.0.1:33206 - "POST /node/69beafbc448e074b3ffe2c3c HTTP/1.0" 202 Accepted 2026-03-23 14:48:49,810 - lava_callback - INFO - Starting async job submit for node 69beafbc448e074b3ffe2c3c 2026-03-23 14:48:49,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:49,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beafbc448e074b3ffe2c3c HTTP/1.1" 200 None 2026-03-23 14:48:49,829 - lava_callback - DEBUG - Processing node 69beafbc448e074b3ffe2c3c: baseline-arm-clabbe 2026-03-23 14:48:49,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beafbc448e074b3ffe2c3c 2026-03-23 14:48:49,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:49,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beafbc448e074b3ffe2c3c HTTP/1.1" 200 None 2026-03-23 14:48:49,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:49,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 14:48:49,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:48:49,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beafbc448e074b3ffe2c3c HTTP/1.1" 200 None 2026-03-23 14:48:49,880 - lava_callback - ERROR - Error processing callback for node 69beafbc448e074b3ffe2c3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:49:20,849 - lava_callback - INFO - Received callback for node 69beafdd448e074b3ffe2c46 INFO: 172.21.0.1:52552 - "POST /node/69beafdd448e074b3ffe2c46 HTTP/1.0" 202 Accepted 2026-03-23 14:49:20,855 - lava_callback - INFO - Starting async job submit for node 69beafdd448e074b3ffe2c46 2026-03-23 14:49:20,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:20,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beafdd448e074b3ffe2c46 HTTP/1.1" 200 None 2026-03-23 14:49:20,871 - lava_callback - DEBUG - Processing node 69beafdd448e074b3ffe2c46: baseline-arm-baylibre 2026-03-23 14:49:20,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beafdd448e074b3ffe2c46 2026-03-23 14:49:20,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:20,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beafdd448e074b3ffe2c46 HTTP/1.1" 200 None 2026-03-23 14:49:20,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:20,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:49:20,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:20,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beafdd448e074b3ffe2c46 HTTP/1.1" 200 None 2026-03-23 14:49:20,932 - lava_callback - ERROR - Error processing callback for node 69beafdd448e074b3ffe2c46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:49:40,681 - lava_callback - INFO - Received callback for node 69beb001448e074b3ffe2c51 INFO: 172.21.0.1:37500 - "POST /node/69beb001448e074b3ffe2c51 HTTP/1.0" 202 Accepted 2026-03-23 14:49:40,686 - lava_callback - INFO - Starting async job submit for node 69beb001448e074b3ffe2c51 2026-03-23 14:49:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:40,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb001448e074b3ffe2c51 HTTP/1.1" 200 None 2026-03-23 14:49:40,703 - lava_callback - DEBUG - Processing node 69beb001448e074b3ffe2c51: baseline-arm-baylibre 2026-03-23 14:49:40,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb001448e074b3ffe2c51 2026-03-23 14:49:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:40,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb001448e074b3ffe2c51 HTTP/1.1" 200 None 2026-03-23 14:49:40,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:40,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:49:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:49:40,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb001448e074b3ffe2c51 HTTP/1.1" 200 None 2026-03-23 14:49:40,762 - lava_callback - ERROR - Error processing callback for node 69beb001448e074b3ffe2c51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:50:20,733 - lava_callback - INFO - Received callback for node 69beb023448e074b3ffe2c5c INFO: 172.21.0.1:38706 - "POST /node/69beb023448e074b3ffe2c5c HTTP/1.0" 202 Accepted 2026-03-23 14:50:20,738 - lava_callback - INFO - Starting async job submit for node 69beb023448e074b3ffe2c5c 2026-03-23 14:50:20,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:50:20,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb023448e074b3ffe2c5c HTTP/1.1" 200 None 2026-03-23 14:50:20,755 - lava_callback - DEBUG - Processing node 69beb023448e074b3ffe2c5c: baseline-arm-baylibre 2026-03-23 14:50:20,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb023448e074b3ffe2c5c 2026-03-23 14:50:20,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:50:20,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb023448e074b3ffe2c5c HTTP/1.1" 200 None 2026-03-23 14:50:20,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:50:20,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:50:20,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:50:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb023448e074b3ffe2c5c HTTP/1.1" 200 None 2026-03-23 14:50:20,810 - lava_callback - ERROR - Error processing callback for node 69beb023448e074b3ffe2c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:51:00,857 - lava_callback - INFO - Received callback for node 69beb047448e074b3ffe2c67 INFO: 172.21.0.1:49364 - "POST /node/69beb047448e074b3ffe2c67 HTTP/1.0" 202 Accepted 2026-03-23 14:51:00,863 - lava_callback - INFO - Starting async job submit for node 69beb047448e074b3ffe2c67 2026-03-23 14:51:00,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb047448e074b3ffe2c67 HTTP/1.1" 200 None 2026-03-23 14:51:00,878 - lava_callback - DEBUG - Processing node 69beb047448e074b3ffe2c67: baseline-arm-baylibre 2026-03-23 14:51:00,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb047448e074b3ffe2c67 2026-03-23 14:51:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:00,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb047448e074b3ffe2c67 HTTP/1.1" 200 None 2026-03-23 14:51:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:00,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:51:00,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:00,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb047448e074b3ffe2c67 HTTP/1.1" 200 None 2026-03-23 14:51:00,933 - lava_callback - ERROR - Error processing callback for node 69beb047448e074b3ffe2c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:51:40,785 - lava_callback - INFO - Received callback for node 69beb06a448e074b3ffe2c74 INFO: 172.21.0.1:45450 - "POST /node/69beb06a448e074b3ffe2c74 HTTP/1.0" 202 Accepted 2026-03-23 14:51:40,791 - lava_callback - INFO - Starting async job submit for node 69beb06a448e074b3ffe2c74 2026-03-23 14:51:40,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb06a448e074b3ffe2c74 HTTP/1.1" 200 None 2026-03-23 14:51:40,807 - lava_callback - DEBUG - Processing node 69beb06a448e074b3ffe2c74: baseline-arm-baylibre 2026-03-23 14:51:40,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb06a448e074b3ffe2c74 2026-03-23 14:51:40,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:40,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb06a448e074b3ffe2c74 HTTP/1.1" 200 None 2026-03-23 14:51:40,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:40,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:51:40,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:51:40,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb06a448e074b3ffe2c74 HTTP/1.1" 200 None 2026-03-23 14:51:40,884 - lava_callback - ERROR - Error processing callback for node 69beb06a448e074b3ffe2c74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:52:00,823 - lava_callback - INFO - Received callback for node 69beb08e448e074b3ffe2c81 INFO: 172.21.0.1:53016 - "POST /node/69beb08e448e074b3ffe2c81 HTTP/1.0" 202 Accepted 2026-03-23 14:52:00,828 - lava_callback - INFO - Starting async job submit for node 69beb08e448e074b3ffe2c81 2026-03-23 14:52:00,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:00,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb08e448e074b3ffe2c81 HTTP/1.1" 200 None 2026-03-23 14:52:00,844 - lava_callback - DEBUG - Processing node 69beb08e448e074b3ffe2c81: baseline-arm-baylibre 2026-03-23 14:52:00,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb08e448e074b3ffe2c81 2026-03-23 14:52:00,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:00,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb08e448e074b3ffe2c81 HTTP/1.1" 200 None 2026-03-23 14:52:00,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:00,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:52:00,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:00,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb08e448e074b3ffe2c81 HTTP/1.1" 200 None 2026-03-23 14:52:00,896 - lava_callback - ERROR - Error processing callback for node 69beb08e448e074b3ffe2c81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:52:41,033 - lava_callback - INFO - Received callback for node 69beb0b1448e074b3ffe2c8c INFO: 172.21.0.1:52374 - "POST /node/69beb0b1448e074b3ffe2c8c HTTP/1.0" 202 Accepted 2026-03-23 14:52:41,038 - lava_callback - INFO - Starting async job submit for node 69beb0b1448e074b3ffe2c8c 2026-03-23 14:52:41,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:41,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0b1448e074b3ffe2c8c HTTP/1.1" 200 None 2026-03-23 14:52:41,054 - lava_callback - DEBUG - Processing node 69beb0b1448e074b3ffe2c8c: baseline-arm-baylibre 2026-03-23 14:52:41,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb0b1448e074b3ffe2c8c 2026-03-23 14:52:41,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:41,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0b1448e074b3ffe2c8c HTTP/1.1" 200 None 2026-03-23 14:52:41,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:41,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:52:41,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:52:41,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb0b1448e074b3ffe2c8c HTTP/1.1" 200 None 2026-03-23 14:52:41,128 - lava_callback - ERROR - Error processing callback for node 69beb0b1448e074b3ffe2c8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:53:20,923 - lava_callback - INFO - Received callback for node 69beb0d6448e074b3ffe2c96 INFO: 172.21.0.1:33820 - "POST /node/69beb0d6448e074b3ffe2c96 HTTP/1.0" 202 Accepted 2026-03-23 14:53:20,928 - lava_callback - INFO - Starting async job submit for node 69beb0d6448e074b3ffe2c96 2026-03-23 14:53:20,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:53:20,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0d6448e074b3ffe2c96 HTTP/1.1" 200 None 2026-03-23 14:53:20,949 - lava_callback - DEBUG - Processing node 69beb0d6448e074b3ffe2c96: baseline-arm-baylibre 2026-03-23 14:53:20,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb0d6448e074b3ffe2c96 2026-03-23 14:53:20,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:53:20,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0d6448e074b3ffe2c96 HTTP/1.1" 200 None 2026-03-23 14:53:20,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:53:20,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:53:20,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:53:21,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb0d6448e074b3ffe2c96 HTTP/1.1" 200 None 2026-03-23 14:53:21,009 - lava_callback - ERROR - Error processing callback for node 69beb0d6448e074b3ffe2c96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:54:00,970 - lava_callback - INFO - Received callback for node 69beb0f8448e074b3ffe2ca1 INFO: 172.21.0.1:38904 - "POST /node/69beb0f8448e074b3ffe2ca1 HTTP/1.0" 202 Accepted 2026-03-23 14:54:00,976 - lava_callback - INFO - Starting async job submit for node 69beb0f8448e074b3ffe2ca1 2026-03-23 14:54:00,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:00,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0f8448e074b3ffe2ca1 HTTP/1.1" 200 None 2026-03-23 14:54:00,991 - lava_callback - DEBUG - Processing node 69beb0f8448e074b3ffe2ca1: baseline-arm-baylibre 2026-03-23 14:54:00,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb0f8448e074b3ffe2ca1 2026-03-23 14:54:00,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:01,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb0f8448e074b3ffe2ca1 HTTP/1.1" 200 None 2026-03-23 14:54:01,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:01,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:54:01,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:01,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb0f8448e074b3ffe2ca1 HTTP/1.1" 200 None 2026-03-23 14:54:01,053 - lava_callback - ERROR - Error processing callback for node 69beb0f8448e074b3ffe2ca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:54:41,077 - lava_callback - INFO - Received callback for node 69beb11d448e074b3ffe2cad INFO: 172.21.0.1:51058 - "POST /node/69beb11d448e074b3ffe2cad HTTP/1.0" 202 Accepted 2026-03-23 14:54:41,083 - lava_callback - INFO - Starting async job submit for node 69beb11d448e074b3ffe2cad 2026-03-23 14:54:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:41,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb11d448e074b3ffe2cad HTTP/1.1" 200 None 2026-03-23 14:54:41,099 - lava_callback - DEBUG - Processing node 69beb11d448e074b3ffe2cad: baseline-arm-baylibre 2026-03-23 14:54:41,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb11d448e074b3ffe2cad 2026-03-23 14:54:41,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:41,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb11d448e074b3ffe2cad HTTP/1.1" 200 None 2026-03-23 14:54:41,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:41,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:54:41,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:54:41,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb11d448e074b3ffe2cad HTTP/1.1" 200 None 2026-03-23 14:54:41,167 - lava_callback - ERROR - Error processing callback for node 69beb11d448e074b3ffe2cad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:55:01,025 - lava_callback - INFO - Received callback for node 69beb13f448e074b3ffe2cbc INFO: 172.21.0.1:38984 - "POST /node/69beb13f448e074b3ffe2cbc HTTP/1.0" 202 Accepted 2026-03-23 14:55:01,031 - lava_callback - INFO - Starting async job submit for node 69beb13f448e074b3ffe2cbc 2026-03-23 14:55:01,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:01,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb13f448e074b3ffe2cbc HTTP/1.1" 200 None 2026-03-23 14:55:01,048 - lava_callback - DEBUG - Processing node 69beb13f448e074b3ffe2cbc: baseline-arm-baylibre 2026-03-23 14:55:01,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb13f448e074b3ffe2cbc 2026-03-23 14:55:01,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:01,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb13f448e074b3ffe2cbc HTTP/1.1" 200 None 2026-03-23 14:55:01,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:01,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:55:01,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:01,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb13f448e074b3ffe2cbc HTTP/1.1" 200 None 2026-03-23 14:55:01,112 - lava_callback - ERROR - Error processing callback for node 69beb13f448e074b3ffe2cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:55:41,070 - lava_callback - INFO - Received callback for node 69beb163448e074b3ffe2cc9 INFO: 172.21.0.1:54036 - "POST /node/69beb163448e074b3ffe2cc9 HTTP/1.0" 202 Accepted 2026-03-23 14:55:41,076 - lava_callback - INFO - Starting async job submit for node 69beb163448e074b3ffe2cc9 2026-03-23 14:55:41,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:41,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb163448e074b3ffe2cc9 HTTP/1.1" 200 None 2026-03-23 14:55:41,093 - lava_callback - DEBUG - Processing node 69beb163448e074b3ffe2cc9: baseline-arm-baylibre 2026-03-23 14:55:41,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb163448e074b3ffe2cc9 2026-03-23 14:55:41,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:41,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb163448e074b3ffe2cc9 HTTP/1.1" 200 None 2026-03-23 14:55:41,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:41,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:55:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:55:41,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb163448e074b3ffe2cc9 HTTP/1.1" 200 None 2026-03-23 14:55:41,151 - lava_callback - ERROR - Error processing callback for node 69beb163448e074b3ffe2cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:56:30,090 - lava_callback - INFO - Received callback for node 69beb188448e074b3ffe2cd5 INFO: 172.21.0.1:48922 - "POST /node/69beb188448e074b3ffe2cd5 HTTP/1.0" 202 Accepted 2026-03-23 14:56:30,096 - lava_callback - INFO - Starting async job submit for node 69beb188448e074b3ffe2cd5 2026-03-23 14:56:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:30,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb188448e074b3ffe2cd5 HTTP/1.1" 200 None 2026-03-23 14:56:30,112 - lava_callback - DEBUG - Processing node 69beb188448e074b3ffe2cd5: baseline-arm-clabbe 2026-03-23 14:56:30,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb188448e074b3ffe2cd5 2026-03-23 14:56:30,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:30,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb188448e074b3ffe2cd5 HTTP/1.1" 200 None 2026-03-23 14:56:30,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:30,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:56:30,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:30,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb188448e074b3ffe2cd5 HTTP/1.1" 200 None 2026-03-23 14:56:30,166 - lava_callback - ERROR - Error processing callback for node 69beb188448e074b3ffe2cd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:56:50,147 - lava_callback - INFO - Received callback for node 69beb1ad448e074b3ffe2ce6 INFO: 172.21.0.1:36702 - "POST /node/69beb1ad448e074b3ffe2ce6 HTTP/1.0" 202 Accepted 2026-03-23 14:56:50,153 - lava_callback - INFO - Starting async job submit for node 69beb1ad448e074b3ffe2ce6 2026-03-23 14:56:50,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:50,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1ad448e074b3ffe2ce6 HTTP/1.1" 200 None 2026-03-23 14:56:50,169 - lava_callback - DEBUG - Processing node 69beb1ad448e074b3ffe2ce6: baseline-arm-clabbe 2026-03-23 14:56:50,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb1ad448e074b3ffe2ce6 2026-03-23 14:56:50,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1ad448e074b3ffe2ce6 HTTP/1.1" 200 None 2026-03-23 14:56:50,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:56:50,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:56:50,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb1ad448e074b3ffe2ce6 HTTP/1.1" 200 None 2026-03-23 14:56:50,236 - lava_callback - ERROR - Error processing callback for node 69beb1ad448e074b3ffe2ce6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:57:21,285 - lava_callback - INFO - Received callback for node 69beb1cf448e074b3ffe2cf0 INFO: 172.21.0.1:45892 - "POST /node/69beb1cf448e074b3ffe2cf0 HTTP/1.0" 202 Accepted 2026-03-23 14:57:21,291 - lava_callback - INFO - Starting async job submit for node 69beb1cf448e074b3ffe2cf0 2026-03-23 14:57:21,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:57:21,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1cf448e074b3ffe2cf0 HTTP/1.1" 200 None 2026-03-23 14:57:21,313 - lava_callback - DEBUG - Processing node 69beb1cf448e074b3ffe2cf0: baseline-arm-baylibre 2026-03-23 14:57:21,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb1cf448e074b3ffe2cf0 2026-03-23 14:57:21,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:57:21,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1cf448e074b3ffe2cf0 HTTP/1.1" 200 None 2026-03-23 14:57:21,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:57:21,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:57:21,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:57:21,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb1cf448e074b3ffe2cf0 HTTP/1.1" 200 None 2026-03-23 14:57:21,375 - lava_callback - ERROR - Error processing callback for node 69beb1cf448e074b3ffe2cf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:58:10,218 - lava_callback - INFO - Received callback for node 69beb1f4448e074b3ffe2d01 INFO: 172.21.0.1:52916 - "POST /node/69beb1f4448e074b3ffe2d01 HTTP/1.0" 202 Accepted 2026-03-23 14:58:10,224 - lava_callback - INFO - Starting async job submit for node 69beb1f4448e074b3ffe2d01 2026-03-23 14:58:10,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:10,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1f4448e074b3ffe2d01 HTTP/1.1" 200 None 2026-03-23 14:58:10,240 - lava_callback - DEBUG - Processing node 69beb1f4448e074b3ffe2d01: baseline-arm-clabbe 2026-03-23 14:58:10,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb1f4448e074b3ffe2d01 2026-03-23 14:58:10,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:10,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb1f4448e074b3ffe2d01 HTTP/1.1" 200 None 2026-03-23 14:58:10,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:10,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:58:10,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:10,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb1f4448e074b3ffe2d01 HTTP/1.1" 200 None 2026-03-23 14:58:10,307 - lava_callback - ERROR - Error processing callback for node 69beb1f4448e074b3ffe2d01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45290 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:58:50,230 - lava_callback - INFO - Received callback for node 69beb218448e074b3ffe2d0c INFO: 172.21.0.1:36560 - "POST /node/69beb218448e074b3ffe2d0c HTTP/1.0" 202 Accepted 2026-03-23 14:58:50,236 - lava_callback - INFO - Starting async job submit for node 69beb218448e074b3ffe2d0c 2026-03-23 14:58:50,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:50,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb218448e074b3ffe2d0c HTTP/1.1" 200 None 2026-03-23 14:58:50,252 - lava_callback - DEBUG - Processing node 69beb218448e074b3ffe2d0c: baseline-arm-clabbe 2026-03-23 14:58:50,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb218448e074b3ffe2d0c 2026-03-23 14:58:50,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:50,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb218448e074b3ffe2d0c HTTP/1.1" 200 None 2026-03-23 14:58:50,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:50,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:58:50,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:58:50,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb218448e074b3ffe2d0c HTTP/1.1" 200 None 2026-03-23 14:58:50,302 - lava_callback - ERROR - Error processing callback for node 69beb218448e074b3ffe2d0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:59:30,257 - lava_callback - INFO - Received callback for node 69beb23d448e074b3ffe2d17 INFO: 172.21.0.1:47264 - "POST /node/69beb23d448e074b3ffe2d17 HTTP/1.0" 202 Accepted 2026-03-23 14:59:30,263 - lava_callback - INFO - Starting async job submit for node 69beb23d448e074b3ffe2d17 2026-03-23 14:59:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:30,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb23d448e074b3ffe2d17 HTTP/1.1" 200 None 2026-03-23 14:59:30,278 - lava_callback - DEBUG - Processing node 69beb23d448e074b3ffe2d17: baseline-arm-clabbe 2026-03-23 14:59:30,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb23d448e074b3ffe2d17 2026-03-23 14:59:30,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb23d448e074b3ffe2d17 HTTP/1.1" 200 None 2026-03-23 14:59:30,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:30,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:59:30,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:30,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb23d448e074b3ffe2d17 HTTP/1.1" 200 None 2026-03-23 14:59:30,346 - lava_callback - ERROR - Error processing callback for node 69beb23d448e074b3ffe2d17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK 2026-03-23 14:59:50,300 - lava_callback - INFO - Received callback for node 69beb261448e074b3ffe2d28 INFO: 172.21.0.1:60180 - "POST /node/69beb261448e074b3ffe2d28 HTTP/1.0" 202 Accepted 2026-03-23 14:59:50,305 - lava_callback - INFO - Starting async job submit for node 69beb261448e074b3ffe2d28 2026-03-23 14:59:50,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:50,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb261448e074b3ffe2d28 HTTP/1.1" 200 None 2026-03-23 14:59:50,321 - lava_callback - DEBUG - Processing node 69beb261448e074b3ffe2d28: baseline-arm-clabbe 2026-03-23 14:59:50,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb261448e074b3ffe2d28 2026-03-23 14:59:50,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:50,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb261448e074b3ffe2d28 HTTP/1.1" 200 None 2026-03-23 14:59:50,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:50,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 14:59:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 14:59:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb261448e074b3ffe2d28 HTTP/1.1" 200 None 2026-03-23 14:59:50,399 - lava_callback - ERROR - Error processing callback for node 69beb261448e074b3ffe2d28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:00:30,348 - lava_callback - INFO - Received callback for node 69beb285448e074b3ffe2d35 INFO: 172.21.0.1:36722 - "POST /node/69beb285448e074b3ffe2d35 HTTP/1.0" 202 Accepted 2026-03-23 15:00:30,354 - lava_callback - INFO - Starting async job submit for node 69beb285448e074b3ffe2d35 2026-03-23 15:00:30,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:00:30,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb285448e074b3ffe2d35 HTTP/1.1" 200 None 2026-03-23 15:00:30,373 - lava_callback - DEBUG - Processing node 69beb285448e074b3ffe2d35: baseline-arm-clabbe 2026-03-23 15:00:30,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb285448e074b3ffe2d35 2026-03-23 15:00:30,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:00:30,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb285448e074b3ffe2d35 HTTP/1.1" 200 None 2026-03-23 15:00:30,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:00:30,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:00:30,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:00:30,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb285448e074b3ffe2d35 HTTP/1.1" 200 None 2026-03-23 15:00:30,427 - lava_callback - ERROR - Error processing callback for node 69beb285448e074b3ffe2d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:01:01,527 - lava_callback - INFO - Received callback for node 69beb2a6448e074b3ffe2d41 INFO: 172.21.0.1:50276 - "POST /node/69beb2a6448e074b3ffe2d41 HTTP/1.0" 202 Accepted 2026-03-23 15:01:01,533 - lava_callback - INFO - Starting async job submit for node 69beb2a6448e074b3ffe2d41 2026-03-23 15:01:01,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:01,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2a6448e074b3ffe2d41 HTTP/1.1" 200 None 2026-03-23 15:01:01,551 - lava_callback - DEBUG - Processing node 69beb2a6448e074b3ffe2d41: baseline-arm-baylibre 2026-03-23 15:01:01,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb2a6448e074b3ffe2d41 2026-03-23 15:01:01,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:01,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2a6448e074b3ffe2d41 HTTP/1.1" 200 None 2026-03-23 15:01:01,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:01,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:01:01,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:01,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb2a6448e074b3ffe2d41 HTTP/1.1" 200 None 2026-03-23 15:01:01,632 - lava_callback - ERROR - Error processing callback for node 69beb2a6448e074b3ffe2d41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:01:50,388 - lava_callback - INFO - Received callback for node 69beb2cd448e074b3ffe2d50 INFO: 172.21.0.1:35478 - "POST /node/69beb2cd448e074b3ffe2d50 HTTP/1.0" 202 Accepted 2026-03-23 15:01:50,393 - lava_callback - INFO - Starting async job submit for node 69beb2cd448e074b3ffe2d50 2026-03-23 15:01:50,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:50,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2cd448e074b3ffe2d50 HTTP/1.1" 200 None 2026-03-23 15:01:50,422 - lava_callback - DEBUG - Processing node 69beb2cd448e074b3ffe2d50: baseline-arm-clabbe 2026-03-23 15:01:50,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb2cd448e074b3ffe2d50 2026-03-23 15:01:50,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:50,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2cd448e074b3ffe2d50 HTTP/1.1" 200 None 2026-03-23 15:01:50,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:50,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:01:50,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:01:50,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb2cd448e074b3ffe2d50 HTTP/1.1" 200 None 2026-03-23 15:01:50,481 - lava_callback - ERROR - Error processing callback for node 69beb2cd448e074b3ffe2d50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:02:21,540 - lava_callback - INFO - Received callback for node 69beb2ec448e074b3ffe2d5b INFO: 172.21.0.1:54160 - "POST /node/69beb2ec448e074b3ffe2d5b HTTP/1.0" 202 Accepted 2026-03-23 15:02:21,546 - lava_callback - INFO - Starting async job submit for node 69beb2ec448e074b3ffe2d5b 2026-03-23 15:02:21,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:02:21,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2ec448e074b3ffe2d5b HTTP/1.1" 200 None 2026-03-23 15:02:21,562 - lava_callback - DEBUG - Processing node 69beb2ec448e074b3ffe2d5b: baseline-arm-baylibre 2026-03-23 15:02:21,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb2ec448e074b3ffe2d5b 2026-03-23 15:02:21,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:02:21,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb2ec448e074b3ffe2d5b HTTP/1.1" 200 None 2026-03-23 15:02:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:02:21,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:02:21,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:02:21,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb2ec448e074b3ffe2d5b HTTP/1.1" 200 None 2026-03-23 15:02:21,630 - lava_callback - ERROR - Error processing callback for node 69beb2ec448e074b3ffe2d5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:03:01,452 - lava_callback - INFO - Received callback for node 69beb310448e074b3ffe2d66 INFO: 172.21.0.1:45678 - "POST /node/69beb310448e074b3ffe2d66 HTTP/1.0" 202 Accepted 2026-03-23 15:03:01,457 - lava_callback - INFO - Starting async job submit for node 69beb310448e074b3ffe2d66 2026-03-23 15:03:01,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:01,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb310448e074b3ffe2d66 HTTP/1.1" 200 None 2026-03-23 15:03:01,476 - lava_callback - DEBUG - Processing node 69beb310448e074b3ffe2d66: baseline-arm-baylibre 2026-03-23 15:03:01,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb310448e074b3ffe2d66 2026-03-23 15:03:01,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:01,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb310448e074b3ffe2d66 HTTP/1.1" 200 None 2026-03-23 15:03:01,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:01,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:03:01,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:01,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb310448e074b3ffe2d66 HTTP/1.1" 200 None 2026-03-23 15:03:01,534 - lava_callback - ERROR - Error processing callback for node 69beb310448e074b3ffe2d66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:03:21,490 - lava_callback - INFO - Received callback for node 69beb332448e074b3ffe2d73 INFO: 172.21.0.1:44982 - "POST /node/69beb332448e074b3ffe2d73 HTTP/1.0" 202 Accepted 2026-03-23 15:03:21,496 - lava_callback - INFO - Starting async job submit for node 69beb332448e074b3ffe2d73 2026-03-23 15:03:21,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:21,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb332448e074b3ffe2d73 HTTP/1.1" 200 None 2026-03-23 15:03:21,518 - lava_callback - DEBUG - Processing node 69beb332448e074b3ffe2d73: baseline-arm-baylibre 2026-03-23 15:03:21,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb332448e074b3ffe2d73 2026-03-23 15:03:21,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:21,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb332448e074b3ffe2d73 HTTP/1.1" 200 None 2026-03-23 15:03:21,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:21,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:03:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:03:21,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb332448e074b3ffe2d73 HTTP/1.1" 200 None 2026-03-23 15:03:21,571 - lava_callback - ERROR - Error processing callback for node 69beb332448e074b3ffe2d73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:04:01,569 - lava_callback - INFO - Received callback for node 69beb356448e074b3ffe2d7d INFO: 172.21.0.1:43898 - "POST /node/69beb356448e074b3ffe2d7d HTTP/1.0" 202 Accepted 2026-03-23 15:04:01,575 - lava_callback - INFO - Starting async job submit for node 69beb356448e074b3ffe2d7d 2026-03-23 15:04:01,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:01,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb356448e074b3ffe2d7d HTTP/1.1" 200 None 2026-03-23 15:04:01,595 - lava_callback - DEBUG - Processing node 69beb356448e074b3ffe2d7d: baseline-arm-baylibre 2026-03-23 15:04:01,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb356448e074b3ffe2d7d 2026-03-23 15:04:01,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:01,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb356448e074b3ffe2d7d HTTP/1.1" 200 None 2026-03-23 15:04:01,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:01,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:04:01,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:01,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb356448e074b3ffe2d7d HTTP/1.1" 200 None 2026-03-23 15:04:01,651 - lava_callback - ERROR - Error processing callback for node 69beb356448e074b3ffe2d7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:04:41,540 - lava_callback - INFO - Received callback for node 69beb37a448e074b3ffe2d8e INFO: 172.21.0.1:46184 - "POST /node/69beb37a448e074b3ffe2d8e HTTP/1.0" 202 Accepted 2026-03-23 15:04:41,545 - lava_callback - INFO - Starting async job submit for node 69beb37a448e074b3ffe2d8e 2026-03-23 15:04:41,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:41,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb37a448e074b3ffe2d8e HTTP/1.1" 200 None 2026-03-23 15:04:41,562 - lava_callback - DEBUG - Processing node 69beb37a448e074b3ffe2d8e: baseline-arm-baylibre 2026-03-23 15:04:41,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb37a448e074b3ffe2d8e 2026-03-23 15:04:41,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:41,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb37a448e074b3ffe2d8e HTTP/1.1" 200 None 2026-03-23 15:04:41,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:41,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:04:41,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:04:41,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb37a448e074b3ffe2d8e HTTP/1.1" 200 None 2026-03-23 15:04:41,625 - lava_callback - ERROR - Error processing callback for node 69beb37a448e074b3ffe2d8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:05:01,550 - lava_callback - INFO - Received callback for node 69beb39b448e074b3ffe2d9d INFO: 172.21.0.1:54304 - "POST /node/69beb39b448e074b3ffe2d9d HTTP/1.0" 202 Accepted 2026-03-23 15:05:01,556 - lava_callback - INFO - Starting async job submit for node 69beb39b448e074b3ffe2d9d 2026-03-23 15:05:01,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:01,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb39b448e074b3ffe2d9d HTTP/1.1" 200 None 2026-03-23 15:05:01,573 - lava_callback - DEBUG - Processing node 69beb39b448e074b3ffe2d9d: baseline-arm-baylibre 2026-03-23 15:05:01,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb39b448e074b3ffe2d9d 2026-03-23 15:05:01,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:01,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb39b448e074b3ffe2d9d HTTP/1.1" 200 None 2026-03-23 15:05:01,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:01,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:05:01,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:01,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb39b448e074b3ffe2d9d HTTP/1.1" 200 None 2026-03-23 15:05:01,638 - lava_callback - ERROR - Error processing callback for node 69beb39b448e074b3ffe2d9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:05:41,754 - lava_callback - INFO - Received callback for node 69beb3bf448e074b3ffe2da9 INFO: 172.21.0.1:55408 - "POST /node/69beb3bf448e074b3ffe2da9 HTTP/1.0" 202 Accepted 2026-03-23 15:05:41,759 - lava_callback - INFO - Starting async job submit for node 69beb3bf448e074b3ffe2da9 2026-03-23 15:05:41,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:41,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb3bf448e074b3ffe2da9 HTTP/1.1" 200 None 2026-03-23 15:05:41,775 - lava_callback - DEBUG - Processing node 69beb3bf448e074b3ffe2da9: baseline-arm-baylibre 2026-03-23 15:05:41,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb3bf448e074b3ffe2da9 2026-03-23 15:05:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:41,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb3bf448e074b3ffe2da9 HTTP/1.1" 200 None 2026-03-23 15:05:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:41,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:05:41,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:05:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb3bf448e074b3ffe2da9 HTTP/1.1" 200 None 2026-03-23 15:05:41,845 - lava_callback - ERROR - Error processing callback for node 69beb3bf448e074b3ffe2da9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:06:30,574 - lava_callback - INFO - Received callback for node 69beb3e6448e074b3ffe2db4 INFO: 172.21.0.1:58742 - "POST /node/69beb3e6448e074b3ffe2db4 HTTP/1.0" 202 Accepted 2026-03-23 15:06:30,580 - lava_callback - INFO - Starting async job submit for node 69beb3e6448e074b3ffe2db4 2026-03-23 15:06:30,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:06:30,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb3e6448e074b3ffe2db4 HTTP/1.1" 200 None 2026-03-23 15:06:30,601 - lava_callback - DEBUG - Processing node 69beb3e6448e074b3ffe2db4: baseline-arm-clabbe 2026-03-23 15:06:30,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb3e6448e074b3ffe2db4 2026-03-23 15:06:30,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:06:30,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb3e6448e074b3ffe2db4 HTTP/1.1" 200 None 2026-03-23 15:06:30,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:06:30,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:06:30,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:06:30,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb3e6448e074b3ffe2db4 HTTP/1.1" 200 None 2026-03-23 15:06:30,662 - lava_callback - ERROR - Error processing callback for node 69beb3e6448e074b3ffe2db4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:07:01,762 - lava_callback - INFO - Received callback for node 69beb408448e074b3ffe2dc0 INFO: 172.21.0.1:44700 - "POST /node/69beb408448e074b3ffe2dc0 HTTP/1.0" 202 Accepted 2026-03-23 15:07:01,768 - lava_callback - INFO - Starting async job submit for node 69beb408448e074b3ffe2dc0 2026-03-23 15:07:01,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:01,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb408448e074b3ffe2dc0 HTTP/1.1" 200 None 2026-03-23 15:07:01,784 - lava_callback - DEBUG - Processing node 69beb408448e074b3ffe2dc0: baseline-arm-baylibre 2026-03-23 15:07:01,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb408448e074b3ffe2dc0 2026-03-23 15:07:01,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:01,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb408448e074b3ffe2dc0 HTTP/1.1" 200 None 2026-03-23 15:07:01,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:01,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:07:01,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:01,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb408448e074b3ffe2dc0 HTTP/1.1" 200 None 2026-03-23 15:07:01,841 - lava_callback - ERROR - Error processing callback for node 69beb408448e074b3ffe2dc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:07:41,743 - lava_callback - INFO - Received callback for node 69beb42a448e074b3ffe2dce INFO: 172.21.0.1:41678 - "POST /node/69beb42a448e074b3ffe2dce HTTP/1.0" 202 Accepted 2026-03-23 15:07:41,749 - lava_callback - INFO - Starting async job submit for node 69beb42a448e074b3ffe2dce 2026-03-23 15:07:41,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb42a448e074b3ffe2dce HTTP/1.1" 200 None 2026-03-23 15:07:41,765 - lava_callback - DEBUG - Processing node 69beb42a448e074b3ffe2dce: baseline-arm-baylibre 2026-03-23 15:07:41,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb42a448e074b3ffe2dce 2026-03-23 15:07:41,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:41,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb42a448e074b3ffe2dce HTTP/1.1" 200 None 2026-03-23 15:07:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:41,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:07:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:07:41,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb42a448e074b3ffe2dce HTTP/1.1" 200 None 2026-03-23 15:07:41,830 - lava_callback - ERROR - Error processing callback for node 69beb42a448e074b3ffe2dce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:08:10,636 - lava_callback - INFO - Received callback for node 69beb450448e074b3ffe2ddb INFO: 172.21.0.1:50684 - "POST /node/69beb450448e074b3ffe2ddb HTTP/1.0" 202 Accepted 2026-03-23 15:08:10,642 - lava_callback - INFO - Starting async job submit for node 69beb450448e074b3ffe2ddb 2026-03-23 15:08:10,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:10,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb450448e074b3ffe2ddb HTTP/1.1" 200 None 2026-03-23 15:08:10,688 - lava_callback - DEBUG - Processing node 69beb450448e074b3ffe2ddb: baseline-arm-clabbe 2026-03-23 15:08:10,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb450448e074b3ffe2ddb 2026-03-23 15:08:10,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:10,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb450448e074b3ffe2ddb HTTP/1.1" 200 None 2026-03-23 15:08:10,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:10,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:08:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:10,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb450448e074b3ffe2ddb HTTP/1.1" 200 None 2026-03-23 15:08:10,744 - lava_callback - ERROR - Error processing callback for node 69beb450448e074b3ffe2ddb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:08:50,608 - lava_callback - INFO - Received callback for node 69beb474448e074b3ffe2dea INFO: 172.21.0.1:37206 - "POST /node/69beb474448e074b3ffe2dea HTTP/1.0" 202 Accepted 2026-03-23 15:08:50,613 - lava_callback - INFO - Starting async job submit for node 69beb474448e074b3ffe2dea 2026-03-23 15:08:50,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:50,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb474448e074b3ffe2dea HTTP/1.1" 200 None 2026-03-23 15:08:50,629 - lava_callback - DEBUG - Processing node 69beb474448e074b3ffe2dea: baseline-arm-clabbe 2026-03-23 15:08:50,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb474448e074b3ffe2dea 2026-03-23 15:08:50,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:50,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb474448e074b3ffe2dea HTTP/1.1" 200 None 2026-03-23 15:08:50,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:50,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:08:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:08:50,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb474448e074b3ffe2dea HTTP/1.1" 200 None 2026-03-23 15:08:50,696 - lava_callback - ERROR - Error processing callback for node 69beb474448e074b3ffe2dea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:09:21,978 - lava_callback - INFO - Received callback for node 69beb498448e074b3ffe2df9 INFO: 172.21.0.1:47168 - "POST /node/69beb498448e074b3ffe2df9 HTTP/1.0" 202 Accepted 2026-03-23 15:09:21,985 - lava_callback - INFO - Starting async job submit for node 69beb498448e074b3ffe2df9 2026-03-23 15:09:21,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:09:22,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb498448e074b3ffe2df9 HTTP/1.1" 200 None 2026-03-23 15:09:22,015 - lava_callback - DEBUG - Processing node 69beb498448e074b3ffe2df9: baseline-arm-baylibre 2026-03-23 15:09:22,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb498448e074b3ffe2df9 2026-03-23 15:09:22,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:09:22,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb498448e074b3ffe2df9 HTTP/1.1" 200 None 2026-03-23 15:09:22,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:09:22,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:09:22,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:09:22,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb498448e074b3ffe2df9 HTTP/1.1" 200 None 2026-03-23 15:09:22,074 - lava_callback - ERROR - Error processing callback for node 69beb498448e074b3ffe2df9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:10:10,780 - lava_callback - INFO - Received callback for node 69beb4bd448e074b3ffe2e09 INFO: 172.21.0.1:41452 - "POST /node/69beb4bd448e074b3ffe2e09 HTTP/1.0" 202 Accepted 2026-03-23 15:10:10,787 - lava_callback - INFO - Starting async job submit for node 69beb4bd448e074b3ffe2e09 2026-03-23 15:10:10,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:10,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb4bd448e074b3ffe2e09 HTTP/1.1" 200 None 2026-03-23 15:10:10,808 - lava_callback - DEBUG - Processing node 69beb4bd448e074b3ffe2e09: baseline-arm-clabbe 2026-03-23 15:10:10,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb4bd448e074b3ffe2e09 2026-03-23 15:10:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:10,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb4bd448e074b3ffe2e09 HTTP/1.1" 200 None 2026-03-23 15:10:10,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:10,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:10:10,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:10,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb4bd448e074b3ffe2e09 HTTP/1.1" 200 None 2026-03-23 15:10:10,879 - lava_callback - ERROR - Error processing callback for node 69beb4bd448e074b3ffe2e09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:10:30,702 - lava_callback - INFO - Received callback for node 69beb4e2448e074b3ffe2e1b INFO: 172.21.0.1:40112 - "POST /node/69beb4e2448e074b3ffe2e1b HTTP/1.0" 202 Accepted 2026-03-23 15:10:30,708 - lava_callback - INFO - Starting async job submit for node 69beb4e2448e074b3ffe2e1b 2026-03-23 15:10:30,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:30,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb4e2448e074b3ffe2e1b HTTP/1.1" 200 None 2026-03-23 15:10:30,736 - lava_callback - DEBUG - Processing node 69beb4e2448e074b3ffe2e1b: baseline-arm-clabbe 2026-03-23 15:10:30,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb4e2448e074b3ffe2e1b 2026-03-23 15:10:30,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:30,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb4e2448e074b3ffe2e1b HTTP/1.1" 200 None 2026-03-23 15:10:30,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:30,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:10:30,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:10:30,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb4e2448e074b3ffe2e1b HTTP/1.1" 200 None 2026-03-23 15:10:30,792 - lava_callback - ERROR - Error processing callback for node 69beb4e2448e074b3ffe2e1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:11:10,791 - lava_callback - INFO - Received callback for node 69beb507448e074b3ffe2e28 INFO: 172.21.0.1:56608 - "POST /node/69beb507448e074b3ffe2e28 HTTP/1.0" 202 Accepted 2026-03-23 15:11:10,797 - lava_callback - INFO - Starting async job submit for node 69beb507448e074b3ffe2e28 2026-03-23 15:11:10,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb507448e074b3ffe2e28 HTTP/1.1" 200 None 2026-03-23 15:11:10,824 - lava_callback - DEBUG - Processing node 69beb507448e074b3ffe2e28: baseline-arm-clabbe 2026-03-23 15:11:10,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb507448e074b3ffe2e28 2026-03-23 15:11:10,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:10,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb507448e074b3ffe2e28 HTTP/1.1" 200 None 2026-03-23 15:11:10,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:10,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:11:10,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:10,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb507448e074b3ffe2e28 HTTP/1.1" 200 None 2026-03-23 15:11:10,926 - lava_callback - ERROR - Error processing callback for node 69beb507448e074b3ffe2e28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:11:50,745 - lava_callback - INFO - Received callback for node 69beb52b448e074b3ffe2e36 INFO: 172.21.0.1:59686 - "POST /node/69beb52b448e074b3ffe2e36 HTTP/1.0" 202 Accepted 2026-03-23 15:11:50,751 - lava_callback - INFO - Starting async job submit for node 69beb52b448e074b3ffe2e36 2026-03-23 15:11:50,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:50,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb52b448e074b3ffe2e36 HTTP/1.1" 200 None 2026-03-23 15:11:50,768 - lava_callback - DEBUG - Processing node 69beb52b448e074b3ffe2e36: baseline-arm-clabbe 2026-03-23 15:11:50,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb52b448e074b3ffe2e36 2026-03-23 15:11:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:50,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb52b448e074b3ffe2e36 HTTP/1.1" 200 None 2026-03-23 15:11:50,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:50,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:11:50,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:11:50,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb52b448e074b3ffe2e36 HTTP/1.1" 200 None 2026-03-23 15:11:50,849 - lava_callback - ERROR - Error processing callback for node 69beb52b448e074b3ffe2e36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:12:30,930 - lava_callback - INFO - Received callback for node 69beb550448e074b3ffe2e44 INFO: 172.21.0.1:48150 - "POST /node/69beb550448e074b3ffe2e44 HTTP/1.0" 202 Accepted 2026-03-23 15:12:30,936 - lava_callback - INFO - Starting async job submit for node 69beb550448e074b3ffe2e44 2026-03-23 15:12:30,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:12:30,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb550448e074b3ffe2e44 HTTP/1.1" 200 None 2026-03-23 15:12:30,951 - lava_callback - DEBUG - Processing node 69beb550448e074b3ffe2e44: baseline-arm-clabbe 2026-03-23 15:12:30,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb550448e074b3ffe2e44 2026-03-23 15:12:30,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:12:30,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb550448e074b3ffe2e44 HTTP/1.1" 200 None 2026-03-23 15:12:30,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:12:30,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:12:30,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:12:31,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb550448e074b3ffe2e44 HTTP/1.1" 200 None 2026-03-23 15:12:31,024 - lava_callback - ERROR - Error processing callback for node 69beb550448e074b3ffe2e44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:13:10,847 - lava_callback - INFO - Received callback for node 69beb574448e074b3ffe2e5c INFO: 172.21.0.1:38216 - "POST /node/69beb574448e074b3ffe2e5c HTTP/1.0" 202 Accepted 2026-03-23 15:13:10,852 - lava_callback - INFO - Starting async job submit for node 69beb574448e074b3ffe2e5c 2026-03-23 15:13:10,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb574448e074b3ffe2e5c HTTP/1.1" 200 None 2026-03-23 15:13:10,868 - lava_callback - DEBUG - Processing node 69beb574448e074b3ffe2e5c: baseline-arm-clabbe 2026-03-23 15:13:10,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb574448e074b3ffe2e5c 2026-03-23 15:13:10,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:10,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb574448e074b3ffe2e5c HTTP/1.1" 200 None 2026-03-23 15:13:10,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:10,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:13:10,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:10,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb574448e074b3ffe2e5c HTTP/1.1" 200 None 2026-03-23 15:13:10,928 - lava_callback - ERROR - Error processing callback for node 69beb574448e074b3ffe2e5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:13:50,859 - lava_callback - INFO - Received callback for node 69beb599448e074b3ffe2e67 INFO: 172.21.0.1:53624 - "POST /node/69beb599448e074b3ffe2e67 HTTP/1.0" 202 Accepted 2026-03-23 15:13:50,864 - lava_callback - INFO - Starting async job submit for node 69beb599448e074b3ffe2e67 2026-03-23 15:13:50,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:50,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb599448e074b3ffe2e67 HTTP/1.1" 200 None 2026-03-23 15:13:50,889 - lava_callback - DEBUG - Processing node 69beb599448e074b3ffe2e67: baseline-arm-clabbe 2026-03-23 15:13:50,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb599448e074b3ffe2e67 2026-03-23 15:13:50,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:50,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb599448e074b3ffe2e67 HTTP/1.1" 200 None 2026-03-23 15:13:50,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:13:50,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:13:50,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb599448e074b3ffe2e67 HTTP/1.1" 200 None 2026-03-23 15:13:50,945 - lava_callback - ERROR - Error processing callback for node 69beb599448e074b3ffe2e67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:14:10,881 - lava_callback - INFO - Received callback for node 69beb5bd448e074b3ffe2e76 INFO: 172.21.0.1:45458 - "POST /node/69beb5bd448e074b3ffe2e76 HTTP/1.0" 202 Accepted 2026-03-23 15:14:10,886 - lava_callback - INFO - Starting async job submit for node 69beb5bd448e074b3ffe2e76 2026-03-23 15:14:10,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:10,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb5bd448e074b3ffe2e76 HTTP/1.1" 200 None 2026-03-23 15:14:10,902 - lava_callback - DEBUG - Processing node 69beb5bd448e074b3ffe2e76: baseline-arm-clabbe 2026-03-23 15:14:10,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb5bd448e074b3ffe2e76 2026-03-23 15:14:10,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:10,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb5bd448e074b3ffe2e76 HTTP/1.1" 200 None 2026-03-23 15:14:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:10,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:14:10,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:10,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb5bd448e074b3ffe2e76 HTTP/1.1" 200 None 2026-03-23 15:14:10,968 - lava_callback - ERROR - Error processing callback for node 69beb5bd448e074b3ffe2e76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:14:50,939 - lava_callback - INFO - Received callback for node 69beb5e1448e074b3ffe2e86 INFO: 172.21.0.1:47254 - "POST /node/69beb5e1448e074b3ffe2e86 HTTP/1.0" 202 Accepted 2026-03-23 15:14:50,945 - lava_callback - INFO - Starting async job submit for node 69beb5e1448e074b3ffe2e86 2026-03-23 15:14:50,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:50,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb5e1448e074b3ffe2e86 HTTP/1.1" 200 None 2026-03-23 15:14:50,984 - lava_callback - DEBUG - Processing node 69beb5e1448e074b3ffe2e86: baseline-arm-clabbe 2026-03-23 15:14:50,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb5e1448e074b3ffe2e86 2026-03-23 15:14:50,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:50,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb5e1448e074b3ffe2e86 HTTP/1.1" 200 None 2026-03-23 15:14:50,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:51,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 15:14:51,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:14:51,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb5e1448e074b3ffe2e86 HTTP/1.1" 200 None 2026-03-23 15:14:51,075 - lava_callback - ERROR - Error processing callback for node 69beb5e1448e074b3ffe2e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:15:30,997 - lava_callback - INFO - Received callback for node 69beb605448e074b3ffe2e97 INFO: 172.21.0.1:45464 - "POST /node/69beb605448e074b3ffe2e97 HTTP/1.0" 202 Accepted 2026-03-23 15:15:31,004 - lava_callback - INFO - Starting async job submit for node 69beb605448e074b3ffe2e97 2026-03-23 15:15:31,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:15:31,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb605448e074b3ffe2e97 HTTP/1.1" 200 None 2026-03-23 15:15:31,034 - lava_callback - DEBUG - Processing node 69beb605448e074b3ffe2e97: baseline-arm-clabbe 2026-03-23 15:15:31,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb605448e074b3ffe2e97 2026-03-23 15:15:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:15:31,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb605448e074b3ffe2e97 HTTP/1.1" 200 None 2026-03-23 15:15:31,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:15:31,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:15:31,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:15:31,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb605448e074b3ffe2e97 HTTP/1.1" 200 None 2026-03-23 15:15:31,104 - lava_callback - ERROR - Error processing callback for node 69beb605448e074b3ffe2e97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:16:11,037 - lava_callback - INFO - Received callback for node 69beb629448e074b3ffe2ead INFO: 172.21.0.1:57016 - "POST /node/69beb629448e074b3ffe2ead HTTP/1.0" 202 Accepted 2026-03-23 15:16:11,042 - lava_callback - INFO - Starting async job submit for node 69beb629448e074b3ffe2ead 2026-03-23 15:16:11,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:11,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb629448e074b3ffe2ead HTTP/1.1" 200 None 2026-03-23 15:16:11,057 - lava_callback - DEBUG - Processing node 69beb629448e074b3ffe2ead: baseline-arm-clabbe 2026-03-23 15:16:11,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb629448e074b3ffe2ead 2026-03-23 15:16:11,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:11,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb629448e074b3ffe2ead HTTP/1.1" 200 None 2026-03-23 15:16:11,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:11,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:16:11,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:11,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb629448e074b3ffe2ead HTTP/1.1" 200 None 2026-03-23 15:16:11,115 - lava_callback - ERROR - Error processing callback for node 69beb629448e074b3ffe2ead: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:16:51,011 - lava_callback - INFO - Received callback for node 69beb64e448e074b3ffe2eb8 INFO: 172.21.0.1:41978 - "POST /node/69beb64e448e074b3ffe2eb8 HTTP/1.0" 202 Accepted 2026-03-23 15:16:51,016 - lava_callback - INFO - Starting async job submit for node 69beb64e448e074b3ffe2eb8 2026-03-23 15:16:51,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:51,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb64e448e074b3ffe2eb8 HTTP/1.1" 200 None 2026-03-23 15:16:51,032 - lava_callback - DEBUG - Processing node 69beb64e448e074b3ffe2eb8: baseline-arm-clabbe 2026-03-23 15:16:51,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb64e448e074b3ffe2eb8 2026-03-23 15:16:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:51,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb64e448e074b3ffe2eb8 HTTP/1.1" 200 None 2026-03-23 15:16:51,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:51,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:16:51,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:16:51,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb64e448e074b3ffe2eb8 HTTP/1.1" 200 None 2026-03-23 15:16:51,091 - lava_callback - ERROR - Error processing callback for node 69beb64e448e074b3ffe2eb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:18:31,108 - lava_callback - INFO - Received callback for node 69beb6b0448e074b3ffe2ed7 INFO: 172.21.0.1:52670 - "POST /node/69beb6b0448e074b3ffe2ed7 HTTP/1.0" 202 Accepted 2026-03-23 15:18:31,113 - lava_callback - INFO - Starting async job submit for node 69beb6b0448e074b3ffe2ed7 2026-03-23 15:18:31,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:31,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb6b0448e074b3ffe2ed7 HTTP/1.1" 200 None 2026-03-23 15:18:31,129 - lava_callback - DEBUG - Processing node 69beb6b0448e074b3ffe2ed7: baseline-arm-clabbe 2026-03-23 15:18:31,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb6b0448e074b3ffe2ed7 2026-03-23 15:18:31,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:31,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb6b0448e074b3ffe2ed7 HTTP/1.1" 200 None 2026-03-23 15:18:31,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:31,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:18:31,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:31,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb6b0448e074b3ffe2ed7 HTTP/1.1" 200 None 2026-03-23 15:18:31,195 - lava_callback - ERROR - Error processing callback for node 69beb6b0448e074b3ffe2ed7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:18:51,068 - lava_callback - INFO - Received callback for node 69beb6d6448e074b3ffe2ee8 INFO: 172.21.0.1:50374 - "POST /node/69beb6d6448e074b3ffe2ee8 HTTP/1.0" 202 Accepted 2026-03-23 15:18:51,074 - lava_callback - INFO - Starting async job submit for node 69beb6d6448e074b3ffe2ee8 2026-03-23 15:18:51,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:51,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb6d6448e074b3ffe2ee8 HTTP/1.1" 200 None 2026-03-23 15:18:51,092 - lava_callback - DEBUG - Processing node 69beb6d6448e074b3ffe2ee8: baseline-arm-clabbe 2026-03-23 15:18:51,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb6d6448e074b3ffe2ee8 2026-03-23 15:18:51,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:51,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb6d6448e074b3ffe2ee8 HTTP/1.1" 200 None 2026-03-23 15:18:51,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:51,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-23 15:18:51,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:18:51,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb6d6448e074b3ffe2ee8 HTTP/1.1" 200 None 2026-03-23 15:18:51,160 - lava_callback - ERROR - Error processing callback for node 69beb6d6448e074b3ffe2ee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:19:42,602 - lava_callback - INFO - Received callback for node 69beb700448e074b3ffe2ef8 INFO: 172.21.0.1:33732 - "POST /node/69beb700448e074b3ffe2ef8 HTTP/1.0" 202 Accepted 2026-03-23 15:19:42,608 - lava_callback - INFO - Starting async job submit for node 69beb700448e074b3ffe2ef8 2026-03-23 15:19:42,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:19:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb700448e074b3ffe2ef8 HTTP/1.1" 200 None 2026-03-23 15:19:42,633 - lava_callback - DEBUG - Processing node 69beb700448e074b3ffe2ef8: baseline-arm64-baylibre 2026-03-23 15:19:42,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb700448e074b3ffe2ef8 2026-03-23 15:19:42,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:19:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb700448e074b3ffe2ef8 HTTP/1.1" 200 None 2026-03-23 15:19:42,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:19:42,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:19:42,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:19:42,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb700448e074b3ffe2ef8 HTTP/1.1" 200 None 2026-03-23 15:19:42,718 - lava_callback - ERROR - Error processing callback for node 69beb700448e074b3ffe2ef8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:21:02,599 - lava_callback - INFO - Received callback for node 69beb74c448e074b3ffe2f00 INFO: 172.21.0.1:58568 - "POST /node/69beb74c448e074b3ffe2f00 HTTP/1.0" 202 Accepted 2026-03-23 15:21:02,604 - lava_callback - INFO - Starting async job submit for node 69beb74c448e074b3ffe2f00 2026-03-23 15:21:02,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:21:02,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb74c448e074b3ffe2f00 HTTP/1.1" 200 None 2026-03-23 15:21:02,620 - lava_callback - DEBUG - Processing node 69beb74c448e074b3ffe2f00: baseline-arm64-baylibre 2026-03-23 15:21:02,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb74c448e074b3ffe2f00 2026-03-23 15:21:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:21:02,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb74c448e074b3ffe2f00 HTTP/1.1" 200 None 2026-03-23 15:21:02,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:21:02,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:21:02,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:21:02,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb74c448e074b3ffe2f00 HTTP/1.1" 200 None 2026-03-23 15:21:02,683 - lava_callback - ERROR - Error processing callback for node 69beb74c448e074b3ffe2f00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:22:02,500 - lava_callback - INFO - Received callback for node 69beb795448e074b3ffe2f0c INFO: 172.21.0.1:53878 - "POST /node/69beb795448e074b3ffe2f0c HTTP/1.0" 202 Accepted 2026-03-23 15:22:02,506 - lava_callback - INFO - Starting async job submit for node 69beb795448e074b3ffe2f0c 2026-03-23 15:22:02,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:22:02,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb795448e074b3ffe2f0c HTTP/1.1" 200 None 2026-03-23 15:22:02,522 - lava_callback - DEBUG - Processing node 69beb795448e074b3ffe2f0c: baseline-arm64-baylibre 2026-03-23 15:22:02,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb795448e074b3ffe2f0c 2026-03-23 15:22:02,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:22:02,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb795448e074b3ffe2f0c HTTP/1.1" 200 None 2026-03-23 15:22:02,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:22:02,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:22:02,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:22:02,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb795448e074b3ffe2f0c HTTP/1.1" 200 None 2026-03-23 15:22:02,598 - lava_callback - ERROR - Error processing callback for node 69beb795448e074b3ffe2f0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:23:22,619 - lava_callback - INFO - Received callback for node 69beb7df448e074b3ffe2f23 INFO: 172.21.0.1:42116 - "POST /node/69beb7df448e074b3ffe2f23 HTTP/1.0" 202 Accepted 2026-03-23 15:23:22,628 - lava_callback - INFO - Starting async job submit for node 69beb7df448e074b3ffe2f23 2026-03-23 15:23:22,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:23:22,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb7df448e074b3ffe2f23 HTTP/1.1" 200 None 2026-03-23 15:23:22,648 - lava_callback - DEBUG - Processing node 69beb7df448e074b3ffe2f23: baseline-arm64-baylibre 2026-03-23 15:23:22,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb7df448e074b3ffe2f23 2026-03-23 15:23:22,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:23:22,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb7df448e074b3ffe2f23 HTTP/1.1" 200 None 2026-03-23 15:23:22,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:23:22,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:23:22,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:23:22,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb7df448e074b3ffe2f23 HTTP/1.1" 200 None 2026-03-23 15:23:22,715 - lava_callback - ERROR - Error processing callback for node 69beb7df448e074b3ffe2f23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:24:51,334 - lava_callback - INFO - Received callback for node 69beb82f448e074b3ffe2f54 INFO: 172.21.0.1:60586 - "POST /node/69beb82f448e074b3ffe2f54 HTTP/1.0" 202 Accepted 2026-03-23 15:24:51,339 - lava_callback - INFO - Starting async job submit for node 69beb82f448e074b3ffe2f54 2026-03-23 15:24:51,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:24:51,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb82f448e074b3ffe2f54 HTTP/1.1" 200 None 2026-03-23 15:24:51,356 - lava_callback - DEBUG - Processing node 69beb82f448e074b3ffe2f54: baseline-arm64-clabbe 2026-03-23 15:24:51,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb82f448e074b3ffe2f54 2026-03-23 15:24:51,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:24:51,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb82f448e074b3ffe2f54 HTTP/1.1" 200 None 2026-03-23 15:24:51,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:24:51,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:24:51,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:24:51,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb82f448e074b3ffe2f54 HTTP/1.1" 200 None 2026-03-23 15:24:51,415 - lava_callback - ERROR - Error processing callback for node 69beb82f448e074b3ffe2f54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:25:42,757 - lava_callback - INFO - Received callback for node 69beb872448e074b3ffe2f59 INFO: 172.21.0.1:58952 - "POST /node/69beb872448e074b3ffe2f59 HTTP/1.0" 202 Accepted 2026-03-23 15:25:42,763 - lava_callback - INFO - Starting async job submit for node 69beb872448e074b3ffe2f59 2026-03-23 15:25:42,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:25:42,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb872448e074b3ffe2f59 HTTP/1.1" 200 None 2026-03-23 15:25:42,778 - lava_callback - DEBUG - Processing node 69beb872448e074b3ffe2f59: baseline-arm64-baylibre 2026-03-23 15:25:42,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb872448e074b3ffe2f59 2026-03-23 15:25:42,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:25:42,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb872448e074b3ffe2f59 HTTP/1.1" 200 None 2026-03-23 15:25:42,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:25:42,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:25:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:25:42,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb872448e074b3ffe2f59 HTTP/1.1" 200 None 2026-03-23 15:25:42,842 - lava_callback - ERROR - Error processing callback for node 69beb872448e074b3ffe2f59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:27:11,435 - lava_callback - INFO - Received callback for node 69beb8c4448e074b3ffe2f66 INFO: 172.21.0.1:50840 - "POST /node/69beb8c4448e074b3ffe2f66 HTTP/1.0" 202 Accepted 2026-03-23 15:27:11,440 - lava_callback - INFO - Starting async job submit for node 69beb8c4448e074b3ffe2f66 2026-03-23 15:27:11,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:27:11,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb8c4448e074b3ffe2f66 HTTP/1.1" 200 None 2026-03-23 15:27:11,456 - lava_callback - DEBUG - Processing node 69beb8c4448e074b3ffe2f66: baseline-arm64-clabbe 2026-03-23 15:27:11,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb8c4448e074b3ffe2f66 2026-03-23 15:27:11,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:27:11,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb8c4448e074b3ffe2f66 HTTP/1.1" 200 None 2026-03-23 15:27:11,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:27:11,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:27:11,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:27:11,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb8c4448e074b3ffe2f66 HTTP/1.1" 200 None 2026-03-23 15:27:11,541 - lava_callback - ERROR - Error processing callback for node 69beb8c4448e074b3ffe2f66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:28:31,566 - lava_callback - INFO - Received callback for node 69beb910448e074b3ffe2f6e INFO: 172.21.0.1:54990 - "POST /node/69beb910448e074b3ffe2f6e HTTP/1.0" 202 Accepted 2026-03-23 15:28:31,571 - lava_callback - INFO - Starting async job submit for node 69beb910448e074b3ffe2f6e 2026-03-23 15:28:31,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:28:31,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb910448e074b3ffe2f6e HTTP/1.1" 200 None 2026-03-23 15:28:31,588 - lava_callback - DEBUG - Processing node 69beb910448e074b3ffe2f6e: baseline-arm64-clabbe 2026-03-23 15:28:31,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb910448e074b3ffe2f6e 2026-03-23 15:28:31,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:28:31,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb910448e074b3ffe2f6e HTTP/1.1" 200 None 2026-03-23 15:28:31,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:28:31,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:28:31,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:28:31,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb910448e074b3ffe2f6e HTTP/1.1" 200 None 2026-03-23 15:28:31,642 - lava_callback - ERROR - Error processing callback for node 69beb910448e074b3ffe2f6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:29:43,020 - lava_callback - INFO - Received callback for node 69beb954448e074b3ffe2f79 INFO: 172.21.0.1:41186 - "POST /node/69beb954448e074b3ffe2f79 HTTP/1.0" 202 Accepted 2026-03-23 15:29:43,026 - lava_callback - INFO - Starting async job submit for node 69beb954448e074b3ffe2f79 2026-03-23 15:29:43,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:29:43,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb954448e074b3ffe2f79 HTTP/1.1" 200 None 2026-03-23 15:29:43,042 - lava_callback - DEBUG - Processing node 69beb954448e074b3ffe2f79: baseline-arm64-baylibre 2026-03-23 15:29:43,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb954448e074b3ffe2f79 2026-03-23 15:29:43,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:29:43,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb954448e074b3ffe2f79 HTTP/1.1" 200 None 2026-03-23 15:29:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:29:43,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:29:43,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:29:43,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb954448e074b3ffe2f79 HTTP/1.1" 200 None 2026-03-23 15:29:43,094 - lava_callback - ERROR - Error processing callback for node 69beb954448e074b3ffe2f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:30:51,633 - lava_callback - INFO - Received callback for node 69beb9a5448e074b3ffe2f82 INFO: 172.21.0.1:59082 - "POST /node/69beb9a5448e074b3ffe2f82 HTTP/1.0" 202 Accepted 2026-03-23 15:30:51,638 - lava_callback - INFO - Starting async job submit for node 69beb9a5448e074b3ffe2f82 2026-03-23 15:30:51,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:30:51,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb9a5448e074b3ffe2f82 HTTP/1.1" 200 None 2026-03-23 15:30:51,654 - lava_callback - DEBUG - Processing node 69beb9a5448e074b3ffe2f82: baseline-arm64-clabbe 2026-03-23 15:30:51,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb9a5448e074b3ffe2f82 2026-03-23 15:30:51,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:30:51,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb9a5448e074b3ffe2f82 HTTP/1.1" 200 None 2026-03-23 15:30:51,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:30:51,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:30:51,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:30:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb9a5448e074b3ffe2f82 HTTP/1.1" 200 None 2026-03-23 15:30:51,729 - lava_callback - ERROR - Error processing callback for node 69beb9a5448e074b3ffe2f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:32:03,079 - lava_callback - INFO - Received callback for node 69beb9ea448e074b3ffe2f8d INFO: 172.21.0.1:58302 - "POST /node/69beb9ea448e074b3ffe2f8d HTTP/1.0" 202 Accepted 2026-03-23 15:32:03,085 - lava_callback - INFO - Starting async job submit for node 69beb9ea448e074b3ffe2f8d 2026-03-23 15:32:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:32:03,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb9ea448e074b3ffe2f8d HTTP/1.1" 200 None 2026-03-23 15:32:03,113 - lava_callback - DEBUG - Processing node 69beb9ea448e074b3ffe2f8d: baseline-arm64-baylibre 2026-03-23 15:32:03,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beb9ea448e074b3ffe2f8d 2026-03-23 15:32:03,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:32:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beb9ea448e074b3ffe2f8d HTTP/1.1" 200 None 2026-03-23 15:32:03,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:32:03,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:32:03,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:32:03,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beb9ea448e074b3ffe2f8d HTTP/1.1" 200 None 2026-03-23 15:32:03,169 - lava_callback - ERROR - Error processing callback for node 69beb9ea448e074b3ffe2f8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:33:31,713 - lava_callback - INFO - Received callback for node 69beba3a448e074b3ffe2f92 INFO: 172.21.0.1:59542 - "POST /node/69beba3a448e074b3ffe2f92 HTTP/1.0" 202 Accepted 2026-03-23 15:33:31,718 - lava_callback - INFO - Starting async job submit for node 69beba3a448e074b3ffe2f92 2026-03-23 15:33:31,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:33:31,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beba3a448e074b3ffe2f92 HTTP/1.1" 200 None 2026-03-23 15:33:31,737 - lava_callback - DEBUG - Processing node 69beba3a448e074b3ffe2f92: baseline-arm64-clabbe 2026-03-23 15:33:31,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beba3a448e074b3ffe2f92 2026-03-23 15:33:31,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:33:31,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beba3a448e074b3ffe2f92 HTTP/1.1" 200 None 2026-03-23 15:33:31,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:33:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:33:31,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:33:31,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beba3a448e074b3ffe2f92 HTTP/1.1" 200 None 2026-03-23 15:33:31,793 - lava_callback - ERROR - Error processing callback for node 69beba3a448e074b3ffe2f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:34:43,210 - lava_callback - INFO - Received callback for node 69beba80448e074b3ffe2f9f INFO: 172.21.0.1:42264 - "POST /node/69beba80448e074b3ffe2f9f HTTP/1.0" 202 Accepted 2026-03-23 15:34:43,215 - lava_callback - INFO - Starting async job submit for node 69beba80448e074b3ffe2f9f 2026-03-23 15:34:43,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:34:43,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beba80448e074b3ffe2f9f HTTP/1.1" 200 None 2026-03-23 15:34:43,231 - lava_callback - DEBUG - Processing node 69beba80448e074b3ffe2f9f: baseline-arm64-baylibre 2026-03-23 15:34:43,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beba80448e074b3ffe2f9f 2026-03-23 15:34:43,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:34:43,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beba80448e074b3ffe2f9f HTTP/1.1" 200 None 2026-03-23 15:34:43,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:34:43,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:34:43,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:34:43,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beba80448e074b3ffe2f9f HTTP/1.1" 200 None 2026-03-23 15:34:43,289 - lava_callback - ERROR - Error processing callback for node 69beba80448e074b3ffe2f9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:35:51,756 - lava_callback - INFO - Received callback for node 69bebad4448e074b3ffe2fa6 INFO: 172.21.0.1:59928 - "POST /node/69bebad4448e074b3ffe2fa6 HTTP/1.0" 202 Accepted 2026-03-23 15:35:51,761 - lava_callback - INFO - Starting async job submit for node 69bebad4448e074b3ffe2fa6 2026-03-23 15:35:51,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:35:51,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebad4448e074b3ffe2fa6 HTTP/1.1" 200 None 2026-03-23 15:35:51,777 - lava_callback - DEBUG - Processing node 69bebad4448e074b3ffe2fa6: baseline-arm64-clabbe 2026-03-23 15:35:51,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebad4448e074b3ffe2fa6 2026-03-23 15:35:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:35:51,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebad4448e074b3ffe2fa6 HTTP/1.1" 200 None 2026-03-23 15:35:51,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:35:51,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:35:51,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:35:51,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebad4448e074b3ffe2fa6 HTTP/1.1" 200 None 2026-03-23 15:35:51,835 - lava_callback - ERROR - Error processing callback for node 69bebad4448e074b3ffe2fa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:37:11,809 - lava_callback - INFO - Received callback for node 69bebb20448e074b3ffe2fb2 INFO: 172.21.0.1:50496 - "POST /node/69bebb20448e074b3ffe2fb2 HTTP/1.0" 202 Accepted 2026-03-23 15:37:11,814 - lava_callback - INFO - Starting async job submit for node 69bebb20448e074b3ffe2fb2 2026-03-23 15:37:11,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:37:11,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebb20448e074b3ffe2fb2 HTTP/1.1" 200 None 2026-03-23 15:37:11,830 - lava_callback - DEBUG - Processing node 69bebb20448e074b3ffe2fb2: baseline-arm64-clabbe 2026-03-23 15:37:11,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebb20448e074b3ffe2fb2 2026-03-23 15:37:11,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:37:11,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebb20448e074b3ffe2fb2 HTTP/1.1" 200 None 2026-03-23 15:37:11,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:37:11,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:37:11,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:37:11,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebb20448e074b3ffe2fb2 HTTP/1.1" 200 None 2026-03-23 15:37:11,893 - lava_callback - ERROR - Error processing callback for node 69bebb20448e074b3ffe2fb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:38:31,863 - lava_callback - INFO - Received callback for node 69bebb6c448e074b3ffe2fb8 INFO: 172.21.0.1:43166 - "POST /node/69bebb6c448e074b3ffe2fb8 HTTP/1.0" 202 Accepted 2026-03-23 15:38:31,869 - lava_callback - INFO - Starting async job submit for node 69bebb6c448e074b3ffe2fb8 2026-03-23 15:38:31,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:38:31,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebb6c448e074b3ffe2fb8 HTTP/1.1" 200 None 2026-03-23 15:38:31,901 - lava_callback - DEBUG - Processing node 69bebb6c448e074b3ffe2fb8: baseline-arm64-clabbe 2026-03-23 15:38:31,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebb6c448e074b3ffe2fb8 2026-03-23 15:38:31,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:38:31,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebb6c448e074b3ffe2fb8 HTTP/1.1" 200 None 2026-03-23 15:38:31,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:38:31,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:38:31,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:38:31,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebb6c448e074b3ffe2fb8 HTTP/1.1" 200 None 2026-03-23 15:38:31,982 - lava_callback - ERROR - Error processing callback for node 69bebb6c448e074b3ffe2fb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:45:52,228 - lava_callback - INFO - Received callback for node 69bebd28448e074b3ffe2ff5 INFO: 172.21.0.1:47820 - "POST /node/69bebd28448e074b3ffe2ff5 HTTP/1.0" 202 Accepted 2026-03-23 15:45:52,234 - lava_callback - INFO - Starting async job submit for node 69bebd28448e074b3ffe2ff5 2026-03-23 15:45:52,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:45:52,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebd28448e074b3ffe2ff5 HTTP/1.1" 200 None 2026-03-23 15:45:52,250 - lava_callback - DEBUG - Processing node 69bebd28448e074b3ffe2ff5: baseline-arm64-clabbe 2026-03-23 15:45:52,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebd28448e074b3ffe2ff5 2026-03-23 15:45:52,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:45:52,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebd28448e074b3ffe2ff5 HTTP/1.1" 200 None 2026-03-23 15:45:52,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:45:52,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 15:45:52,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:45:52,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebd28448e074b3ffe2ff5 HTTP/1.1" 200 None 2026-03-23 15:45:52,337 - lava_callback - ERROR - Error processing callback for node 69bebd28448e074b3ffe2ff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:47:04,373 - lava_callback - INFO - Received callback for node 69bebd6a448e074b3ffe2fff INFO: 172.21.0.1:53826 - "POST /node/69bebd6a448e074b3ffe2fff HTTP/1.0" 202 Accepted 2026-03-23 15:47:04,379 - lava_callback - INFO - Starting async job submit for node 69bebd6a448e074b3ffe2fff 2026-03-23 15:47:04,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:47:04,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebd6a448e074b3ffe2fff HTTP/1.1" 200 None 2026-03-23 15:47:04,401 - lava_callback - DEBUG - Processing node 69bebd6a448e074b3ffe2fff: baseline-arm64-baylibre 2026-03-23 15:47:04,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebd6a448e074b3ffe2fff 2026-03-23 15:47:04,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:47:04,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebd6a448e074b3ffe2fff HTTP/1.1" 200 None 2026-03-23 15:47:04,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:47:04,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:47:04,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:47:04,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebd6a448e074b3ffe2fff HTTP/1.1" 200 None 2026-03-23 15:47:04,517 - lava_callback - ERROR - Error processing callback for node 69bebd6a448e074b3ffe2fff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:48:23,932 - lava_callback - INFO - Received callback for node 69bebdb5448e074b3ffe300d INFO: 172.21.0.1:50654 - "POST /node/69bebdb5448e074b3ffe300d HTTP/1.0" 202 Accepted 2026-03-23 15:48:23,938 - lava_callback - INFO - Starting async job submit for node 69bebdb5448e074b3ffe300d 2026-03-23 15:48:23,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:48:23,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebdb5448e074b3ffe300d HTTP/1.1" 200 None 2026-03-23 15:48:23,954 - lava_callback - DEBUG - Processing node 69bebdb5448e074b3ffe300d: baseline-arm64-baylibre 2026-03-23 15:48:23,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebdb5448e074b3ffe300d 2026-03-23 15:48:23,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:48:23,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebdb5448e074b3ffe300d HTTP/1.1" 200 None 2026-03-23 15:48:23,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:48:23,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:48:23,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:48:24,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebdb5448e074b3ffe300d HTTP/1.1" 200 None 2026-03-23 15:48:24,016 - lava_callback - ERROR - Error processing callback for node 69bebdb5448e074b3ffe300d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:49:23,996 - lava_callback - INFO - Received callback for node 69bebe00448e074b3ffe3016 INFO: 172.21.0.1:36622 - "POST /node/69bebe00448e074b3ffe3016 HTTP/1.0" 202 Accepted 2026-03-23 15:49:24,002 - lava_callback - INFO - Starting async job submit for node 69bebe00448e074b3ffe3016 2026-03-23 15:49:24,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:49:24,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe00448e074b3ffe3016 HTTP/1.1" 200 None 2026-03-23 15:49:24,018 - lava_callback - DEBUG - Processing node 69bebe00448e074b3ffe3016: baseline-arm64-baylibre 2026-03-23 15:49:24,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebe00448e074b3ffe3016 2026-03-23 15:49:24,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:49:24,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe00448e074b3ffe3016 HTTP/1.1" 200 None 2026-03-23 15:49:24,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:49:24,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:49:24,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:49:24,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebe00448e074b3ffe3016 HTTP/1.1" 200 None 2026-03-23 15:49:24,096 - lava_callback - ERROR - Error processing callback for node 69bebe00448e074b3ffe3016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:50:44,128 - lava_callback - INFO - Received callback for node 69bebe4b448e074b3ffe3024 INFO: 172.21.0.1:49988 - "POST /node/69bebe4b448e074b3ffe3024 HTTP/1.0" 202 Accepted 2026-03-23 15:50:44,137 - lava_callback - INFO - Starting async job submit for node 69bebe4b448e074b3ffe3024 2026-03-23 15:50:44,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:50:44,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe4b448e074b3ffe3024 HTTP/1.1" 200 None 2026-03-23 15:50:44,162 - lava_callback - DEBUG - Processing node 69bebe4b448e074b3ffe3024: baseline-arm64-baylibre 2026-03-23 15:50:44,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebe4b448e074b3ffe3024 2026-03-23 15:50:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:50:44,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe4b448e074b3ffe3024 HTTP/1.1" 200 None 2026-03-23 15:50:44,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:50:44,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:50:44,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:50:44,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebe4b448e074b3ffe3024 HTTP/1.1" 200 None 2026-03-23 15:50:44,230 - lava_callback - ERROR - Error processing callback for node 69bebe4b448e074b3ffe3024: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:52:04,374 - lava_callback - INFO - Received callback for node 69bebe98448e074b3ffe302b INFO: 172.21.0.1:33124 - "POST /node/69bebe98448e074b3ffe302b HTTP/1.0" 202 Accepted 2026-03-23 15:52:04,380 - lava_callback - INFO - Starting async job submit for node 69bebe98448e074b3ffe302b 2026-03-23 15:52:04,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:52:04,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe98448e074b3ffe302b HTTP/1.1" 200 None 2026-03-23 15:52:04,396 - lava_callback - DEBUG - Processing node 69bebe98448e074b3ffe302b: baseline-arm64-baylibre 2026-03-23 15:52:04,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebe98448e074b3ffe302b 2026-03-23 15:52:04,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:52:04,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebe98448e074b3ffe302b HTTP/1.1" 200 None 2026-03-23 15:52:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:52:04,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:52:04,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:52:04,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebe98448e074b3ffe302b HTTP/1.1" 200 None 2026-03-23 15:52:04,476 - lava_callback - ERROR - Error processing callback for node 69bebe98448e074b3ffe302b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:53:24,287 - lava_callback - INFO - Received callback for node 69bebee2448e074b3ffe3039 INFO: 172.21.0.1:45034 - "POST /node/69bebee2448e074b3ffe3039 HTTP/1.0" 202 Accepted 2026-03-23 15:53:24,292 - lava_callback - INFO - Starting async job submit for node 69bebee2448e074b3ffe3039 2026-03-23 15:53:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:53:24,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebee2448e074b3ffe3039 HTTP/1.1" 200 None 2026-03-23 15:53:24,317 - lava_callback - DEBUG - Processing node 69bebee2448e074b3ffe3039: baseline-arm64-baylibre 2026-03-23 15:53:24,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebee2448e074b3ffe3039 2026-03-23 15:53:24,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:53:24,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebee2448e074b3ffe3039 HTTP/1.1" 200 None 2026-03-23 15:53:24,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:53:24,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:53:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:53:24,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebee2448e074b3ffe3039 HTTP/1.1" 200 None 2026-03-23 15:53:24,380 - lava_callback - ERROR - Error processing callback for node 69bebee2448e074b3ffe3039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:54:32,647 - lava_callback - INFO - Received callback for node 69bebf31448e074b3ffe3043 INFO: 172.21.0.1:60772 - "POST /node/69bebf31448e074b3ffe3043 HTTP/1.0" 202 Accepted 2026-03-23 15:54:32,653 - lava_callback - INFO - Starting async job submit for node 69bebf31448e074b3ffe3043 2026-03-23 15:54:32,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:54:32,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebf31448e074b3ffe3043 HTTP/1.1" 200 None 2026-03-23 15:54:32,677 - lava_callback - DEBUG - Processing node 69bebf31448e074b3ffe3043: baseline-arm64-clabbe 2026-03-23 15:54:32,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebf31448e074b3ffe3043 2026-03-23 15:54:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:54:32,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebf31448e074b3ffe3043 HTTP/1.1" 200 None 2026-03-23 15:54:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:54:32,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:54:32,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:54:32,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebf31448e074b3ffe3043 HTTP/1.1" 200 None 2026-03-23 15:54:32,736 - lava_callback - ERROR - Error processing callback for node 69bebf31448e074b3ffe3043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:55:52,668 - lava_callback - INFO - Received callback for node 69bebf7b448e074b3ffe304c INFO: 172.21.0.1:56014 - "POST /node/69bebf7b448e074b3ffe304c HTTP/1.0" 202 Accepted 2026-03-23 15:55:52,674 - lava_callback - INFO - Starting async job submit for node 69bebf7b448e074b3ffe304c 2026-03-23 15:55:52,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:55:52,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebf7b448e074b3ffe304c HTTP/1.1" 200 None 2026-03-23 15:55:52,693 - lava_callback - DEBUG - Processing node 69bebf7b448e074b3ffe304c: baseline-arm64-clabbe 2026-03-23 15:55:52,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebf7b448e074b3ffe304c 2026-03-23 15:55:52,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:55:52,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebf7b448e074b3ffe304c HTTP/1.1" 200 None 2026-03-23 15:55:52,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:55:52,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:55:52,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:55:52,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebf7b448e074b3ffe304c HTTP/1.1" 200 None 2026-03-23 15:55:52,751 - lava_callback - ERROR - Error processing callback for node 69bebf7b448e074b3ffe304c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:57:12,720 - lava_callback - INFO - Received callback for node 69bebfc6448e074b3ffe305a INFO: 172.21.0.1:60416 - "POST /node/69bebfc6448e074b3ffe305a HTTP/1.0" 202 Accepted 2026-03-23 15:57:12,726 - lava_callback - INFO - Starting async job submit for node 69bebfc6448e074b3ffe305a 2026-03-23 15:57:12,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:57:12,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebfc6448e074b3ffe305a HTTP/1.1" 200 None 2026-03-23 15:57:12,742 - lava_callback - DEBUG - Processing node 69bebfc6448e074b3ffe305a: baseline-arm64-clabbe 2026-03-23 15:57:12,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bebfc6448e074b3ffe305a 2026-03-23 15:57:12,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:57:12,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bebfc6448e074b3ffe305a HTTP/1.1" 200 None 2026-03-23 15:57:12,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:57:12,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:57:12,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:57:12,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bebfc6448e074b3ffe305a HTTP/1.1" 200 None 2026-03-23 15:57:12,830 - lava_callback - ERROR - Error processing callback for node 69bebfc6448e074b3ffe305a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:58:12,761 - lava_callback - INFO - Received callback for node 69bec012448e074b3ffe3068 INFO: 172.21.0.1:46604 - "POST /node/69bec012448e074b3ffe3068 HTTP/1.0" 202 Accepted 2026-03-23 15:58:12,767 - lava_callback - INFO - Starting async job submit for node 69bec012448e074b3ffe3068 2026-03-23 15:58:12,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:58:12,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec012448e074b3ffe3068 HTTP/1.1" 200 None 2026-03-23 15:58:12,791 - lava_callback - DEBUG - Processing node 69bec012448e074b3ffe3068: baseline-arm64-clabbe 2026-03-23 15:58:12,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec012448e074b3ffe3068 2026-03-23 15:58:12,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:58:12,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec012448e074b3ffe3068 HTTP/1.1" 200 None 2026-03-23 15:58:12,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:58:12,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:58:12,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:58:12,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec012448e074b3ffe3068 HTTP/1.1" 200 None 2026-03-23 15:58:12,862 - lava_callback - ERROR - Error processing callback for node 69bec012448e074b3ffe3068: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK 2026-03-23 15:59:32,900 - lava_callback - INFO - Received callback for node 69bec05d448e074b3ffe3075 INFO: 172.21.0.1:35280 - "POST /node/69bec05d448e074b3ffe3075 HTTP/1.0" 202 Accepted 2026-03-23 15:59:32,906 - lava_callback - INFO - Starting async job submit for node 69bec05d448e074b3ffe3075 2026-03-23 15:59:32,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:59:32,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec05d448e074b3ffe3075 HTTP/1.1" 200 None 2026-03-23 15:59:32,929 - lava_callback - DEBUG - Processing node 69bec05d448e074b3ffe3075: baseline-arm64-clabbe 2026-03-23 15:59:32,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec05d448e074b3ffe3075 2026-03-23 15:59:32,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:59:32,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec05d448e074b3ffe3075 HTTP/1.1" 200 None 2026-03-23 15:59:32,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:59:32,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 15:59:32,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 15:59:32,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec05d448e074b3ffe3075 HTTP/1.1" 200 None 2026-03-23 15:59:32,981 - lava_callback - ERROR - Error processing callback for node 69bec05d448e074b3ffe3075: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60880 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:00:52,831 - lava_callback - INFO - Received callback for node 69bec0aa448e074b3ffe307f INFO: 172.21.0.1:35874 - "POST /node/69bec0aa448e074b3ffe307f HTTP/1.0" 202 Accepted 2026-03-23 16:00:52,836 - lava_callback - INFO - Starting async job submit for node 69bec0aa448e074b3ffe307f 2026-03-23 16:00:52,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:00:52,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec0aa448e074b3ffe307f HTTP/1.1" 200 None 2026-03-23 16:00:52,852 - lava_callback - DEBUG - Processing node 69bec0aa448e074b3ffe307f: baseline-arm64-clabbe 2026-03-23 16:00:52,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec0aa448e074b3ffe307f 2026-03-23 16:00:52,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:00:52,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec0aa448e074b3ffe307f HTTP/1.1" 200 None 2026-03-23 16:00:52,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:00:52,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 16:00:52,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:00:52,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec0aa448e074b3ffe307f HTTP/1.1" 200 None 2026-03-23 16:00:52,912 - lava_callback - ERROR - Error processing callback for node 69bec0aa448e074b3ffe307f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:02:12,910 - lava_callback - INFO - Received callback for node 69bec0f6448e074b3ffe3090 INFO: 172.21.0.1:42232 - "POST /node/69bec0f6448e074b3ffe3090 HTTP/1.0" 202 Accepted 2026-03-23 16:02:12,916 - lava_callback - INFO - Starting async job submit for node 69bec0f6448e074b3ffe3090 2026-03-23 16:02:12,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:02:12,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec0f6448e074b3ffe3090 HTTP/1.1" 200 None 2026-03-23 16:02:12,940 - lava_callback - DEBUG - Processing node 69bec0f6448e074b3ffe3090: baseline-arm64-clabbe 2026-03-23 16:02:12,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec0f6448e074b3ffe3090 2026-03-23 16:02:12,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:02:12,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec0f6448e074b3ffe3090 HTTP/1.1" 200 None 2026-03-23 16:02:12,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:02:12,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 16:02:12,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:02:12,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec0f6448e074b3ffe3090 HTTP/1.1" 200 None 2026-03-23 16:02:12,996 - lava_callback - ERROR - Error processing callback for node 69bec0f6448e074b3ffe3090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:03:33,008 - lava_callback - INFO - Received callback for node 69bec141448e074b3ffe309b INFO: 172.21.0.1:34026 - "POST /node/69bec141448e074b3ffe309b HTTP/1.0" 202 Accepted 2026-03-23 16:03:33,013 - lava_callback - INFO - Starting async job submit for node 69bec141448e074b3ffe309b 2026-03-23 16:03:33,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:03:33,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec141448e074b3ffe309b HTTP/1.1" 200 None 2026-03-23 16:03:33,029 - lava_callback - DEBUG - Processing node 69bec141448e074b3ffe309b: baseline-arm64-clabbe 2026-03-23 16:03:33,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec141448e074b3ffe309b 2026-03-23 16:03:33,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:03:33,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec141448e074b3ffe309b HTTP/1.1" 200 None 2026-03-23 16:03:33,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:03:33,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 16:03:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:03:33,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec141448e074b3ffe309b HTTP/1.1" 200 None 2026-03-23 16:03:33,091 - lava_callback - ERROR - Error processing callback for node 69bec141448e074b3ffe309b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:04:33,003 - lava_callback - INFO - Received callback for node 69bec18d448e074b3ffe30a5 INFO: 172.21.0.1:34010 - "POST /node/69bec18d448e074b3ffe30a5 HTTP/1.0" 202 Accepted 2026-03-23 16:04:33,008 - lava_callback - INFO - Starting async job submit for node 69bec18d448e074b3ffe30a5 2026-03-23 16:04:33,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:04:33,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec18d448e074b3ffe30a5 HTTP/1.1" 200 None 2026-03-23 16:04:33,024 - lava_callback - DEBUG - Processing node 69bec18d448e074b3ffe30a5: baseline-arm64-clabbe 2026-03-23 16:04:33,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec18d448e074b3ffe30a5 2026-03-23 16:04:33,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:04:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec18d448e074b3ffe30a5 HTTP/1.1" 200 None 2026-03-23 16:04:33,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:04:33,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 16:04:33,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:04:33,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec18d448e074b3ffe30a5 HTTP/1.1" 200 None 2026-03-23 16:04:33,083 - lava_callback - ERROR - Error processing callback for node 69bec18d448e074b3ffe30a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:05:45,080 - lava_callback - INFO - Received callback for node 69bec1ce448e074b3ffe30b0 INFO: 172.21.0.1:44174 - "POST /node/69bec1ce448e074b3ffe30b0 HTTP/1.0" 202 Accepted 2026-03-23 16:05:45,086 - lava_callback - INFO - Starting async job submit for node 69bec1ce448e074b3ffe30b0 2026-03-23 16:05:45,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:05:45,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec1ce448e074b3ffe30b0 HTTP/1.1" 200 None 2026-03-23 16:05:45,102 - lava_callback - DEBUG - Processing node 69bec1ce448e074b3ffe30b0: baseline-arm64-baylibre 2026-03-23 16:05:45,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec1ce448e074b3ffe30b0 2026-03-23 16:05:45,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:05:45,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec1ce448e074b3ffe30b0 HTTP/1.1" 200 None 2026-03-23 16:05:45,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:05:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:05:45,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:05:45,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec1ce448e074b3ffe30b0 HTTP/1.1" 200 None 2026-03-23 16:05:45,177 - lava_callback - ERROR - Error processing callback for node 69bec1ce448e074b3ffe30b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:07:05,249 - lava_callback - INFO - Received callback for node 69bec218448e074b3ffe30b7 INFO: 172.21.0.1:40964 - "POST /node/69bec218448e074b3ffe30b7 HTTP/1.0" 202 Accepted 2026-03-23 16:07:05,255 - lava_callback - INFO - Starting async job submit for node 69bec218448e074b3ffe30b7 2026-03-23 16:07:05,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:07:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec218448e074b3ffe30b7 HTTP/1.1" 200 None 2026-03-23 16:07:05,271 - lava_callback - DEBUG - Processing node 69bec218448e074b3ffe30b7: baseline-arm64-baylibre 2026-03-23 16:07:05,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec218448e074b3ffe30b7 2026-03-23 16:07:05,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:07:05,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec218448e074b3ffe30b7 HTTP/1.1" 200 None 2026-03-23 16:07:05,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:07:05,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:07:05,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:07:05,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec218448e074b3ffe30b7 HTTP/1.1" 200 None 2026-03-23 16:07:05,330 - lava_callback - ERROR - Error processing callback for node 69bec218448e074b3ffe30b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:08:05,017 - lava_callback - INFO - Received callback for node 69bec261448e074b3ffe30c1 INFO: 172.21.0.1:38214 - "POST /node/69bec261448e074b3ffe30c1 HTTP/1.0" 202 Accepted 2026-03-23 16:08:05,023 - lava_callback - INFO - Starting async job submit for node 69bec261448e074b3ffe30c1 2026-03-23 16:08:05,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:08:05,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec261448e074b3ffe30c1 HTTP/1.1" 200 None 2026-03-23 16:08:05,040 - lava_callback - DEBUG - Processing node 69bec261448e074b3ffe30c1: baseline-arm64-baylibre 2026-03-23 16:08:05,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec261448e074b3ffe30c1 2026-03-23 16:08:05,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:08:05,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec261448e074b3ffe30c1 HTTP/1.1" 200 None 2026-03-23 16:08:05,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:08:05,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:08:05,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:08:05,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec261448e074b3ffe30c1 HTTP/1.1" 200 None 2026-03-23 16:08:05,104 - lava_callback - ERROR - Error processing callback for node 69bec261448e074b3ffe30c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:09:25,276 - lava_callback - INFO - Received callback for node 69bec2ad448e074b3ffe30ca INFO: 172.21.0.1:57784 - "POST /node/69bec2ad448e074b3ffe30ca HTTP/1.0" 202 Accepted 2026-03-23 16:09:25,282 - lava_callback - INFO - Starting async job submit for node 69bec2ad448e074b3ffe30ca 2026-03-23 16:09:25,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:09:25,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec2ad448e074b3ffe30ca HTTP/1.1" 200 None 2026-03-23 16:09:25,298 - lava_callback - DEBUG - Processing node 69bec2ad448e074b3ffe30ca: baseline-arm64-baylibre 2026-03-23 16:09:25,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec2ad448e074b3ffe30ca 2026-03-23 16:09:25,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:09:25,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec2ad448e074b3ffe30ca HTTP/1.1" 200 None 2026-03-23 16:09:25,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:09:25,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:09:25,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:09:25,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec2ad448e074b3ffe30ca HTTP/1.1" 200 None 2026-03-23 16:09:25,348 - lava_callback - ERROR - Error processing callback for node 69bec2ad448e074b3ffe30ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:10:45,239 - lava_callback - INFO - Received callback for node 69bec2f8448e074b3ffe30d4 INFO: 172.21.0.1:51438 - "POST /node/69bec2f8448e074b3ffe30d4 HTTP/1.0" 202 Accepted 2026-03-23 16:10:45,248 - lava_callback - INFO - Starting async job submit for node 69bec2f8448e074b3ffe30d4 2026-03-23 16:10:45,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:10:45,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec2f8448e074b3ffe30d4 HTTP/1.1" 200 None 2026-03-23 16:10:45,266 - lava_callback - DEBUG - Processing node 69bec2f8448e074b3ffe30d4: baseline-arm64-baylibre 2026-03-23 16:10:45,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec2f8448e074b3ffe30d4 2026-03-23 16:10:45,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:10:45,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec2f8448e074b3ffe30d4 HTTP/1.1" 200 None 2026-03-23 16:10:45,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:10:45,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:10:45,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:10:45,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec2f8448e074b3ffe30d4 HTTP/1.1" 200 None 2026-03-23 16:10:45,344 - lava_callback - ERROR - Error processing callback for node 69bec2f8448e074b3ffe30d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:12:05,337 - lava_callback - INFO - Received callback for node 69bec344448e074b3ffe30da INFO: 172.21.0.1:37956 - "POST /node/69bec344448e074b3ffe30da HTTP/1.0" 202 Accepted 2026-03-23 16:12:05,345 - lava_callback - INFO - Starting async job submit for node 69bec344448e074b3ffe30da 2026-03-23 16:12:05,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:12:05,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec344448e074b3ffe30da HTTP/1.1" 200 None 2026-03-23 16:12:05,367 - lava_callback - DEBUG - Processing node 69bec344448e074b3ffe30da: baseline-arm64-baylibre 2026-03-23 16:12:05,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec344448e074b3ffe30da 2026-03-23 16:12:05,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:12:05,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec344448e074b3ffe30da HTTP/1.1" 200 None 2026-03-23 16:12:05,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:12:05,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-23 16:12:05,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:12:05,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec344448e074b3ffe30da HTTP/1.1" 200 None 2026-03-23 16:12:05,447 - lava_callback - ERROR - Error processing callback for node 69bec344448e074b3ffe30da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]