INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:31:58,821 - lava_callback - INFO - Received callback for node 69c40deb944faaf0e7f5e474 2026-03-27 16:31:58,827 - lava_callback - INFO - Starting async job submit for node 69c40deb944faaf0e7f5e474 INFO: 172.20.0.1:40428 - "POST /node/69c40deb944faaf0e7f5e474 HTTP/1.0" 202 Accepted 2026-03-27 16:31:58,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:31:58,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40deb944faaf0e7f5e474 HTTP/1.1" 200 None 2026-03-27 16:31:58,871 - lava_callback - DEBUG - Processing node 69c40deb944faaf0e7f5e474: baseline-arm64-baylibre 2026-03-27 16:31:58,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40deb944faaf0e7f5e474 2026-03-27 16:31:58,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:31:58,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40deb944faaf0e7f5e474 HTTP/1.1" 200 None 2026-03-27 16:31:58,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:31:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:31:58,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:31:58,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40deb944faaf0e7f5e474 HTTP/1.1" 200 None 2026-03-27 16:31:58,964 - lava_callback - ERROR - Error processing callback for node 69c40deb944faaf0e7f5e474: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:33:18,892 - lava_callback - INFO - Received callback for node 69c40e40944faaf0e7f5e488 INFO: 172.20.0.1:60756 - "POST /node/69c40e40944faaf0e7f5e488 HTTP/1.0" 202 Accepted 2026-03-27 16:33:18,898 - lava_callback - INFO - Starting async job submit for node 69c40e40944faaf0e7f5e488 2026-03-27 16:33:18,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:33:18,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40e40944faaf0e7f5e488 HTTP/1.1" 200 None 2026-03-27 16:33:18,966 - lava_callback - DEBUG - Processing node 69c40e40944faaf0e7f5e488: baseline-arm64-baylibre 2026-03-27 16:33:18,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40e40944faaf0e7f5e488 2026-03-27 16:33:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:33:18,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40e40944faaf0e7f5e488 HTTP/1.1" 200 None 2026-03-27 16:33:18,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:33:19,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:33:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:33:19,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40e40944faaf0e7f5e488 HTTP/1.1" 200 None 2026-03-27 16:33:19,055 - lava_callback - ERROR - Error processing callback for node 69c40e40944faaf0e7f5e488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:37:19,125 - lava_callback - INFO - Received callback for node 69c40f30944faaf0e7f60b68 INFO: 172.20.0.1:48584 - "POST /node/69c40f30944faaf0e7f60b68 HTTP/1.0" 202 Accepted 2026-03-27 16:37:19,131 - lava_callback - INFO - Starting async job submit for node 69c40f30944faaf0e7f60b68 2026-03-27 16:37:19,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:37:19,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40f30944faaf0e7f60b68 HTTP/1.1" 200 None 2026-03-27 16:37:19,152 - lava_callback - DEBUG - Processing node 69c40f30944faaf0e7f60b68: baseline-arm64-baylibre 2026-03-27 16:37:19,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40f30944faaf0e7f60b68 2026-03-27 16:37:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:37:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40f30944faaf0e7f60b68 HTTP/1.1" 200 None 2026-03-27 16:37:19,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:37:19,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:37:19,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:37:19,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40f30944faaf0e7f60b68 HTTP/1.1" 200 None 2026-03-27 16:37:19,209 - lava_callback - ERROR - Error processing callback for node 69c40f30944faaf0e7f60b68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:38:39,200 - lava_callback - INFO - Received callback for node 69c40f86944faaf0e7f60b83 INFO: 172.20.0.1:35170 - "POST /node/69c40f86944faaf0e7f60b83 HTTP/1.0" 202 Accepted 2026-03-27 16:38:39,209 - lava_callback - INFO - Starting async job submit for node 69c40f86944faaf0e7f60b83 2026-03-27 16:38:39,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:38:39,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40f86944faaf0e7f60b83 HTTP/1.1" 200 None 2026-03-27 16:38:39,243 - lava_callback - DEBUG - Processing node 69c40f86944faaf0e7f60b83: baseline-arm64-baylibre 2026-03-27 16:38:39,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40f86944faaf0e7f60b83 2026-03-27 16:38:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:38:39,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40f86944faaf0e7f60b83 HTTP/1.1" 200 None 2026-03-27 16:38:39,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:38:39,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:38:39,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:38:39,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40f86944faaf0e7f60b83 HTTP/1.1" 200 None 2026-03-27 16:38:39,370 - lava_callback - ERROR - Error processing callback for node 69c40f86944faaf0e7f60b83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47518 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:39:59,271 - lava_callback - INFO - Received callback for node 69c40fcb944faaf0e7f60ba3 INFO: 172.20.0.1:47526 - "POST /node/69c40fcb944faaf0e7f60ba3 HTTP/1.0" 202 Accepted 2026-03-27 16:39:59,276 - lava_callback - INFO - Starting async job submit for node 69c40fcb944faaf0e7f60ba3 2026-03-27 16:39:59,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:39:59,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40fcb944faaf0e7f60ba3 HTTP/1.1" 200 None 2026-03-27 16:39:59,314 - lava_callback - DEBUG - Processing node 69c40fcb944faaf0e7f60ba3: baseline-arm-baylibre 2026-03-27 16:39:59,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40fcb944faaf0e7f60ba3 2026-03-27 16:39:59,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:39:59,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40fcb944faaf0e7f60ba3 HTTP/1.1" 200 None 2026-03-27 16:39:59,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:39:59,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:39:59,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:39:59,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40fcb944faaf0e7f60ba3 HTTP/1.1" 200 None 2026-03-27 16:39:59,377 - lava_callback - ERROR - Error processing callback for node 69c40fcb944faaf0e7f60ba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:40:39,262 - lava_callback - INFO - Received callback for node 69c40ff5944faaf0e7f60bb2 INFO: 172.20.0.1:45386 - "POST /node/69c40ff5944faaf0e7f60bb2 HTTP/1.0" 202 Accepted 2026-03-27 16:40:39,268 - lava_callback - INFO - Starting async job submit for node 69c40ff5944faaf0e7f60bb2 2026-03-27 16:40:39,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:40:39,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ff5944faaf0e7f60bb2 HTTP/1.1" 200 None 2026-03-27 16:40:39,285 - lava_callback - DEBUG - Processing node 69c40ff5944faaf0e7f60bb2: baseline-arm-baylibre 2026-03-27 16:40:39,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c40ff5944faaf0e7f60bb2 2026-03-27 16:40:39,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:40:39,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ff5944faaf0e7f60bb2 HTTP/1.1" 200 None 2026-03-27 16:40:39,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:40:39,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:40:39,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:40:39,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c40ff5944faaf0e7f60bb2 HTTP/1.1" 200 None 2026-03-27 16:40:39,375 - lava_callback - ERROR - Error processing callback for node 69c40ff5944faaf0e7f60bb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:41:41,603 - lava_callback - INFO - Received callback for node 69c41033944faaf0e7f60bc6 INFO: 172.20.0.1:47778 - "POST /node/69c41033944faaf0e7f60bc6 HTTP/1.0" 202 Accepted 2026-03-27 16:41:41,611 - lava_callback - INFO - Starting async job submit for node 69c41033944faaf0e7f60bc6 2026-03-27 16:41:41,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:41:41,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41033944faaf0e7f60bc6 HTTP/1.1" 200 None 2026-03-27 16:41:41,642 - lava_callback - DEBUG - Processing node 69c41033944faaf0e7f60bc6: baseline-arm64-clabbe 2026-03-27 16:41:41,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41033944faaf0e7f60bc6 2026-03-27 16:41:41,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:41:41,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41033944faaf0e7f60bc6 HTTP/1.1" 200 None 2026-03-27 16:41:41,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:41:41,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:41:41,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:41:41,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41033944faaf0e7f60bc6 HTTP/1.1" 200 None 2026-03-27 16:41:41,735 - lava_callback - ERROR - Error processing callback for node 69c41033944faaf0e7f60bc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:42:39,374 - lava_callback - INFO - Received callback for node 69c41072944faaf0e7f60bd2 INFO: 172.20.0.1:39394 - "POST /node/69c41072944faaf0e7f60bd2 HTTP/1.0" 202 Accepted 2026-03-27 16:42:39,380 - lava_callback - INFO - Starting async job submit for node 69c41072944faaf0e7f60bd2 2026-03-27 16:42:39,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:42:39,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41072944faaf0e7f60bd2 HTTP/1.1" 200 None 2026-03-27 16:42:39,396 - lava_callback - DEBUG - Processing node 69c41072944faaf0e7f60bd2: baseline-arm-baylibre 2026-03-27 16:42:39,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41072944faaf0e7f60bd2 2026-03-27 16:42:39,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:42:39,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41072944faaf0e7f60bd2 HTTP/1.1" 200 None 2026-03-27 16:42:39,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:42:39,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:42:39,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:42:39,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41072944faaf0e7f60bd2 HTTP/1.1" 200 None 2026-03-27 16:42:39,457 - lava_callback - ERROR - Error processing callback for node 69c41072944faaf0e7f60bd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52596 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:43:19,407 - lava_callback - INFO - Received callback for node 69c4109d944faaf0e7f60bda INFO: 172.20.0.1:52608 - "POST /node/69c4109d944faaf0e7f60bda HTTP/1.0" 202 Accepted 2026-03-27 16:43:19,412 - lava_callback - INFO - Starting async job submit for node 69c4109d944faaf0e7f60bda 2026-03-27 16:43:19,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:19,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4109d944faaf0e7f60bda HTTP/1.1" 200 None 2026-03-27 16:43:19,429 - lava_callback - DEBUG - Processing node 69c4109d944faaf0e7f60bda: baseline-arm-baylibre 2026-03-27 16:43:19,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4109d944faaf0e7f60bda 2026-03-27 16:43:19,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:19,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4109d944faaf0e7f60bda HTTP/1.1" 200 None 2026-03-27 16:43:19,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:19,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:43:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:19,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4109d944faaf0e7f60bda HTTP/1.1" 200 None 2026-03-27 16:43:19,510 - lava_callback - ERROR - Error processing callback for node 69c4109d944faaf0e7f60bda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51102 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:43:39,420 - lava_callback - INFO - Received callback for node 69c410a9944faaf0e7f60bf7 INFO: 172.20.0.1:51110 - "POST /node/69c410a9944faaf0e7f60bf7 HTTP/1.0" 202 Accepted 2026-03-27 16:43:39,426 - lava_callback - INFO - Starting async job submit for node 69c410a9944faaf0e7f60bf7 2026-03-27 16:43:39,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:39,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a9944faaf0e7f60bf7 HTTP/1.1" 200 None 2026-03-27 16:43:39,445 - lava_callback - DEBUG - Processing node 69c410a9944faaf0e7f60bf7: baseline-arm-baylibre 2026-03-27 16:43:39,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410a9944faaf0e7f60bf7 2026-03-27 16:43:39,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:39,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410a9944faaf0e7f60bf7 HTTP/1.1" 200 None 2026-03-27 16:43:39,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:39,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:39,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:39,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410a9944faaf0e7f60bf7 HTTP/1.1" 200 None 2026-03-27 16:43:39,507 - lava_callback - ERROR - Error processing callback for node 69c410a9944faaf0e7f60bf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:43:40,146 - lava_callback - INFO - Received callback for node 69c410ab944faaf0e7f60bfa INFO: 172.20.0.1:51994 - "POST /node/69c410ab944faaf0e7f60bfa HTTP/1.0" 202 Accepted 2026-03-27 16:43:40,152 - lava_callback - INFO - Starting async job submit for node 69c410ab944faaf0e7f60bfa 2026-03-27 16:43:40,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ab944faaf0e7f60bfa HTTP/1.1" 200 None 2026-03-27 16:43:40,177 - lava_callback - DEBUG - Processing node 69c410ab944faaf0e7f60bfa: baseline-arm-baylibre 2026-03-27 16:43:40,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410ab944faaf0e7f60bfa 2026-03-27 16:43:40,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ab944faaf0e7f60bfa HTTP/1.1" 200 None 2026-03-27 16:43:40,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:40,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ab944faaf0e7f60bfa HTTP/1.1" 200 None 2026-03-27 16:43:40,233 - lava_callback - ERROR - Error processing callback for node 69c410ab944faaf0e7f60bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:43:40,845 - lava_callback - INFO - Received callback for node 69c410ac944faaf0e7f60c0e INFO: 172.20.0.1:52004 - "POST /node/69c410ac944faaf0e7f60c0e HTTP/1.0" 202 Accepted 2026-03-27 16:43:40,850 - lava_callback - INFO - Starting async job submit for node 69c410ac944faaf0e7f60c0e 2026-03-27 16:43:40,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ac944faaf0e7f60c0e HTTP/1.1" 200 None 2026-03-27 16:43:40,867 - lava_callback - DEBUG - Processing node 69c410ac944faaf0e7f60c0e: baseline-arm-baylibre 2026-03-27 16:43:40,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410ac944faaf0e7f60c0e 2026-03-27 16:43:40,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ac944faaf0e7f60c0e HTTP/1.1" 200 None 2026-03-27 16:43:40,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:40,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:40,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ac944faaf0e7f60c0e HTTP/1.1" 200 None 2026-03-27 16:43:40,932 - lava_callback - ERROR - Error processing callback for node 69c410ac944faaf0e7f60c0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:43:41,512 - lava_callback - INFO - Received callback for node 69c410ad944faaf0e7f60c11 INFO: 172.20.0.1:52010 - "POST /node/69c410ad944faaf0e7f60c11 HTTP/1.0" 202 Accepted 2026-03-27 16:43:41,521 - lava_callback - INFO - Starting async job submit for node 69c410ad944faaf0e7f60c11 2026-03-27 16:43:41,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:41,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ad944faaf0e7f60c11 HTTP/1.1" 200 None 2026-03-27 16:43:41,537 - lava_callback - DEBUG - Processing node 69c410ad944faaf0e7f60c11: baseline-arm-baylibre 2026-03-27 16:43:41,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410ad944faaf0e7f60c11 2026-03-27 16:43:41,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:41,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410ad944faaf0e7f60c11 HTTP/1.1" 200 None 2026-03-27 16:43:41,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:41,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:41,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:41,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410ad944faaf0e7f60c11 HTTP/1.1" 200 None 2026-03-27 16:43:41,588 - lava_callback - ERROR - Error processing callback for node 69c410ad944faaf0e7f60c11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:43:42,217 - lava_callback - INFO - Received callback for node 69c410b0944faaf0e7f60c1c INFO: 172.20.0.1:52026 - "POST /node/69c410b0944faaf0e7f60c1c HTTP/1.0" 202 Accepted 2026-03-27 16:43:42,223 - lava_callback - INFO - Starting async job submit for node 69c410b0944faaf0e7f60c1c 2026-03-27 16:43:42,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b0944faaf0e7f60c1c HTTP/1.1" 200 None 2026-03-27 16:43:42,239 - lava_callback - DEBUG - Processing node 69c410b0944faaf0e7f60c1c: baseline-arm-baylibre 2026-03-27 16:43:42,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410b0944faaf0e7f60c1c 2026-03-27 16:43:42,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b0944faaf0e7f60c1c HTTP/1.1" 200 None 2026-03-27 16:43:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:42,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b0944faaf0e7f60c1c HTTP/1.1" 200 None 2026-03-27 16:43:42,295 - lava_callback - ERROR - Error processing callback for node 69c410b0944faaf0e7f60c1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:43:42,926 - lava_callback - INFO - Received callback for node 69c410b2944faaf0e7f60c1f INFO: 172.20.0.1:52038 - "POST /node/69c410b2944faaf0e7f60c1f HTTP/1.0" 202 Accepted 2026-03-27 16:43:42,931 - lava_callback - INFO - Starting async job submit for node 69c410b2944faaf0e7f60c1f 2026-03-27 16:43:42,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b2944faaf0e7f60c1f HTTP/1.1" 200 None 2026-03-27 16:43:42,949 - lava_callback - DEBUG - Processing node 69c410b2944faaf0e7f60c1f: baseline-arm-baylibre 2026-03-27 16:43:42,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410b2944faaf0e7f60c1f 2026-03-27 16:43:42,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410b2944faaf0e7f60c1f HTTP/1.1" 200 None 2026-03-27 16:43:42,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:43:42,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:42,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410b2944faaf0e7f60c1f HTTP/1.1" 200 None 2026-03-27 16:43:43,004 - lava_callback - ERROR - Error processing callback for node 69c410b2944faaf0e7f60c1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:43:59,413 - lava_callback - INFO - Received callback for node 69c410c9944faaf0e7f60c87 INFO: 172.20.0.1:59978 - "POST /node/69c410c9944faaf0e7f60c87 HTTP/1.0" 202 Accepted 2026-03-27 16:43:59,434 - lava_callback - INFO - Starting async job submit for node 69c410c9944faaf0e7f60c87 2026-03-27 16:43:59,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:59,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c87 HTTP/1.1" 200 None 2026-03-27 16:43:59,464 - lava_callback - DEBUG - Processing node 69c410c9944faaf0e7f60c87: baseline-arm-baylibre 2026-03-27 16:43:59,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410c9944faaf0e7f60c87 2026-03-27 16:43:59,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:59,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c9944faaf0e7f60c87 HTTP/1.1" 200 None 2026-03-27 16:43:59,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:43:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:43:59,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c9944faaf0e7f60c87 HTTP/1.1" 200 None 2026-03-27 16:43:59,544 - lava_callback - ERROR - Error processing callback for node 69c410c9944faaf0e7f60c87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:44:01,524 - lava_callback - INFO - Received callback for node 69c410bb944faaf0e7f60c36 INFO: 172.20.0.1:36778 - "POST /node/69c410bb944faaf0e7f60c36 HTTP/1.0" 202 Accepted 2026-03-27 16:44:01,530 - lava_callback - INFO - Starting async job submit for node 69c410bb944faaf0e7f60c36 2026-03-27 16:44:01,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:01,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bb944faaf0e7f60c36 HTTP/1.1" 200 None 2026-03-27 16:44:01,546 - lava_callback - DEBUG - Processing node 69c410bb944faaf0e7f60c36: baseline-arm-clabbe 2026-03-27 16:44:01,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410bb944faaf0e7f60c36 2026-03-27 16:44:01,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:01,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bb944faaf0e7f60c36 HTTP/1.1" 200 None 2026-03-27 16:44:01,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:01,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:44:01,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:01,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410bb944faaf0e7f60c36 HTTP/1.1" 200 None 2026-03-27 16:44:01,599 - lava_callback - ERROR - Error processing callback for node 69c410bb944faaf0e7f60c36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:44:02,216 - lava_callback - INFO - Received callback for node 69c410bf944faaf0e7f60c44 INFO: 172.20.0.1:36782 - "POST /node/69c410bf944faaf0e7f60c44 HTTP/1.0" 202 Accepted 2026-03-27 16:44:02,222 - lava_callback - INFO - Starting async job submit for node 69c410bf944faaf0e7f60c44 2026-03-27 16:44:02,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bf944faaf0e7f60c44 HTTP/1.1" 200 None 2026-03-27 16:44:02,238 - lava_callback - DEBUG - Processing node 69c410bf944faaf0e7f60c44: baseline-arm-clabbe 2026-03-27 16:44:02,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410bf944faaf0e7f60c44 2026-03-27 16:44:02,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410bf944faaf0e7f60c44 HTTP/1.1" 200 None 2026-03-27 16:44:02,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:44:02,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410bf944faaf0e7f60c44 HTTP/1.1" 200 None 2026-03-27 16:44:02,303 - lava_callback - ERROR - Error processing callback for node 69c410bf944faaf0e7f60c44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:44:02,906 - lava_callback - INFO - Received callback for node 69c410c0944faaf0e7f60c47 INFO: 172.20.0.1:36788 - "POST /node/69c410c0944faaf0e7f60c47 HTTP/1.0" 202 Accepted 2026-03-27 16:44:02,911 - lava_callback - INFO - Starting async job submit for node 69c410c0944faaf0e7f60c47 2026-03-27 16:44:02,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c0944faaf0e7f60c47 HTTP/1.1" 200 None 2026-03-27 16:44:02,929 - lava_callback - DEBUG - Processing node 69c410c0944faaf0e7f60c47: baseline-arm-clabbe 2026-03-27 16:44:02,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410c0944faaf0e7f60c47 2026-03-27 16:44:02,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c0944faaf0e7f60c47 HTTP/1.1" 200 None 2026-03-27 16:44:02,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:44:02,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:02,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c0944faaf0e7f60c47 HTTP/1.1" 200 None 2026-03-27 16:44:02,980 - lava_callback - ERROR - Error processing callback for node 69c410c0944faaf0e7f60c47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:44:03,603 - lava_callback - INFO - Received callback for node 69c410c1944faaf0e7f60c4e INFO: 172.20.0.1:36804 - "POST /node/69c410c1944faaf0e7f60c4e HTTP/1.0" 202 Accepted 2026-03-27 16:44:03,611 - lava_callback - INFO - Starting async job submit for node 69c410c1944faaf0e7f60c4e 2026-03-27 16:44:03,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:03,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c4e HTTP/1.1" 200 None 2026-03-27 16:44:03,627 - lava_callback - DEBUG - Processing node 69c410c1944faaf0e7f60c4e: baseline-arm-clabbe 2026-03-27 16:44:03,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410c1944faaf0e7f60c4e 2026-03-27 16:44:03,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:03,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c1944faaf0e7f60c4e HTTP/1.1" 200 None 2026-03-27 16:44:03,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:03,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:44:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:03,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c1944faaf0e7f60c4e HTTP/1.1" 200 None 2026-03-27 16:44:03,712 - lava_callback - ERROR - Error processing callback for node 69c410c1944faaf0e7f60c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:44:04,335 - lava_callback - INFO - Received callback for node 69c410c3944faaf0e7f60c57 INFO: 172.20.0.1:36820 - "POST /node/69c410c3944faaf0e7f60c57 HTTP/1.0" 202 Accepted 2026-03-27 16:44:04,341 - lava_callback - INFO - Starting async job submit for node 69c410c3944faaf0e7f60c57 2026-03-27 16:44:04,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:04,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c3944faaf0e7f60c57 HTTP/1.1" 200 None 2026-03-27 16:44:04,357 - lava_callback - DEBUG - Processing node 69c410c3944faaf0e7f60c57: baseline-arm-clabbe 2026-03-27 16:44:04,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410c3944faaf0e7f60c57 2026-03-27 16:44:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410c3944faaf0e7f60c57 HTTP/1.1" 200 None 2026-03-27 16:44:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:04,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 16:44:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:04,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410c3944faaf0e7f60c57 HTTP/1.1" 200 None 2026-03-27 16:44:04,445 - lava_callback - ERROR - Error processing callback for node 69c410c3944faaf0e7f60c57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:44:10,482 - lava_callback - INFO - Received callback for node 69c6b35902375b4506df89f9 INFO: 172.20.0.1:50802 - "POST /node/69c6b35902375b4506df89f9 HTTP/1.0" 202 Accepted 2026-03-27 16:44:10,491 - lava_callback - INFO - Starting async job submit for node 69c6b35902375b4506df89f9 2026-03-27 16:44:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:10,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b35902375b4506df89f9 HTTP/1.1" 200 None 2026-03-27 16:44:10,546 - lava_callback - DEBUG - Processing node 69c6b35902375b4506df89f9: baseline-arm 2026-03-27 16:44:10,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:44:11,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:44:11,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b35902375b4506df89f9/log.txt.gz 2026-03-27 16:44:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:44:11,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:44:11,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b35902375b4506df89f9/lava-logs.yaml 2026-03-27 16:44:11,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:44:11,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:44:11,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b35902375b4506df89f9/lava_callback.json.gz 2026-03-27 16:44:11,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:11,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b35902375b4506df89f9 HTTP/1.1" 200 None 2026-03-27 16:44:11,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:11,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0a02375b4506df8995 HTTP/1.1" 200 None 2026-03-27 16:44:11,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:11,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b35902375b4506df89f9 HTTP/1.1" 200 None 2026-03-27 16:44:11,911 - lava_callback - INFO - Completed processing callback for node 69c6b35902375b4506df89f9 INFO: 172.20.0.1:50814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:44:28,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:28,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:44:39,489 - lava_callback - INFO - Received callback for node 69c410f5944faaf0e7f60cda INFO: 172.20.0.1:34110 - "POST /node/69c410f5944faaf0e7f60cda HTTP/1.0" 202 Accepted 2026-03-27 16:44:39,494 - lava_callback - INFO - Starting async job submit for node 69c410f5944faaf0e7f60cda 2026-03-27 16:44:39,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:39,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cda HTTP/1.1" 200 None 2026-03-27 16:44:39,510 - lava_callback - DEBUG - Processing node 69c410f5944faaf0e7f60cda: baseline-arm-baylibre 2026-03-27 16:44:39,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c410f5944faaf0e7f60cda 2026-03-27 16:44:39,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:39,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c410f5944faaf0e7f60cda HTTP/1.1" 200 None 2026-03-27 16:44:39,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:39,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:44:39,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:44:39,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c410f5944faaf0e7f60cda HTTP/1.1" 200 None 2026-03-27 16:44:39,573 - lava_callback - ERROR - Error processing callback for node 69c410f5944faaf0e7f60cda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38720 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:45:41,562 - lava_callback - INFO - Received callback for node 69c41124944faaf0e7f60d32 INFO: 172.20.0.1:41774 - "POST /node/69c41124944faaf0e7f60d32 HTTP/1.0" 202 Accepted 2026-03-27 16:45:41,567 - lava_callback - INFO - Starting async job submit for node 69c41124944faaf0e7f60d32 2026-03-27 16:45:41,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:45:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41124944faaf0e7f60d32 HTTP/1.1" 200 None 2026-03-27 16:45:41,583 - lava_callback - DEBUG - Processing node 69c41124944faaf0e7f60d32: baseline-arm-clabbe 2026-03-27 16:45:41,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41124944faaf0e7f60d32 2026-03-27 16:45:41,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:45:41,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41124944faaf0e7f60d32 HTTP/1.1" 200 None 2026-03-27 16:45:41,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:45:41,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:45:41,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:45:41,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41124944faaf0e7f60d32 HTTP/1.1" 200 None 2026-03-27 16:45:41,637 - lava_callback - ERROR - Error processing callback for node 69c41124944faaf0e7f60d32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:46:21,536 - lava_callback - INFO - Received callback for node 69c4114f944faaf0e7f60d4f INFO: 172.20.0.1:59274 - "POST /node/69c4114f944faaf0e7f60d4f HTTP/1.0" 202 Accepted 2026-03-27 16:46:21,542 - lava_callback - INFO - Starting async job submit for node 69c4114f944faaf0e7f60d4f 2026-03-27 16:46:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:46:21,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4114f944faaf0e7f60d4f HTTP/1.1" 200 None 2026-03-27 16:46:21,557 - lava_callback - DEBUG - Processing node 69c4114f944faaf0e7f60d4f: baseline-arm-clabbe 2026-03-27 16:46:21,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4114f944faaf0e7f60d4f 2026-03-27 16:46:21,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:46:21,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4114f944faaf0e7f60d4f HTTP/1.1" 200 None 2026-03-27 16:46:21,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:46:21,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:46:21,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:46:21,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4114f944faaf0e7f60d4f HTTP/1.1" 200 None 2026-03-27 16:46:21,618 - lava_callback - ERROR - Error processing callback for node 69c4114f944faaf0e7f60d4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:47:01,617 - lava_callback - INFO - Received callback for node 69c4117b944faaf0e7f60da2 INFO: 172.20.0.1:39492 - "POST /node/69c4117b944faaf0e7f60da2 HTTP/1.0" 202 Accepted 2026-03-27 16:47:01,622 - lava_callback - INFO - Starting async job submit for node 69c4117b944faaf0e7f60da2 2026-03-27 16:47:01,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:01,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da2 HTTP/1.1" 200 None 2026-03-27 16:47:01,639 - lava_callback - DEBUG - Processing node 69c4117b944faaf0e7f60da2: baseline-arm-clabbe 2026-03-27 16:47:01,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4117b944faaf0e7f60da2 2026-03-27 16:47:01,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:01,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4117b944faaf0e7f60da2 HTTP/1.1" 200 None 2026-03-27 16:47:01,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:01,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:47:01,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:01,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4117b944faaf0e7f60da2 HTTP/1.1" 200 None 2026-03-27 16:47:01,699 - lava_callback - ERROR - Error processing callback for node 69c4117b944faaf0e7f60da2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54726 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:47:39,700 - lava_callback - INFO - Received callback for node 69c4119b944faaf0e7f60e0d INFO: 172.20.0.1:38754 - "POST /node/69c4119b944faaf0e7f60e0d HTTP/1.0" 202 Accepted 2026-03-27 16:47:39,707 - lava_callback - INFO - Starting async job submit for node 69c4119b944faaf0e7f60e0d 2026-03-27 16:47:39,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:39,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119b944faaf0e7f60e0d HTTP/1.1" 200 None 2026-03-27 16:47:39,723 - lava_callback - DEBUG - Processing node 69c4119b944faaf0e7f60e0d: baseline-arm64-baylibre 2026-03-27 16:47:39,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4119b944faaf0e7f60e0d 2026-03-27 16:47:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:39,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119b944faaf0e7f60e0d HTTP/1.1" 200 None 2026-03-27 16:47:39,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:39,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:47:39,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:39,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4119b944faaf0e7f60e0d HTTP/1.1" 200 None 2026-03-27 16:47:39,781 - lava_callback - ERROR - Error processing callback for node 69c4119b944faaf0e7f60e0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:47:40,378 - lava_callback - INFO - Received callback for node 69c4119c944faaf0e7f60e2c INFO: 172.20.0.1:38768 - "POST /node/69c4119c944faaf0e7f60e2c HTTP/1.0" 202 Accepted 2026-03-27 16:47:40,383 - lava_callback - INFO - Starting async job submit for node 69c4119c944faaf0e7f60e2c 2026-03-27 16:47:40,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:40,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119c944faaf0e7f60e2c HTTP/1.1" 200 None 2026-03-27 16:47:40,411 - lava_callback - DEBUG - Processing node 69c4119c944faaf0e7f60e2c: baseline-arm64-baylibre 2026-03-27 16:47:40,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4119c944faaf0e7f60e2c 2026-03-27 16:47:40,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:40,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119c944faaf0e7f60e2c HTTP/1.1" 200 None 2026-03-27 16:47:40,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:40,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:47:40,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:40,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4119c944faaf0e7f60e2c HTTP/1.1" 200 None 2026-03-27 16:47:40,469 - lava_callback - ERROR - Error processing callback for node 69c4119c944faaf0e7f60e2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:47:41,051 - lava_callback - INFO - Received callback for node 69c411a0944faaf0e7f60e36 INFO: 172.20.0.1:38772 - "POST /node/69c411a0944faaf0e7f60e36 HTTP/1.0" 202 Accepted 2026-03-27 16:47:41,057 - lava_callback - INFO - Starting async job submit for node 69c411a0944faaf0e7f60e36 2026-03-27 16:47:41,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a0944faaf0e7f60e36 HTTP/1.1" 200 None 2026-03-27 16:47:41,074 - lava_callback - DEBUG - Processing node 69c411a0944faaf0e7f60e36: baseline-arm64-baylibre 2026-03-27 16:47:41,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411a0944faaf0e7f60e36 2026-03-27 16:47:41,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a0944faaf0e7f60e36 HTTP/1.1" 200 None 2026-03-27 16:47:41,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:47:41,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a0944faaf0e7f60e36 HTTP/1.1" 200 None 2026-03-27 16:47:41,140 - lava_callback - ERROR - Error processing callback for node 69c411a0944faaf0e7f60e36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:47:41,591 - lava_callback - INFO - Received callback for node 69c411a6944faaf0e7f60e3f INFO: 172.20.0.1:38780 - "POST /node/69c411a6944faaf0e7f60e3f HTTP/1.0" 202 Accepted 2026-03-27 16:47:41,597 - lava_callback - INFO - Starting async job submit for node 69c411a6944faaf0e7f60e3f 2026-03-27 16:47:41,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a6944faaf0e7f60e3f HTTP/1.1" 200 None 2026-03-27 16:47:41,614 - lava_callback - DEBUG - Processing node 69c411a6944faaf0e7f60e3f: baseline-arm-clabbe 2026-03-27 16:47:41,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411a6944faaf0e7f60e3f 2026-03-27 16:47:41,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411a6944faaf0e7f60e3f HTTP/1.1" 200 None 2026-03-27 16:47:41,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:47:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411a6944faaf0e7f60e3f HTTP/1.1" 200 None 2026-03-27 16:47:41,678 - lava_callback - ERROR - Error processing callback for node 69c411a6944faaf0e7f60e3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:47:41,773 - lava_callback - INFO - Received callback for node 69c4119e944faaf0e7f60e33 INFO: 172.20.0.1:38796 - "POST /node/69c4119e944faaf0e7f60e33 HTTP/1.0" 202 Accepted 2026-03-27 16:47:41,783 - lava_callback - INFO - Starting async job submit for node 69c4119e944faaf0e7f60e33 2026-03-27 16:47:41,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119e944faaf0e7f60e33 HTTP/1.1" 200 None 2026-03-27 16:47:41,812 - lava_callback - DEBUG - Processing node 69c4119e944faaf0e7f60e33: baseline-arm64-baylibre 2026-03-27 16:47:41,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4119e944faaf0e7f60e33 2026-03-27 16:47:41,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4119e944faaf0e7f60e33 HTTP/1.1" 200 None 2026-03-27 16:47:41,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:47:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:47:41,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4119e944faaf0e7f60e33 HTTP/1.1" 200 None 2026-03-27 16:47:41,872 - lava_callback - ERROR - Error processing callback for node 69c4119e944faaf0e7f60e33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40570 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:48:01,633 - lava_callback - INFO - Received callback for node 69c411b3944faaf0e7f60e61 INFO: 172.20.0.1:51306 - "POST /node/69c411b3944faaf0e7f60e61 HTTP/1.0" 202 Accepted 2026-03-27 16:48:01,638 - lava_callback - INFO - Starting async job submit for node 69c411b3944faaf0e7f60e61 2026-03-27 16:48:01,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:01,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b3944faaf0e7f60e61 HTTP/1.1" 200 None 2026-03-27 16:48:01,655 - lava_callback - DEBUG - Processing node 69c411b3944faaf0e7f60e61: baseline-arm64-clabbe 2026-03-27 16:48:01,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b3944faaf0e7f60e61 2026-03-27 16:48:01,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:01,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b3944faaf0e7f60e61 HTTP/1.1" 200 None 2026-03-27 16:48:01,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:01,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:01,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:01,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b3944faaf0e7f60e61 HTTP/1.1" 200 None 2026-03-27 16:48:01,736 - lava_callback - ERROR - Error processing callback for node 69c411b3944faaf0e7f60e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:48:02,349 - lava_callback - INFO - Received callback for node 69c411b3944faaf0e7f60e64 INFO: 172.20.0.1:51316 - "POST /node/69c411b3944faaf0e7f60e64 HTTP/1.0" 202 Accepted 2026-03-27 16:48:02,355 - lava_callback - INFO - Starting async job submit for node 69c411b3944faaf0e7f60e64 2026-03-27 16:48:02,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:02,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b3944faaf0e7f60e64 HTTP/1.1" 200 None 2026-03-27 16:48:02,372 - lava_callback - DEBUG - Processing node 69c411b3944faaf0e7f60e64: baseline-arm64-clabbe 2026-03-27 16:48:02,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b3944faaf0e7f60e64 2026-03-27 16:48:02,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:02,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b3944faaf0e7f60e64 HTTP/1.1" 200 None 2026-03-27 16:48:02,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:02,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:02,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b3944faaf0e7f60e64 HTTP/1.1" 200 None 2026-03-27 16:48:02,428 - lava_callback - ERROR - Error processing callback for node 69c411b3944faaf0e7f60e64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:48:03,065 - lava_callback - INFO - Received callback for node 69c411b4944faaf0e7f60e67 INFO: 172.20.0.1:51322 - "POST /node/69c411b4944faaf0e7f60e67 HTTP/1.0" 202 Accepted 2026-03-27 16:48:03,070 - lava_callback - INFO - Starting async job submit for node 69c411b4944faaf0e7f60e67 2026-03-27 16:48:03,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b4944faaf0e7f60e67 HTTP/1.1" 200 None 2026-03-27 16:48:03,086 - lava_callback - DEBUG - Processing node 69c411b4944faaf0e7f60e67: baseline-arm64-clabbe 2026-03-27 16:48:03,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b4944faaf0e7f60e67 2026-03-27 16:48:03,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b4944faaf0e7f60e67 HTTP/1.1" 200 None 2026-03-27 16:48:03,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:03,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b4944faaf0e7f60e67 HTTP/1.1" 200 None 2026-03-27 16:48:03,143 - lava_callback - ERROR - Error processing callback for node 69c411b4944faaf0e7f60e67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:48:03,745 - lava_callback - INFO - Received callback for node 69c411b5944faaf0e7f60e6a INFO: 172.20.0.1:51326 - "POST /node/69c411b5944faaf0e7f60e6a HTTP/1.0" 202 Accepted 2026-03-27 16:48:03,751 - lava_callback - INFO - Starting async job submit for node 69c411b5944faaf0e7f60e6a 2026-03-27 16:48:03,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b5944faaf0e7f60e6a HTTP/1.1" 200 None 2026-03-27 16:48:03,767 - lava_callback - DEBUG - Processing node 69c411b5944faaf0e7f60e6a: baseline-arm64-clabbe 2026-03-27 16:48:03,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b5944faaf0e7f60e6a 2026-03-27 16:48:03,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b5944faaf0e7f60e6a HTTP/1.1" 200 None 2026-03-27 16:48:03,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:03,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:03,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b5944faaf0e7f60e6a HTTP/1.1" 200 None 2026-03-27 16:48:03,862 - lava_callback - ERROR - Error processing callback for node 69c411b5944faaf0e7f60e6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:48:04,436 - lava_callback - INFO - Received callback for node 69c411b7944faaf0e7f60e70 INFO: 172.20.0.1:51330 - "POST /node/69c411b7944faaf0e7f60e70 HTTP/1.0" 202 Accepted 2026-03-27 16:48:04,442 - lava_callback - INFO - Starting async job submit for node 69c411b7944faaf0e7f60e70 2026-03-27 16:48:04,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:04,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b7944faaf0e7f60e70 HTTP/1.1" 200 None 2026-03-27 16:48:04,458 - lava_callback - DEBUG - Processing node 69c411b7944faaf0e7f60e70: baseline-arm64-clabbe 2026-03-27 16:48:04,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b7944faaf0e7f60e70 2026-03-27 16:48:04,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:04,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b7944faaf0e7f60e70 HTTP/1.1" 200 None 2026-03-27 16:48:04,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:04,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:04,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:04,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b7944faaf0e7f60e70 HTTP/1.1" 200 None 2026-03-27 16:48:04,515 - lava_callback - ERROR - Error processing callback for node 69c411b7944faaf0e7f60e70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 16:48:05,125 - lava_callback - INFO - Received callback for node 69c411b8944faaf0e7f60e73 INFO: 172.20.0.1:51334 - "POST /node/69c411b8944faaf0e7f60e73 HTTP/1.0" 202 Accepted 2026-03-27 16:48:05,131 - lava_callback - INFO - Starting async job submit for node 69c411b8944faaf0e7f60e73 2026-03-27 16:48:05,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:05,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b8944faaf0e7f60e73 HTTP/1.1" 200 None 2026-03-27 16:48:05,147 - lava_callback - DEBUG - Processing node 69c411b8944faaf0e7f60e73: baseline-arm64-clabbe 2026-03-27 16:48:05,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411b8944faaf0e7f60e73 2026-03-27 16:48:05,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:05,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411b8944faaf0e7f60e73 HTTP/1.1" 200 None 2026-03-27 16:48:05,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:05,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 16:48:05,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:05,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411b8944faaf0e7f60e73 HTTP/1.1" 200 None 2026-03-27 16:48:05,212 - lava_callback - ERROR - Error processing callback for node 69c411b8944faaf0e7f60e73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:48:21,679 - lava_callback - INFO - Received callback for node 69c411d1944faaf0e7f60eaa INFO: 172.20.0.1:40968 - "POST /node/69c411d1944faaf0e7f60eaa HTTP/1.0" 202 Accepted 2026-03-27 16:48:21,685 - lava_callback - INFO - Starting async job submit for node 69c411d1944faaf0e7f60eaa 2026-03-27 16:48:21,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:21,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411d1944faaf0e7f60eaa HTTP/1.1" 200 None 2026-03-27 16:48:21,701 - lava_callback - DEBUG - Processing node 69c411d1944faaf0e7f60eaa: baseline-arm-clabbe 2026-03-27 16:48:21,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c411d1944faaf0e7f60eaa 2026-03-27 16:48:21,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:21,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c411d1944faaf0e7f60eaa HTTP/1.1" 200 None 2026-03-27 16:48:21,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:21,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 16:48:21,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:48:21,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c411d1944faaf0e7f60eaa HTTP/1.1" 200 None 2026-03-27 16:48:21,773 - lava_callback - ERROR - Error processing callback for node 69c411d1944faaf0e7f60eaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45356 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:49:21,738 - lava_callback - INFO - Received callback for node 69c4120b944faaf0e7f60f3c INFO: 172.20.0.1:55540 - "POST /node/69c4120b944faaf0e7f60f3c HTTP/1.0" 202 Accepted 2026-03-27 16:49:21,747 - lava_callback - INFO - Starting async job submit for node 69c4120b944faaf0e7f60f3c 2026-03-27 16:49:21,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:49:21,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4120b944faaf0e7f60f3c HTTP/1.1" 200 None 2026-03-27 16:49:21,764 - lava_callback - DEBUG - Processing node 69c4120b944faaf0e7f60f3c: baseline-arm64-clabbe 2026-03-27 16:49:21,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4120b944faaf0e7f60f3c 2026-03-27 16:49:21,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:49:21,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4120b944faaf0e7f60f3c HTTP/1.1" 200 None 2026-03-27 16:49:21,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:49:21,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:49:21,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:49:21,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4120b944faaf0e7f60f3c HTTP/1.1" 200 None 2026-03-27 16:49:21,821 - lava_callback - ERROR - Error processing callback for node 69c4120b944faaf0e7f60f3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:51:01,831 - lava_callback - INFO - Received callback for node 69c4125f944faaf0e7f60f9c INFO: 172.20.0.1:57340 - "POST /node/69c4125f944faaf0e7f60f9c HTTP/1.0" 202 Accepted 2026-03-27 16:51:01,836 - lava_callback - INFO - Starting async job submit for node 69c4125f944faaf0e7f60f9c 2026-03-27 16:51:01,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:51:01,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4125f944faaf0e7f60f9c HTTP/1.1" 200 None 2026-03-27 16:51:01,852 - lava_callback - DEBUG - Processing node 69c4125f944faaf0e7f60f9c: baseline-arm64-clabbe 2026-03-27 16:51:01,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4125f944faaf0e7f60f9c 2026-03-27 16:51:01,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:51:01,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4125f944faaf0e7f60f9c HTTP/1.1" 200 None 2026-03-27 16:51:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:51:01,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:51:01,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:51:01,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4125f944faaf0e7f60f9c HTTP/1.1" 200 None 2026-03-27 16:51:01,910 - lava_callback - ERROR - Error processing callback for node 69c4125f944faaf0e7f60f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38592 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:53:19,276 - lava_callback - INFO - Received callback for node 69c6b5f702375b4506df8b5b INFO: 172.20.0.1:38602 - "POST /node/69c6b5f702375b4506df8b5b HTTP/1.0" 202 Accepted 2026-03-27 16:53:19,282 - lava_callback - INFO - Starting async job submit for node 69c6b5f702375b4506df8b5b 2026-03-27 16:53:19,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:19,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f702375b4506df8b5b HTTP/1.1" 200 None 2026-03-27 16:53:19,307 - lava_callback - DEBUG - Processing node 69c6b5f702375b4506df8b5b: baseline-nfs-arm64 2026-03-27 16:53:19,308 - lava_callback - WARNING - Failed to upload log 2026-03-27 16:53:19,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:19,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:19,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f702375b4506df8b5b/lava-logs.yaml 2026-03-27 16:53:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:19,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:19,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f702375b4506df8b5b/lava_callback.json.gz 2026-03-27 16:53:19,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:19,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f702375b4506df8b5b HTTP/1.1" 200 None 2026-03-27 16:53:19,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:19,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:19,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f702375b4506df8b5b HTTP/1.1" 200 None 2026-03-27 16:53:19,659 - lava_callback - INFO - Completed processing callback for node 69c6b5f702375b4506df8b5b 2026-03-27 16:53:24,404 - lava_callback - INFO - Received callback for node 69c6b5db02375b4506df8afc INFO: 172.20.0.1:41566 - "POST /node/69c6b5db02375b4506df8afc HTTP/1.0" 202 Accepted 2026-03-27 16:53:24,411 - lava_callback - INFO - Starting async job submit for node 69c6b5db02375b4506df8afc 2026-03-27 16:53:24,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5db02375b4506df8afc HTTP/1.1" 200 None 2026-03-27 16:53:24,448 - lava_callback - DEBUG - Processing node 69c6b5db02375b4506df8afc: baseline-arm64 2026-03-27 16:53:24,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:24,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:24,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8afc/log.txt.gz 2026-03-27 16:53:24,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:25,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:25,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8afc/lava-logs.yaml 2026-03-27 16:53:25,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:25,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:25,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8afc/lava_callback.json.gz 2026-03-27 16:53:25,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:25,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5db02375b4506df8afc HTTP/1.1" 200 None 2026-03-27 16:53:25,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:25,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:25,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5db02375b4506df8afc HTTP/1.1" 200 None 2026-03-27 16:53:25,410 - lava_callback - INFO - Completed processing callback for node 69c6b5db02375b4506df8afc INFO: 172.20.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:53:28,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:29,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 16:53:35,452 - lava_callback - INFO - Received callback for node 69c6b5e702375b4506df8b31 INFO: 172.20.0.1:35636 - "POST /node/69c6b5e702375b4506df8b31 HTTP/1.0" 202 Accepted 2026-03-27 16:53:35,458 - lava_callback - INFO - Starting async job submit for node 69c6b5e702375b4506df8b31 2026-03-27 16:53:35,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:35,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e702375b4506df8b31 HTTP/1.1" 200 None 2026-03-27 16:53:35,491 - lava_callback - DEBUG - Processing node 69c6b5e702375b4506df8b31: baseline-arm64 2026-03-27 16:53:35,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:35,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:35,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e702375b4506df8b31/log.txt.gz 2026-03-27 16:53:35,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:36,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:36,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e702375b4506df8b31/lava-logs.yaml 2026-03-27 16:53:36,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:36,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:36,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e702375b4506df8b31/lava_callback.json.gz 2026-03-27 16:53:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:36,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e702375b4506df8b31 HTTP/1.1" 200 None 2026-03-27 16:53:36,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:36,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:36,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:36,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e702375b4506df8b31 HTTP/1.1" 200 None 2026-03-27 16:53:36,419 - lava_callback - INFO - Completed processing callback for node 69c6b5e702375b4506df8b31 INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:53:44,051 - lava_callback - INFO - Received callback for node 69c6b5de02375b4506df8b09 INFO: 172.20.0.1:59836 - "POST /node/69c6b5de02375b4506df8b09 HTTP/1.0" 202 Accepted 2026-03-27 16:53:44,058 - lava_callback - INFO - Starting async job submit for node 69c6b5de02375b4506df8b09 2026-03-27 16:53:44,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:44,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5de02375b4506df8b09 HTTP/1.1" 200 None 2026-03-27 16:53:44,108 - lava_callback - DEBUG - Processing node 69c6b5de02375b4506df8b09: baseline-arm64 2026-03-27 16:53:44,268 - lava_callback - WARNING - Failed to upload log 2026-03-27 16:53:44,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:44,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:44,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5de02375b4506df8b09/lava-logs.yaml 2026-03-27 16:53:44,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:44,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:44,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5de02375b4506df8b09/lava_callback.json.gz 2026-03-27 16:53:44,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:44,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5de02375b4506df8b09 HTTP/1.1" 200 None 2026-03-27 16:53:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:44,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:44,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:44,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5de02375b4506df8b09 HTTP/1.1" 200 None 2026-03-27 16:53:44,822 - lava_callback - INFO - Completed processing callback for node 69c6b5de02375b4506df8b09 2026-03-27 16:53:45,712 - lava_callback - INFO - Received callback for node 69c6b5e002375b4506df8b0c INFO: 172.20.0.1:59850 - "POST /node/69c6b5e002375b4506df8b0c HTTP/1.0" 202 Accepted 2026-03-27 16:53:45,719 - lava_callback - INFO - Starting async job submit for node 69c6b5e002375b4506df8b0c 2026-03-27 16:53:45,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:45,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e002375b4506df8b0c HTTP/1.1" 200 None 2026-03-27 16:53:45,824 - lava_callback - DEBUG - Processing node 69c6b5e002375b4506df8b0c: baseline-arm64 2026-03-27 16:53:46,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:46,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:46,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e002375b4506df8b0c/log.txt.gz 2026-03-27 16:53:46,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:46,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:46,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e002375b4506df8b0c/lava-logs.yaml 2026-03-27 16:53:46,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:53:46,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:46,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e002375b4506df8b0c/lava_callback.json.gz 2026-03-27 16:53:46,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e002375b4506df8b0c HTTP/1.1" 200 None 2026-03-27 16:53:46,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:46,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e002375b4506df8b0c HTTP/1.1" 200 None 2026-03-27 16:53:46,878 - lava_callback - INFO - Completed processing callback for node 69c6b5e002375b4506df8b0c 2026-03-27 16:53:49,627 - lava_callback - INFO - Received callback for node 69c6b5dc02375b4506df8b02 INFO: 172.20.0.1:59864 - "POST /node/69c6b5dc02375b4506df8b02 HTTP/1.0" 202 Accepted 2026-03-27 16:53:49,634 - lava_callback - INFO - Starting async job submit for node 69c6b5dc02375b4506df8b02 2026-03-27 16:53:49,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5dc02375b4506df8b02 HTTP/1.1" 200 None 2026-03-27 16:53:49,672 - lava_callback - DEBUG - Processing node 69c6b5dc02375b4506df8b02: baseline-arm64 2026-03-27 16:53:49,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:50,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:50,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dc02375b4506df8b02/log.txt.gz 2026-03-27 16:53:50,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:50,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:50,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dc02375b4506df8b02/lava-logs.yaml 2026-03-27 16:53:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:50,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:50,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dc02375b4506df8b02/lava_callback.json.gz 2026-03-27 16:53:50,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:50,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5dc02375b4506df8b02 HTTP/1.1" 200 None 2026-03-27 16:53:50,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:50,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:50,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:50,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5dc02375b4506df8b02 HTTP/1.1" 200 None 2026-03-27 16:53:50,758 - lava_callback - INFO - Completed processing callback for node 69c6b5dc02375b4506df8b02 2026-03-27 16:53:55,158 - lava_callback - INFO - Received callback for node 69c6b5ec02375b4506df8b40 INFO: 172.20.0.1:40704 - "POST /node/69c6b5ec02375b4506df8b40 HTTP/1.0" 202 Accepted 2026-03-27 16:53:55,164 - lava_callback - INFO - Starting async job submit for node 69c6b5ec02375b4506df8b40 2026-03-27 16:53:55,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:55,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ec02375b4506df8b40 HTTP/1.1" 200 None 2026-03-27 16:53:55,204 - lava_callback - DEBUG - Processing node 69c6b5ec02375b4506df8b40: baseline-arm64 2026-03-27 16:53:55,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:55,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:55,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ec02375b4506df8b40/log.txt.gz 2026-03-27 16:53:55,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:56,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:56,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ec02375b4506df8b40/lava-logs.yaml 2026-03-27 16:53:56,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:53:56,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:53:56,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ec02375b4506df8b40/lava_callback.json.gz 2026-03-27 16:53:56,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:56,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ec02375b4506df8b40 HTTP/1.1" 200 None 2026-03-27 16:53:56,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:56,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:53:56,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:56,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5ec02375b4506df8b40 HTTP/1.1" 200 None 2026-03-27 16:53:56,285 - lava_callback - INFO - Completed processing callback for node 69c6b5ec02375b4506df8b40 INFO: 172.20.0.1:40718 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:53:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:53:59,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-27 16:54:06,096 - lava_callback - INFO - Received callback for node 69c6b5e802375b4506df8b34 INFO: 172.20.0.1:34898 - "POST /node/69c6b5e802375b4506df8b34 HTTP/1.0" 202 Accepted 2026-03-27 16:54:06,106 - lava_callback - INFO - Starting async job submit for node 69c6b5e802375b4506df8b34 2026-03-27 16:54:06,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:06,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e802375b4506df8b34 HTTP/1.1" 200 None 2026-03-27 16:54:06,171 - lava_callback - DEBUG - Processing node 69c6b5e802375b4506df8b34: baseline-arm64 2026-03-27 16:54:06,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34910 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:06,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:06,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e802375b4506df8b34/log.txt.gz 2026-03-27 16:54:06,680 - lava_callback - INFO - Received callback for node 69c6b5e302375b4506df8b15 2026-03-27 16:54:06,706 - lava_callback - INFO - Starting async job submit for node 69c6b5e302375b4506df8b15 INFO: 172.20.0.1:34920 - "POST /node/69c6b5e302375b4506df8b15 HTTP/1.0" 202 Accepted 2026-03-27 16:54:06,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:06,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:06,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e302375b4506df8b15 HTTP/1.1" 200 None 2026-03-27 16:54:06,824 - lava_callback - DEBUG - Processing node 69c6b5e302375b4506df8b15: baseline-arm64 2026-03-27 16:54:07,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:07,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e802375b4506df8b34/lava-logs.yaml 2026-03-27 16:54:07,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:07,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:07,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:07,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e802375b4506df8b34/lava_callback.json.gz 2026-03-27 16:54:07,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:07,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:07,416 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e302375b4506df8b15/log.txt.gz 2026-03-27 16:54:07,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e802375b4506df8b34 HTTP/1.1" 200 None 2026-03-27 16:54:07,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:07,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:07,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:07,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e802375b4506df8b34 HTTP/1.1" 200 None 2026-03-27 16:54:07,656 - lava_callback - INFO - Completed processing callback for node 69c6b5e802375b4506df8b34 2026-03-27 16:54:07,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:07,949 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e302375b4506df8b15/lava-logs.yaml 2026-03-27 16:54:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:08,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:08,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e302375b4506df8b15/lava_callback.json.gz 2026-03-27 16:54:08,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:08,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e302375b4506df8b15 HTTP/1.1" 200 None 2026-03-27 16:54:08,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:08,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:08,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e302375b4506df8b15 HTTP/1.1" 200 None 2026-03-27 16:54:08,215 - lava_callback - INFO - Completed processing callback for node 69c6b5e302375b4506df8b15 2026-03-27 16:54:09,916 - lava_callback - INFO - Received callback for node 69c6b5e402375b4506df8b2b INFO: 172.20.0.1:59510 - "POST /node/69c6b5e402375b4506df8b2b HTTP/1.0" 202 Accepted 2026-03-27 16:54:09,923 - lava_callback - INFO - Starting async job submit for node 69c6b5e402375b4506df8b2b 2026-03-27 16:54:09,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:09,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e402375b4506df8b2b HTTP/1.1" 200 None 2026-03-27 16:54:09,982 - lava_callback - DEBUG - Processing node 69c6b5e402375b4506df8b2b: baseline-arm64 2026-03-27 16:54:10,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:10,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:10,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e402375b4506df8b2b/log.txt.gz 2026-03-27 16:54:10,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:10,973 - lava_callback - INFO - Received callback for node 69c6b5e602375b4506df8b2e INFO: 172.20.0.1:59512 - "POST /node/69c6b5e602375b4506df8b2e HTTP/1.0" 202 Accepted 2026-03-27 16:54:10,984 - lava_callback - INFO - Starting async job submit for node 69c6b5e602375b4506df8b2e 2026-03-27 16:54:11,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:11,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e602375b4506df8b2e HTTP/1.1" 200 None 2026-03-27 16:54:11,044 - lava_callback - DEBUG - Processing node 69c6b5e602375b4506df8b2e: baseline-arm64 2026-03-27 16:54:11,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:11,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e402375b4506df8b2b/lava-logs.yaml 2026-03-27 16:54:11,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:11,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:11,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:11,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e402375b4506df8b2b/lava_callback.json.gz 2026-03-27 16:54:11,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:11,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:11,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e602375b4506df8b2e/log.txt.gz 2026-03-27 16:54:11,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e402375b4506df8b2b HTTP/1.1" 200 None 2026-03-27 16:54:11,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:11,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:11,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e402375b4506df8b2b HTTP/1.1" 200 None 2026-03-27 16:54:12,110 - lava_callback - INFO - Completed processing callback for node 69c6b5e402375b4506df8b2b 2026-03-27 16:54:12,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:12,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:12,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e602375b4506df8b2e/lava-logs.yaml 2026-03-27 16:54:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:12,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:12,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e602375b4506df8b2e/lava_callback.json.gz 2026-03-27 16:54:12,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:12,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e602375b4506df8b2e HTTP/1.1" 200 None 2026-03-27 16:54:12,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:12,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:12,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:12,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e602375b4506df8b2e HTTP/1.1" 200 None 2026-03-27 16:54:12,714 - lava_callback - INFO - Completed processing callback for node 69c6b5e602375b4506df8b2e 2026-03-27 16:54:13,767 - lava_callback - INFO - Received callback for node 69c6b5e202375b4506df8b12 INFO: 172.20.0.1:59522 - "POST /node/69c6b5e202375b4506df8b12 HTTP/1.0" 202 Accepted 2026-03-27 16:54:13,777 - lava_callback - INFO - Starting async job submit for node 69c6b5e202375b4506df8b12 2026-03-27 16:54:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:13,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e202375b4506df8b12 HTTP/1.1" 200 None 2026-03-27 16:54:13,835 - lava_callback - DEBUG - Processing node 69c6b5e202375b4506df8b12: baseline-arm64 2026-03-27 16:54:14,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:14,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:14,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e202375b4506df8b12/log.txt.gz 2026-03-27 16:54:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:14,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:14,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e202375b4506df8b12/lava-logs.yaml 2026-03-27 16:54:14,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:14,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:14,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e202375b4506df8b12/lava_callback.json.gz 2026-03-27 16:54:14,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e202375b4506df8b12 HTTP/1.1" 200 None 2026-03-27 16:54:14,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:14,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:14,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:14,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e202375b4506df8b12 HTTP/1.1" 200 None 2026-03-27 16:54:14,933 - lava_callback - INFO - Completed processing callback for node 69c6b5e202375b4506df8b12 INFO: 172.20.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:18,242 - lava_callback - INFO - Received callback for node 69c6b5db02375b4506df8aff INFO: 172.20.0.1:59556 - "POST /node/69c6b5db02375b4506df8aff HTTP/1.0" 202 Accepted 2026-03-27 16:54:18,248 - lava_callback - INFO - Starting async job submit for node 69c6b5db02375b4506df8aff 2026-03-27 16:54:18,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:18,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5db02375b4506df8aff HTTP/1.1" 200 None 2026-03-27 16:54:18,300 - lava_callback - DEBUG - Processing node 69c6b5db02375b4506df8aff: baseline-arm64 2026-03-27 16:54:18,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:18,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:18,703 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8aff/log.txt.gz 2026-03-27 16:54:18,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:19,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:19,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8aff/lava-logs.yaml 2026-03-27 16:54:19,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:19,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:19,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5db02375b4506df8aff/lava_callback.json.gz 2026-03-27 16:54:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:19,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5db02375b4506df8aff HTTP/1.1" 200 None 2026-03-27 16:54:19,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:19,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:19,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:19,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5db02375b4506df8aff HTTP/1.1" 200 None 2026-03-27 16:54:19,277 - lava_callback - INFO - Completed processing callback for node 69c6b5db02375b4506df8aff INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:26,557 - lava_callback - INFO - Received callback for node 69c6b5f502375b4506df8b55 INFO: 172.20.0.1:33458 - "POST /node/69c6b5f502375b4506df8b55 HTTP/1.0" 202 Accepted 2026-03-27 16:54:26,565 - lava_callback - INFO - Starting async job submit for node 69c6b5f502375b4506df8b55 2026-03-27 16:54:26,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:26,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f502375b4506df8b55 HTTP/1.1" 200 None 2026-03-27 16:54:26,612 - lava_callback - DEBUG - Processing node 69c6b5f502375b4506df8b55: baseline-nfs-arm64 2026-03-27 16:54:27,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:27,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:27,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f502375b4506df8b55/log.txt.gz 2026-03-27 16:54:27,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:27,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:27,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f502375b4506df8b55/lava-logs.yaml 2026-03-27 16:54:27,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33468 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:28,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:28,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f502375b4506df8b55/lava_callback.json.gz 2026-03-27 16:54:28,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:28,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f502375b4506df8b55 HTTP/1.1" 200 None 2026-03-27 16:54:28,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:28,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:28,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:28,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f502375b4506df8b55 HTTP/1.1" 200 None 2026-03-27 16:54:28,152 - lava_callback - INFO - Completed processing callback for node 69c6b5f502375b4506df8b55 2026-03-27 16:54:28,438 - lava_callback - INFO - Received callback for node 69c6b5dd02375b4506df8b06 INFO: 172.20.0.1:33472 - "POST /node/69c6b5dd02375b4506df8b06 HTTP/1.0" 202 Accepted 2026-03-27 16:54:28,448 - lava_callback - INFO - Starting async job submit for node 69c6b5dd02375b4506df8b06 2026-03-27 16:54:28,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:28,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5dd02375b4506df8b06 HTTP/1.1" 200 None 2026-03-27 16:54:28,488 - lava_callback - DEBUG - Processing node 69c6b5dd02375b4506df8b06: baseline-arm64 2026-03-27 16:54:28,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:28,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:28,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dd02375b4506df8b06/log.txt.gz 2026-03-27 16:54:29,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:29,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-27 16:54:29,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:29,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dd02375b4506df8b06/lava-logs.yaml 2026-03-27 16:54:29,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:29,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:29,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5dd02375b4506df8b06/lava_callback.json.gz 2026-03-27 16:54:29,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:29,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5dd02375b4506df8b06 HTTP/1.1" 200 None 2026-03-27 16:54:29,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:29,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:29,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5dd02375b4506df8b06 HTTP/1.1" 200 None 2026-03-27 16:54:29,415 - lava_callback - INFO - Completed processing callback for node 69c6b5dd02375b4506df8b06 INFO: 172.20.0.1:55462 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:37,629 - lava_callback - INFO - Received callback for node 69c6b5fc02375b4506df8b67 INFO: 172.20.0.1:55464 - "POST /node/69c6b5fc02375b4506df8b67 HTTP/1.0" 202 Accepted 2026-03-27 16:54:37,638 - lava_callback - INFO - Starting async job submit for node 69c6b5fc02375b4506df8b67 2026-03-27 16:54:37,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:37,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fc02375b4506df8b67 HTTP/1.1" 200 None 2026-03-27 16:54:37,685 - lava_callback - DEBUG - Processing node 69c6b5fc02375b4506df8b67: baseline-nfs-arm64 2026-03-27 16:54:37,712 - lava_callback - INFO - Received callback for node 69c6b5eb02375b4506df8b3d INFO: 172.20.0.1:55478 - "POST /node/69c6b5eb02375b4506df8b3d HTTP/1.0" 202 Accepted 2026-03-27 16:54:37,739 - lava_callback - INFO - Starting async job submit for node 69c6b5eb02375b4506df8b3d 2026-03-27 16:54:37,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:37,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5eb02375b4506df8b3d HTTP/1.1" 200 None 2026-03-27 16:54:37,906 - lava_callback - DEBUG - Processing node 69c6b5eb02375b4506df8b3d: baseline-arm64 2026-03-27 16:54:38,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:38,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:38,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:38,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5eb02375b4506df8b3d/log.txt.gz 2026-03-27 16:54:38,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:38,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fc02375b4506df8b67/log.txt.gz 2026-03-27 16:54:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:38,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:39,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:39,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5eb02375b4506df8b3d/lava-logs.yaml 2026-03-27 16:54:39,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:39,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:39,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fc02375b4506df8b67/lava-logs.yaml 2026-03-27 16:54:39,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:39,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:39,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5eb02375b4506df8b3d/lava_callback.json.gz 2026-03-27 16:54:39,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5eb02375b4506df8b3d HTTP/1.1" 200 None 2026-03-27 16:54:39,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:39,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fc02375b4506df8b67/lava_callback.json.gz 2026-03-27 16:54:39,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:39,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fc02375b4506df8b67 HTTP/1.1" 200 None 2026-03-27 16:54:39,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5eb02375b4506df8b3d HTTP/1.1" 200 None 2026-03-27 16:54:39,369 - lava_callback - INFO - Completed processing callback for node 69c6b5eb02375b4506df8b3d 2026-03-27 16:54:39,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:39,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:39,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5fc02375b4506df8b67 HTTP/1.1" 200 None 2026-03-27 16:54:39,477 - lava_callback - INFO - Completed processing callback for node 69c6b5fc02375b4506df8b67 2026-03-27 16:54:44,192 - lava_callback - INFO - Received callback for node 69c6b61f02375b4506df8bed INFO: 172.20.0.1:41894 - "POST /node/69c6b61f02375b4506df8bed HTTP/1.0" 202 Accepted 2026-03-27 16:54:44,199 - lava_callback - INFO - Starting async job submit for node 69c6b61f02375b4506df8bed 2026-03-27 16:54:44,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:44,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61f02375b4506df8bed HTTP/1.1" 200 None 2026-03-27 16:54:44,236 - lava_callback - DEBUG - Processing node 69c6b61f02375b4506df8bed: baseline-arm64-pengutronix 2026-03-27 16:54:44,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:44,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:44,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b61f02375b4506df8bed/log.txt.gz 2026-03-27 16:54:44,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:44,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:44,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b61f02375b4506df8bed/lava-logs.yaml 2026-03-27 16:54:44,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:45,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:45,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b61f02375b4506df8bed/lava_callback.json.gz 2026-03-27 16:54:45,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:45,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61f02375b4506df8bed HTTP/1.1" 200 None 2026-03-27 16:54:45,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:45,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:45,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:45,089 - lava_callback - INFO - Received callback for node 69c6b5ed02375b4506df8b43 INFO: 172.20.0.1:41906 - "POST /node/69c6b5ed02375b4506df8b43 HTTP/1.0" 202 Accepted 2026-03-27 16:54:45,096 - lava_callback - INFO - Starting async job submit for node 69c6b5ed02375b4506df8b43 2026-03-27 16:54:45,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:45,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61f02375b4506df8bed HTTP/1.1" 200 None 2026-03-27 16:54:45,142 - lava_callback - INFO - Completed processing callback for node 69c6b61f02375b4506df8bed 2026-03-27 16:54:45,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ed02375b4506df8b43 HTTP/1.1" 200 None 2026-03-27 16:54:45,174 - lava_callback - DEBUG - Processing node 69c6b5ed02375b4506df8b43: baseline-arm64 2026-03-27 16:54:45,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:45,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:45,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ed02375b4506df8b43/log.txt.gz 2026-03-27 16:54:46,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:46,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:46,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ed02375b4506df8b43/lava-logs.yaml 2026-03-27 16:54:46,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:46,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:46,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ed02375b4506df8b43/lava_callback.json.gz 2026-03-27 16:54:46,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:46,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ed02375b4506df8b43 HTTP/1.1" 200 None 2026-03-27 16:54:46,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:46,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:46,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:46,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5ed02375b4506df8b43 HTTP/1.1" 200 None 2026-03-27 16:54:46,637 - lava_callback - INFO - Completed processing callback for node 69c6b5ed02375b4506df8b43 2026-03-27 16:54:47,250 - lava_callback - INFO - Received callback for node 69c6b5f602375b4506df8b58 INFO: 172.20.0.1:41930 - "POST /node/69c6b5f602375b4506df8b58 HTTP/1.0" 202 Accepted 2026-03-27 16:54:47,258 - lava_callback - INFO - Starting async job submit for node 69c6b5f602375b4506df8b58 2026-03-27 16:54:47,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:47,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f602375b4506df8b58 HTTP/1.1" 200 None 2026-03-27 16:54:47,316 - lava_callback - DEBUG - Processing node 69c6b5f602375b4506df8b58: baseline-nfs-arm64 2026-03-27 16:54:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:48,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:48,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f602375b4506df8b58/log.txt.gz 2026-03-27 16:54:48,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:48,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:48,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f602375b4506df8b58/lava-logs.yaml 2026-03-27 16:54:48,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:48,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:48,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f602375b4506df8b58/lava_callback.json.gz 2026-03-27 16:54:49,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:49,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f602375b4506df8b58 HTTP/1.1" 200 None 2026-03-27 16:54:49,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:49,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:49,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:49,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f602375b4506df8b58 HTTP/1.1" 200 None 2026-03-27 16:54:49,070 - lava_callback - INFO - Completed processing callback for node 69c6b5f602375b4506df8b58 2026-03-27 16:54:51,303 - lava_callback - INFO - Received callback for node 69c6b60902375b4506df8bb1 INFO: 172.20.0.1:47162 - "POST /node/69c6b60902375b4506df8bb1 HTTP/1.0" 202 Accepted 2026-03-27 16:54:51,309 - lava_callback - INFO - Starting async job submit for node 69c6b60902375b4506df8bb1 2026-03-27 16:54:51,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:51,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60902375b4506df8bb1 HTTP/1.1" 200 None 2026-03-27 16:54:51,373 - lava_callback - DEBUG - Processing node 69c6b60902375b4506df8bb1: baseline-arm64-broonie 2026-03-27 16:54:51,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:51,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:51,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60902375b4506df8bb1/log.txt.gz 2026-03-27 16:54:51,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:52,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:52,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60902375b4506df8bb1/lava-logs.yaml 2026-03-27 16:54:52,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:52,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:52,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60902375b4506df8bb1/lava_callback.json.gz 2026-03-27 16:54:52,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:52,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60902375b4506df8bb1 HTTP/1.1" 200 None 2026-03-27 16:54:52,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:52,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:52,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:52,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b60902375b4506df8bb1 HTTP/1.1" 200 None 2026-03-27 16:54:52,278 - lava_callback - INFO - Completed processing callback for node 69c6b60902375b4506df8bb1 2026-03-27 16:54:53,957 - lava_callback - INFO - Received callback for node 69c6b62002375b4506df8c07 INFO: 172.20.0.1:47178 - "POST /node/69c6b62002375b4506df8c07 HTTP/1.0" 202 Accepted 2026-03-27 16:54:53,963 - lava_callback - INFO - Starting async job submit for node 69c6b62002375b4506df8c07 2026-03-27 16:54:53,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:54,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62002375b4506df8c07 HTTP/1.1" 200 None 2026-03-27 16:54:54,008 - lava_callback - DEBUG - Processing node 69c6b62002375b4506df8c07: baseline-arm64-pengutronix 2026-03-27 16:54:54,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:54,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:54,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62002375b4506df8c07/log.txt.gz 2026-03-27 16:54:54,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:54,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:54,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62002375b4506df8c07/lava-logs.yaml 2026-03-27 16:54:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:54,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:54,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62002375b4506df8c07/lava_callback.json.gz 2026-03-27 16:54:55,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:55,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62002375b4506df8c07 HTTP/1.1" 200 None 2026-03-27 16:54:55,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:55,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:55,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:55,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b62002375b4506df8c07 HTTP/1.1" 200 None 2026-03-27 16:54:55,078 - lava_callback - INFO - Completed processing callback for node 69c6b62002375b4506df8c07 INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:54:56,708 - lava_callback - INFO - Received callback for node 69c6b62402375b4506df8c11 INFO: 172.20.0.1:47206 - "POST /node/69c6b62402375b4506df8c11 HTTP/1.0" 202 Accepted 2026-03-27 16:54:56,714 - lava_callback - INFO - Starting async job submit for node 69c6b62402375b4506df8c11 2026-03-27 16:54:56,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:56,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62402375b4506df8c11 HTTP/1.1" 200 None 2026-03-27 16:54:56,753 - lava_callback - DEBUG - Processing node 69c6b62402375b4506df8c11: baseline-arm64-foundriesio 2026-03-27 16:54:56,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:57,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:57,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62402375b4506df8c11/log.txt.gz 2026-03-27 16:54:57,156 - lava_callback - INFO - Received callback for node 69c6b5fb02375b4506df8b64 INFO: 172.20.0.1:47222 - "POST /node/69c6b5fb02375b4506df8b64 HTTP/1.0" 202 Accepted 2026-03-27 16:54:57,183 - lava_callback - INFO - Starting async job submit for node 69c6b5fb02375b4506df8b64 2026-03-27 16:54:57,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:57,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:57,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fb02375b4506df8b64 HTTP/1.1" 200 None 2026-03-27 16:54:57,277 - lava_callback - DEBUG - Processing node 69c6b5fb02375b4506df8b64: baseline-nfs-arm64 2026-03-27 16:54:57,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:57,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62402375b4506df8c11/lava-logs.yaml 2026-03-27 16:54:57,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:57,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:57,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:57,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:57,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fb02375b4506df8b64/log.txt.gz 2026-03-27 16:54:57,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62402375b4506df8c11/lava_callback.json.gz 2026-03-27 16:54:57,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:57,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62402375b4506df8c11 HTTP/1.1" 200 None 2026-03-27 16:54:57,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:58,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:58,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:58,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b62402375b4506df8c11 HTTP/1.1" 200 None 2026-03-27 16:54:58,071 - lava_callback - INFO - Completed processing callback for node 69c6b62402375b4506df8c11 2026-03-27 16:54:58,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:58,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fb02375b4506df8b64/lava-logs.yaml 2026-03-27 16:54:58,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:54:58,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:54:58,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fb02375b4506df8b64/lava_callback.json.gz 2026-03-27 16:54:58,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:58,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fb02375b4506df8b64 HTTP/1.1" 200 None 2026-03-27 16:54:58,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:58,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:54:58,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5fb02375b4506df8b64 HTTP/1.1" 200 None 2026-03-27 16:54:58,590 - lava_callback - INFO - Completed processing callback for node 69c6b5fb02375b4506df8b64 2026-03-27 16:54:59,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:54:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-27 16:55:01,580 - lava_callback - INFO - Received callback for node 69c6b5f202375b4506df8b4f INFO: 172.20.0.1:32782 - "POST /node/69c6b5f202375b4506df8b4f HTTP/1.0" 202 Accepted 2026-03-27 16:55:01,586 - lava_callback - INFO - Starting async job submit for node 69c6b5f202375b4506df8b4f 2026-03-27 16:55:01,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:01,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f202375b4506df8b4f HTTP/1.1" 200 None 2026-03-27 16:55:01,625 - lava_callback - DEBUG - Processing node 69c6b5f202375b4506df8b4f: baseline-nfs-arm64 2026-03-27 16:55:01,961 - lava_callback - INFO - Received callback for node 69c6b5f802375b4506df8b5e INFO: 172.20.0.1:32792 - "POST /node/69c6b5f802375b4506df8b5e HTTP/1.0" 202 Accepted 2026-03-27 16:55:01,981 - lava_callback - INFO - Starting async job submit for node 69c6b5f802375b4506df8b5e 2026-03-27 16:55:02,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:02,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:02,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f802375b4506df8b5e HTTP/1.1" 200 None 2026-03-27 16:55:02,117 - lava_callback - DEBUG - Processing node 69c6b5f802375b4506df8b5e: baseline-nfs-arm64 2026-03-27 16:55:02,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:02,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f202375b4506df8b4f/log.txt.gz 2026-03-27 16:55:02,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:03,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:03,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:03,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f802375b4506df8b5e/log.txt.gz 2026-03-27 16:55:03,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:03,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:03,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f202375b4506df8b4f/lava-logs.yaml 2026-03-27 16:55:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:03,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:03,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f202375b4506df8b4f/lava_callback.json.gz 2026-03-27 16:55:03,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:04,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f802375b4506df8b5e/lava-logs.yaml 2026-03-27 16:55:04,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:04,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f202375b4506df8b4f HTTP/1.1" 200 None 2026-03-27 16:55:04,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:04,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f202375b4506df8b4f HTTP/1.1" 200 None 2026-03-27 16:55:04,111 - lava_callback - INFO - Completed processing callback for node 69c6b5f202375b4506df8b4f 2026-03-27 16:55:04,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:04,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f802375b4506df8b5e/lava_callback.json.gz 2026-03-27 16:55:04,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f802375b4506df8b5e HTTP/1.1" 200 None 2026-03-27 16:55:04,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:04,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:04,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f802375b4506df8b5e HTTP/1.1" 200 None 2026-03-27 16:55:04,584 - lava_callback - INFO - Completed processing callback for node 69c6b5f802375b4506df8b5e INFO: 172.20.0.1:32794 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:55:10,808 - lava_callback - INFO - Received callback for node 69c6b61102375b4506df8bc4 INFO: 172.20.0.1:41790 - "POST /node/69c6b61102375b4506df8bc4 HTTP/1.0" 202 Accepted 2026-03-27 16:55:10,817 - lava_callback - INFO - Starting async job submit for node 69c6b61102375b4506df8bc4 2026-03-27 16:55:10,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:10,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61102375b4506df8bc4 HTTP/1.1" 200 None 2026-03-27 16:55:10,896 - lava_callback - DEBUG - Processing node 69c6b61102375b4506df8bc4: baseline-arm64-broonie 2026-03-27 16:55:11,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:11,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:11,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61102375b4506df8bc4/log.txt.gz 2026-03-27 16:55:11,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:12,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:12,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61102375b4506df8bc4/lava-logs.yaml 2026-03-27 16:55:12,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:12,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:12,550 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61102375b4506df8bc4/lava_callback.json.gz 2026-03-27 16:55:12,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:12,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61102375b4506df8bc4 HTTP/1.1" 200 None 2026-03-27 16:55:12,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:12,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:12,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:12,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61102375b4506df8bc4 HTTP/1.1" 200 None 2026-03-27 16:55:12,711 - lava_callback - INFO - Completed processing callback for node 69c6b61102375b4506df8bc4 2026-03-27 16:55:13,726 - lava_callback - INFO - Received callback for node 69c6b5fd02375b4506df8b6a INFO: 172.20.0.1:41800 - "POST /node/69c6b5fd02375b4506df8b6a HTTP/1.0" 202 Accepted 2026-03-27 16:55:13,736 - lava_callback - INFO - Starting async job submit for node 69c6b5fd02375b4506df8b6a 2026-03-27 16:55:13,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:13,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fd02375b4506df8b6a HTTP/1.1" 200 None 2026-03-27 16:55:13,831 - lava_callback - DEBUG - Processing node 69c6b5fd02375b4506df8b6a: baseline-nfs-arm64 2026-03-27 16:55:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:14,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:14,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fd02375b4506df8b6a/log.txt.gz INFO: 172.20.0.1:41812 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 16:55:15,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:15,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:15,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fd02375b4506df8b6a/lava-logs.yaml 2026-03-27 16:55:15,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:16,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:16,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fd02375b4506df8b6a/lava_callback.json.gz 2026-03-27 16:55:16,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:16,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fd02375b4506df8b6a HTTP/1.1" 200 None 2026-03-27 16:55:16,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:16,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:16,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:16,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5fd02375b4506df8b6a HTTP/1.1" 200 None 2026-03-27 16:55:16,492 - lava_callback - INFO - Completed processing callback for node 69c6b5fd02375b4506df8b6a INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:55:19,996 - lava_callback - INFO - Received callback for node 69c6b60d02375b4506df8bb7 INFO: 172.20.0.1:59614 - "POST /node/69c6b60d02375b4506df8bb7 HTTP/1.0" 202 Accepted 2026-03-27 16:55:20,009 - lava_callback - INFO - Starting async job submit for node 69c6b60d02375b4506df8bb7 2026-03-27 16:55:20,022 - lava_callback - INFO - Received callback for node 69c6b5f002375b4506df8b49 INFO: 172.20.0.1:59630 - "POST /node/69c6b5f002375b4506df8b49 HTTP/1.0" 202 Accepted 2026-03-27 16:55:20,048 - lava_callback - INFO - Starting async job submit for node 69c6b5f002375b4506df8b49 2026-03-27 16:55:20,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:20,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:20,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60d02375b4506df8bb7 HTTP/1.1" 200 None 2026-03-27 16:55:20,129 - lava_callback - DEBUG - Processing node 69c6b60d02375b4506df8bb7: baseline-arm64-broonie 2026-03-27 16:55:20,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f002375b4506df8b49 HTTP/1.1" 200 None 2026-03-27 16:55:20,212 - lava_callback - DEBUG - Processing node 69c6b5f002375b4506df8b49: baseline-nfs-arm64 2026-03-27 16:55:21,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:21,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:21,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:21,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60d02375b4506df8bb7/log.txt.gz 2026-03-27 16:55:21,446 - lava_callback - INFO - Received callback for node 69c6b60e02375b4506df8bba 2026-03-27 16:55:21,466 - lava_callback - INFO - Starting async job submit for node 69c6b60e02375b4506df8bba INFO: 172.20.0.1:59644 - "POST /node/69c6b60e02375b4506df8bba HTTP/1.0" 202 Accepted 2026-03-27 16:55:21,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:21,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:21,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f002375b4506df8b49/log.txt.gz 2026-03-27 16:55:21,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60e02375b4506df8bba HTTP/1.1" 200 None 2026-03-27 16:55:21,725 - lava_callback - DEBUG - Processing node 69c6b60e02375b4506df8bba: baseline-arm64-broonie 2026-03-27 16:55:22,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:22,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:22,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:23,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:23,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60d02375b4506df8bb7/lava-logs.yaml 2026-03-27 16:55:23,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:23,111 - lava_callback - INFO - Received callback for node 69c6b61502375b4506df8bca 2026-03-27 16:55:23,122 - lava_callback - INFO - Starting async job submit for node 69c6b61502375b4506df8bca INFO: 172.20.0.1:59646 - "POST /node/69c6b61502375b4506df8bca HTTP/1.0" 202 Accepted 2026-03-27 16:55:23,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:23,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:23,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60e02375b4506df8bba/log.txt.gz 2026-03-27 16:55:23,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61502375b4506df8bca HTTP/1.1" 200 None 2026-03-27 16:55:23,226 - lava_callback - DEBUG - Processing node 69c6b61502375b4506df8bca: baseline-arm64-broonie 2026-03-27 16:55:23,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:23,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f002375b4506df8b49/lava-logs.yaml 2026-03-27 16:55:23,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:23,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:23,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60d02375b4506df8bb7/lava_callback.json.gz 2026-03-27 16:55:23,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:23,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:23,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60d02375b4506df8bb7 HTTP/1.1" 200 None 2026-03-27 16:55:23,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:23,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:23,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:24,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b60d02375b4506df8bb7 HTTP/1.1" 200 None 2026-03-27 16:55:24,066 - lava_callback - INFO - Completed processing callback for node 69c6b60d02375b4506df8bb7 2026-03-27 16:55:24,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:24,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f002375b4506df8b49/lava_callback.json.gz 2026-03-27 16:55:24,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:24,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:24,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f002375b4506df8b49 HTTP/1.1" 200 None 2026-03-27 16:55:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:24,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f002375b4506df8b49 HTTP/1.1" 200 None 2026-03-27 16:55:24,402 - lava_callback - INFO - Completed processing callback for node 69c6b5f002375b4506df8b49 2026-03-27 16:55:24,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:24,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61502375b4506df8bca/log.txt.gz 2026-03-27 16:55:24,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:24,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60e02375b4506df8bba/lava-logs.yaml 2026-03-27 16:55:25,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:25,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:25,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:25,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60e02375b4506df8bba/lava_callback.json.gz 2026-03-27 16:55:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:25,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:25,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61502375b4506df8bca/lava-logs.yaml 2026-03-27 16:55:25,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60e02375b4506df8bba HTTP/1.1" 200 None 2026-03-27 16:55:25,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:25,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:25,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b60e02375b4506df8bba HTTP/1.1" 200 None 2026-03-27 16:55:25,563 - lava_callback - INFO - Completed processing callback for node 69c6b60e02375b4506df8bba 2026-03-27 16:55:25,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:25,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61502375b4506df8bca/lava_callback.json.gz 2026-03-27 16:55:25,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:26,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61502375b4506df8bca HTTP/1.1" 200 None 2026-03-27 16:55:26,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:26,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:26,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:26,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61502375b4506df8bca HTTP/1.1" 200 None 2026-03-27 16:55:26,073 - lava_callback - INFO - Completed processing callback for node 69c6b61502375b4506df8bca INFO: 172.20.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:55:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:29,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:55:40,042 - lava_callback - INFO - Received callback for node 69c6b61302375b4506df8bc7 INFO: 172.20.0.1:43570 - "POST /node/69c6b61302375b4506df8bc7 HTTP/1.0" 202 Accepted 2026-03-27 16:55:40,053 - lava_callback - INFO - Starting async job submit for node 69c6b61302375b4506df8bc7 2026-03-27 16:55:40,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:40,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61302375b4506df8bc7 HTTP/1.1" 200 None 2026-03-27 16:55:40,128 - lava_callback - DEBUG - Processing node 69c6b61302375b4506df8bc7: baseline-arm64-broonie 2026-03-27 16:55:40,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:40,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:40,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61302375b4506df8bc7/log.txt.gz 2026-03-27 16:55:41,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:41,685 - lava_callback - INFO - Received callback for node 69c6b61602375b4506df8bcd INFO: 172.20.0.1:43584 - "POST /node/69c6b61602375b4506df8bcd HTTP/1.0" 202 Accepted 2026-03-27 16:55:41,695 - lava_callback - INFO - Starting async job submit for node 69c6b61602375b4506df8bcd 2026-03-27 16:55:41,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:41,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61602375b4506df8bcd HTTP/1.1" 200 None 2026-03-27 16:55:41,767 - lava_callback - DEBUG - Processing node 69c6b61602375b4506df8bcd: baseline-arm64-broonie 2026-03-27 16:55:41,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:41,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61302375b4506df8bc7/lava-logs.yaml 2026-03-27 16:55:41,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:42,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:42,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:42,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61302375b4506df8bc7/lava_callback.json.gz 2026-03-27 16:55:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:42,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61302375b4506df8bc7 HTTP/1.1" 200 None 2026-03-27 16:55:42,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:42,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:42,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:42,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61302375b4506df8bc7 HTTP/1.1" 200 None 2026-03-27 16:55:42,581 - lava_callback - INFO - Completed processing callback for node 69c6b61302375b4506df8bc7 2026-03-27 16:55:42,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:42,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61602375b4506df8bcd/log.txt.gz 2026-03-27 16:55:43,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:43,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:43,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61602375b4506df8bcd/lava-logs.yaml 2026-03-27 16:55:43,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:55:44,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:55:44,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61602375b4506df8bcd/lava_callback.json.gz 2026-03-27 16:55:44,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:44,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61602375b4506df8bcd HTTP/1.1" 200 None 2026-03-27 16:55:44,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:44,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:55:44,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61602375b4506df8bcd HTTP/1.1" 200 None 2026-03-27 16:55:44,270 - lava_callback - INFO - Completed processing callback for node 69c6b61602375b4506df8bcd INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:55:59,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:55:59,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:56:30,875 - lava_callback - INFO - Received callback for node 69c6b60b02375b4506df8bb4 INFO: 172.20.0.1:43364 - "POST /node/69c6b60b02375b4506df8bb4 HTTP/1.0" 202 Accepted 2026-03-27 16:56:30,882 - lava_callback - INFO - Starting async job submit for node 69c6b60b02375b4506df8bb4 2026-03-27 16:56:30,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:30,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60b02375b4506df8bb4 HTTP/1.1" 200 None 2026-03-27 16:56:30,942 - lava_callback - DEBUG - Processing node 69c6b60b02375b4506df8bb4: baseline-arm64-broonie 2026-03-27 16:56:31,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:31,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:31,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60b02375b4506df8bb4/log.txt.gz 2026-03-27 16:56:31,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:31,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:31,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60b02375b4506df8bb4/lava-logs.yaml 2026-03-27 16:56:31,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:32,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:32,170 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b60b02375b4506df8bb4/lava_callback.json.gz 2026-03-27 16:56:32,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:32,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b60b02375b4506df8bb4 HTTP/1.1" 200 None 2026-03-27 16:56:32,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:32,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:56:32,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:32,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b60b02375b4506df8bb4 HTTP/1.1" 200 None 2026-03-27 16:56:32,283 - lava_callback - INFO - Completed processing callback for node 69c6b60b02375b4506df8bb4 INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:56:39,832 - lava_callback - INFO - Received callback for node 69c6b5e102375b4506df8b0f INFO: 172.20.0.1:37134 - "POST /node/69c6b5e102375b4506df8b0f HTTP/1.0" 202 Accepted 2026-03-27 16:56:39,840 - lava_callback - INFO - Starting async job submit for node 69c6b5e102375b4506df8b0f 2026-03-27 16:56:39,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:39,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e102375b4506df8b0f HTTP/1.1" 200 None 2026-03-27 16:56:39,880 - lava_callback - DEBUG - Processing node 69c6b5e102375b4506df8b0f: baseline-arm64 2026-03-27 16:56:40,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:40,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:40,523 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e102375b4506df8b0f/log.txt.gz 2026-03-27 16:56:40,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:40,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:40,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e102375b4506df8b0f/lava-logs.yaml 2026-03-27 16:56:40,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:56:41,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:56:41,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e102375b4506df8b0f/lava_callback.json.gz 2026-03-27 16:56:41,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:41,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e102375b4506df8b0f HTTP/1.1" 200 None 2026-03-27 16:56:41,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:41,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:56:41,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:41,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e102375b4506df8b0f HTTP/1.1" 200 None 2026-03-27 16:56:41,238 - lava_callback - INFO - Completed processing callback for node 69c6b5e102375b4506df8b0f INFO: 172.20.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60840 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:56:59,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:56:59,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 16:57:02,306 - lava_callback - INFO - Received callback for node 69c413da944faaf0e7f61030 INFO: 172.20.0.1:60194 - "POST /node/69c413da944faaf0e7f61030 HTTP/1.0" 202 Accepted 2026-03-27 16:57:02,315 - lava_callback - INFO - Starting async job submit for node 69c413da944faaf0e7f61030 2026-03-27 16:57:02,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:02,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c413da944faaf0e7f61030 HTTP/1.1" 200 None 2026-03-27 16:57:02,343 - lava_callback - DEBUG - Processing node 69c413da944faaf0e7f61030: baseline-arm64-clabbe 2026-03-27 16:57:02,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c413da944faaf0e7f61030 2026-03-27 16:57:02,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:02,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c413da944faaf0e7f61030 HTTP/1.1" 200 None 2026-03-27 16:57:02,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:02,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:57:02,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:02,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c413da944faaf0e7f61030 HTTP/1.1" 200 None 2026-03-27 16:57:02,409 - lava_callback - ERROR - Error processing callback for node 69c413da944faaf0e7f61030: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60200 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:57:07,566 - lava_callback - INFO - Received callback for node 69c6b5f102375b4506df8b4c INFO: 172.20.0.1:60208 - "POST /node/69c6b5f102375b4506df8b4c HTTP/1.0" 202 Accepted 2026-03-27 16:57:07,574 - lava_callback - INFO - Starting async job submit for node 69c6b5f102375b4506df8b4c 2026-03-27 16:57:07,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:07,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f102375b4506df8b4c HTTP/1.1" 200 None 2026-03-27 16:57:07,631 - lava_callback - DEBUG - Processing node 69c6b5f102375b4506df8b4c: baseline-nfs-arm64 2026-03-27 16:57:08,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:08,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:08,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f102375b4506df8b4c/log.txt.gz 2026-03-27 16:57:08,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:09,900 - lava_callback - INFO - Received callback for node 69c6b62702375b4506df8c20 INFO: 172.20.0.1:35066 - "POST /node/69c6b62702375b4506df8c20 HTTP/1.0" 202 Accepted 2026-03-27 16:57:09,909 - lava_callback - INFO - Starting async job submit for node 69c6b62702375b4506df8c20 2026-03-27 16:57:09,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:09,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62702375b4506df8c20 HTTP/1.1" 200 None 2026-03-27 16:57:09,973 - lava_callback - DEBUG - Processing node 69c6b62702375b4506df8c20: baseline-arm64-foundriesio 2026-03-27 16:57:10,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:10,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f102375b4506df8b4c/lava-logs.yaml 2026-03-27 16:57:10,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:10,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:10,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f102375b4506df8b4c/lava_callback.json.gz 2026-03-27 16:57:10,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:10,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f102375b4506df8b4c HTTP/1.1" 200 None 2026-03-27 16:57:10,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:10,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:57:10,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:11,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f102375b4506df8b4c HTTP/1.1" 200 None 2026-03-27 16:57:11,077 - lava_callback - INFO - Completed processing callback for node 69c6b5f102375b4506df8b4c 2026-03-27 16:57:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:11,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:11,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62702375b4506df8c20/log.txt.gz 2026-03-27 16:57:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:12,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:12,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62702375b4506df8c20/lava-logs.yaml 2026-03-27 16:57:12,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:12,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:12,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6b62702375b4506df8c20/lava_callback.json.gz DEBUG: 69c6b62702375b4506df8c20 Transitting job node result: pass -> incomplete 2026-03-27 16:57:12,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:12,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62702375b4506df8c20 HTTP/1.1" 200 None 2026-03-27 16:57:12,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:12,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:57:12,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:12,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b62702375b4506df8c20 HTTP/1.1" 200 None 2026-03-27 16:57:12,620 - lava_callback - INFO - Completed processing callback for node 69c6b62702375b4506df8c20 INFO: 172.20.0.1:35070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:57:29,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:29,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 16:57:31,175 - lava_callback - INFO - Received callback for node 69c6b61002375b4506df8bbd INFO: 172.20.0.1:53286 - "POST /node/69c6b61002375b4506df8bbd HTTP/1.0" 202 Accepted 2026-03-27 16:57:31,183 - lava_callback - INFO - Starting async job submit for node 69c6b61002375b4506df8bbd 2026-03-27 16:57:31,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:31,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61002375b4506df8bbd HTTP/1.1" 200 None 2026-03-27 16:57:31,231 - lava_callback - DEBUG - Processing node 69c6b61002375b4506df8bbd: baseline-arm64-broonie 2026-03-27 16:57:31,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:31,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:31,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61002375b4506df8bbd/log.txt.gz 2026-03-27 16:57:31,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:32,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:32,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61002375b4506df8bbd/lava-logs.yaml 2026-03-27 16:57:32,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:57:32,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:57:32,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c6b61002375b4506df8bbd/lava_callback.json.gz 2026-03-27 16:57:32,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:32,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61002375b4506df8bbd HTTP/1.1" 200 None 2026-03-27 16:57:32,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:32,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:57:32,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:32,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61002375b4506df8bbd HTTP/1.1" 200 None 2026-03-27 16:57:32,413 - lava_callback - INFO - Completed processing callback for node 69c6b61002375b4506df8bbd INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56518 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:57:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:57:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45850 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:58:32,499 - lava_callback - INFO - Received callback for node 69c6b62202375b4506df8c0a INFO: 172.20.0.1:55526 - "POST /node/69c6b62202375b4506df8c0a HTTP/1.0" 202 Accepted 2026-03-27 16:58:32,507 - lava_callback - INFO - Starting async job submit for node 69c6b62202375b4506df8c0a 2026-03-27 16:58:32,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:32,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62202375b4506df8c0a HTTP/1.1" 200 None 2026-03-27 16:58:32,548 - lava_callback - DEBUG - Processing node 69c6b62202375b4506df8c0a: baseline-arm64-pengutronix 2026-03-27 16:58:32,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:58:33,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:58:33,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62202375b4506df8c0a/log.txt.gz 2026-03-27 16:58:33,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:58:33,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:58:33,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62202375b4506df8c0a/lava-logs.yaml 2026-03-27 16:58:33,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 16:58:33,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 16:58:33,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c6b62202375b4506df8c0a/lava_callback.json.gz 2026-03-27 16:58:33,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:33,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b62202375b4506df8c0a HTTP/1.1" 200 None 2026-03-27 16:58:33,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:33,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 16:58:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:33,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b62202375b4506df8c0a HTTP/1.1" 200 None 2026-03-27 16:58:33,821 - lava_callback - INFO - Completed processing callback for node 69c6b62202375b4506df8c0a INFO: 172.20.0.1:55542 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:58:42,012 - lava_callback - INFO - Received callback for node 69c4142e944faaf0e7f61041 INFO: 172.20.0.1:34620 - "POST /node/69c4142e944faaf0e7f61041 HTTP/1.0" 202 Accepted 2026-03-27 16:58:42,022 - lava_callback - INFO - Starting async job submit for node 69c4142e944faaf0e7f61041 2026-03-27 16:58:42,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:42,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4142e944faaf0e7f61041 HTTP/1.1" 200 None 2026-03-27 16:58:42,042 - lava_callback - DEBUG - Processing node 69c4142e944faaf0e7f61041: baseline-arm64-clabbe 2026-03-27 16:58:42,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4142e944faaf0e7f61041 2026-03-27 16:58:42,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:42,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4142e944faaf0e7f61041 HTTP/1.1" 200 None 2026-03-27 16:58:42,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:42,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 16:58:42,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:42,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4142e944faaf0e7f61041 HTTP/1.1" 200 None 2026-03-27 16:58:42,124 - lava_callback - ERROR - Error processing callback for node 69c4142e944faaf0e7f61041: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47396 - "GET / HTTP/1.0" 200 OK 2026-03-27 16:58:59,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 16:58:59,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:01:51,442 - lava_callback - INFO - Received callback for node 69c6b35a02375b4506df89fc INFO: 172.20.0.1:47246 - "POST /node/69c6b35a02375b4506df89fc HTTP/1.0" 202 Accepted 2026-03-27 17:01:51,449 - lava_callback - INFO - Starting async job submit for node 69c6b35a02375b4506df89fc 2026-03-27 17:01:51,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:01:51,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b35a02375b4506df89fc HTTP/1.1" 200 None 2026-03-27 17:01:51,567 - lava_callback - DEBUG - Processing node 69c6b35a02375b4506df89fc: ltp-smoke 2026-03-27 17:01:52,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:01:52,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:01:52,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b35a02375b4506df89fc/log.txt.gz 2026-03-27 17:01:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:01:53,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:01:53,512 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b35a02375b4506df89fc/lava-logs.yaml 2026-03-27 17:01:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:01:54,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:01:54,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b35a02375b4506df89fc/lava_callback.json.gz 2026-03-27 17:01:54,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:01:54,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b35a02375b4506df89fc HTTP/1.1" 200 None 2026-03-27 17:01:54,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:01:54,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0a02375b4506df8995 HTTP/1.1" 200 None 2026-03-27 17:01:54,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:01:54,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b35a02375b4506df89fc HTTP/1.1" 200 None 2026-03-27 17:01:54,441 - lava_callback - INFO - Completed processing callback for node 69c6b35a02375b4506df89fc INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:01:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:01:59,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37126 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:02:18,781 - lava_callback - INFO - Received callback for node 69c6b61b02375b4506df8be0 INFO: 172.20.0.1:37128 - "POST /node/69c6b61b02375b4506df8be0 HTTP/1.0" 202 Accepted 2026-03-27 17:02:18,795 - lava_callback - INFO - Starting async job submit for node 69c6b61b02375b4506df8be0 2026-03-27 17:02:18,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:18,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61b02375b4506df8be0 HTTP/1.1" 200 None 2026-03-27 17:02:18,891 - lava_callback - DEBUG - Processing node 69c6b61b02375b4506df8be0: baseline-arm64-clabbe 2026-03-27 17:02:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:19,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:19,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c6b61b02375b4506df8be0/log.txt.gz 2026-03-27 17:02:20,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:20,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:20,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c6b61b02375b4506df8be0/lava-logs.yaml 2026-03-27 17:02:20,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:21,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:21,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c6b61b02375b4506df8be0/lava_callback.json.gz 2026-03-27 17:02:21,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:21,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b61b02375b4506df8be0 HTTP/1.1" 200 None 2026-03-27 17:02:21,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:21,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:02:21,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:21,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b61b02375b4506df8be0 HTTP/1.1" 200 None 2026-03-27 17:02:21,237 - lava_callback - INFO - Completed processing callback for node 69c6b61b02375b4506df8be0 INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:02:29,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:29,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:02:32,719 - lava_callback - INFO - Received callback for node 69c6b80a02375b4506dfb437 INFO: 172.20.0.1:37728 - "POST /node/69c6b80a02375b4506dfb437 HTTP/1.0" 202 Accepted 2026-03-27 17:02:32,728 - lava_callback - INFO - Starting async job submit for node 69c6b80a02375b4506dfb437 2026-03-27 17:02:32,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:32,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80a02375b4506dfb437 HTTP/1.1" 200 None 2026-03-27 17:02:32,789 - lava_callback - DEBUG - Processing node 69c6b80a02375b4506dfb437: baseline-x86 2026-03-27 17:02:33,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:33,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:33,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80a02375b4506dfb437/log.txt.gz 2026-03-27 17:02:33,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:34,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:34,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80a02375b4506dfb437/lava-logs.yaml 2026-03-27 17:02:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:34,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:34,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80a02375b4506dfb437/lava_callback.json.gz 2026-03-27 17:02:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:34,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80a02375b4506dfb437 HTTP/1.1" 200 None 2026-03-27 17:02:34,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:34,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae2f02375b4506df89b7 HTTP/1.1" 200 None 2026-03-27 17:02:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:34,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b80a02375b4506dfb437 HTTP/1.1" 200 None 2026-03-27 17:02:34,358 - lava_callback - INFO - Completed processing callback for node 69c6b80a02375b4506dfb437 INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:02:42,298 - lava_callback - INFO - Received callback for node 69c6b80d02375b4506dfb440 INFO: 172.20.0.1:37038 - "POST /node/69c6b80d02375b4506dfb440 HTTP/1.0" 202 Accepted 2026-03-27 17:02:42,307 - lava_callback - INFO - Starting async job submit for node 69c6b80d02375b4506dfb440 2026-03-27 17:02:42,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:42,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80d02375b4506dfb440 HTTP/1.1" 200 None 2026-03-27 17:02:42,359 - lava_callback - DEBUG - Processing node 69c6b80d02375b4506dfb440: baseline-x86 2026-03-27 17:02:42,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:42,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:42,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80d02375b4506dfb440/log.txt.gz 2026-03-27 17:02:43,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:43,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:43,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80d02375b4506dfb440/lava-logs.yaml 2026-03-27 17:02:43,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:02:43,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:02:43,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80d02375b4506dfb440/lava_callback.json.gz 2026-03-27 17:02:43,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:43,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80d02375b4506dfb440 HTTP/1.1" 200 None 2026-03-27 17:02:43,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:43,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae2f02375b4506df89b7 HTTP/1.1" 200 None 2026-03-27 17:02:43,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:44,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b80d02375b4506dfb440 HTTP/1.1" 200 None 2026-03-27 17:02:44,032 - lava_callback - INFO - Completed processing callback for node 69c6b80d02375b4506dfb440 INFO: 172.20.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:02:59,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:02:59,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:03:06,766 - lava_callback - INFO - Received callback for node 69c6b83702375b4506dfb475 INFO: 172.20.0.1:39118 - "POST /node/69c6b83702375b4506dfb475 HTTP/1.0" 202 Accepted 2026-03-27 17:03:06,772 - lava_callback - INFO - Starting async job submit for node 69c6b83702375b4506dfb475 2026-03-27 17:03:06,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:06,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83702375b4506dfb475 HTTP/1.1" 200 None 2026-03-27 17:03:06,790 - lava_callback - DEBUG - Processing node 69c6b83702375b4506dfb475: baseline-arm 2026-03-27 17:03:06,795 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:03:06,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:06,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:06,947 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83702375b4506dfb475/lava-logs.yaml 2026-03-27 17:03:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:07,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:07,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83702375b4506dfb475/lava_callback.json.gz 2026-03-27 17:03:07,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83702375b4506dfb475 HTTP/1.1" 200 None 2026-03-27 17:03:07,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:07,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:03:07,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83702375b4506dfb475 HTTP/1.1" 200 None 2026-03-27 17:03:07,168 - lava_callback - INFO - Completed processing callback for node 69c6b83702375b4506dfb475 INFO: 172.20.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:03:17,604 - lava_callback - INFO - Received callback for node 69c6b83802375b4506dfb478 INFO: 172.20.0.1:43374 - "POST /node/69c6b83802375b4506dfb478 HTTP/1.0" 202 Accepted 2026-03-27 17:03:17,654 - lava_callback - INFO - Starting async job submit for node 69c6b83802375b4506dfb478 2026-03-27 17:03:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:17,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83802375b4506dfb478 HTTP/1.1" 200 None 2026-03-27 17:03:17,689 - lava_callback - DEBUG - Processing node 69c6b83802375b4506dfb478: baseline-arm 2026-03-27 17:03:17,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:17,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:17,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83802375b4506dfb478/log.txt.gz 2026-03-27 17:03:18,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:18,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:18,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83802375b4506dfb478/lava-logs.yaml 2026-03-27 17:03:18,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:18,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:18,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83802375b4506dfb478/lava_callback.json.gz 2026-03-27 17:03:18,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:18,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83802375b4506dfb478 HTTP/1.1" 200 None 2026-03-27 17:03:18,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:18,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:03:18,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:18,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83802375b4506dfb478 HTTP/1.1" 200 None 2026-03-27 17:03:18,488 - lava_callback - INFO - Completed processing callback for node 69c6b83802375b4506dfb478 2026-03-27 17:03:23,535 - lava_callback - INFO - Received callback for node 69c6b80c02375b4506dfb43d INFO: 172.20.0.1:41462 - "POST /node/69c6b80c02375b4506dfb43d HTTP/1.0" 202 Accepted 2026-03-27 17:03:23,541 - lava_callback - INFO - Starting async job submit for node 69c6b80c02375b4506dfb43d 2026-03-27 17:03:23,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:23,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80c02375b4506dfb43d HTTP/1.1" 200 None 2026-03-27 17:03:23,574 - lava_callback - DEBUG - Processing node 69c6b80c02375b4506dfb43d: baseline-x86 2026-03-27 17:03:23,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:24,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:24,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80c02375b4506dfb43d/log.txt.gz 2026-03-27 17:03:24,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:24,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:24,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80c02375b4506dfb43d/lava-logs.yaml 2026-03-27 17:03:24,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:24,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:24,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80c02375b4506dfb43d/lava_callback.json.gz 2026-03-27 17:03:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:24,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80c02375b4506dfb43d HTTP/1.1" 200 None 2026-03-27 17:03:24,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:24,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae2f02375b4506df89b7 HTTP/1.1" 200 None 2026-03-27 17:03:24,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:24,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b80c02375b4506dfb43d HTTP/1.1" 200 None 2026-03-27 17:03:24,696 - lava_callback - INFO - Completed processing callback for node 69c6b80c02375b4506dfb43d INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:03:29,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:29,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:03:32,835 - lava_callback - INFO - Received callback for node 69c6b83b02375b4506dfb481 INFO: 172.20.0.1:35462 - "POST /node/69c6b83b02375b4506dfb481 HTTP/1.0" 202 Accepted 2026-03-27 17:03:32,881 - lava_callback - INFO - Starting async job submit for node 69c6b83b02375b4506dfb481 2026-03-27 17:03:32,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:32,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83b02375b4506dfb481 HTTP/1.1" 200 None 2026-03-27 17:03:32,914 - lava_callback - DEBUG - Processing node 69c6b83b02375b4506dfb481: baseline-arm 2026-03-27 17:03:33,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:33,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:33,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83b02375b4506dfb481/log.txt.gz 2026-03-27 17:03:33,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:33,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:33,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83b02375b4506dfb481/lava-logs.yaml 2026-03-27 17:03:33,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:33,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:33,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83b02375b4506dfb481/lava_callback.json.gz 2026-03-27 17:03:33,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:33,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83b02375b4506dfb481 HTTP/1.1" 200 None 2026-03-27 17:03:33,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:33,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:03:33,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:33,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83b02375b4506dfb481 HTTP/1.1" 200 None 2026-03-27 17:03:33,580 - lava_callback - INFO - Completed processing callback for node 69c6b83b02375b4506dfb481 INFO: 172.20.0.1:35468 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:03:41,337 - lava_callback - INFO - Received callback for node 69c6b80b02375b4506dfb43a INFO: 172.20.0.1:44102 - "POST /node/69c6b80b02375b4506dfb43a HTTP/1.0" 202 Accepted 2026-03-27 17:03:41,344 - lava_callback - INFO - Starting async job submit for node 69c6b80b02375b4506dfb43a 2026-03-27 17:03:41,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:41,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80b02375b4506dfb43a HTTP/1.1" 200 None 2026-03-27 17:03:41,378 - lava_callback - DEBUG - Processing node 69c6b80b02375b4506dfb43a: baseline-x86 2026-03-27 17:03:41,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:41,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:41,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80b02375b4506dfb43a/log.txt.gz 2026-03-27 17:03:42,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:42,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:42,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80b02375b4506dfb43a/lava-logs.yaml 2026-03-27 17:03:42,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:42,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:42,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80b02375b4506dfb43a/lava_callback.json.gz 2026-03-27 17:03:42,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:42,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80b02375b4506dfb43a HTTP/1.1" 200 None 2026-03-27 17:03:42,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:42,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae2f02375b4506df89b7 HTTP/1.1" 200 None 2026-03-27 17:03:42,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:42,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b80b02375b4506dfb43a HTTP/1.1" 200 None 2026-03-27 17:03:42,505 - lava_callback - INFO - Completed processing callback for node 69c6b80b02375b4506dfb43a 2026-03-27 17:03:43,030 - lava_callback - INFO - Received callback for node 69c6b80e02375b4506dfb443 INFO: 172.20.0.1:44104 - "POST /node/69c6b80e02375b4506dfb443 HTTP/1.0" 202 Accepted 2026-03-27 17:03:43,036 - lava_callback - INFO - Starting async job submit for node 69c6b80e02375b4506dfb443 2026-03-27 17:03:43,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:43,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80e02375b4506dfb443 HTTP/1.1" 200 None 2026-03-27 17:03:43,071 - lava_callback - DEBUG - Processing node 69c6b80e02375b4506dfb443: baseline-x86 2026-03-27 17:03:43,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:43,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:43,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80e02375b4506dfb443/log.txt.gz 2026-03-27 17:03:43,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:43,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:43,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80e02375b4506dfb443/lava-logs.yaml 2026-03-27 17:03:43,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:03:44,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:03:44,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c6b80e02375b4506dfb443/lava_callback.json.gz 2026-03-27 17:03:44,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:44,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b80e02375b4506dfb443 HTTP/1.1" 200 None 2026-03-27 17:03:44,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:44,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae2f02375b4506df89b7 HTTP/1.1" 200 None 2026-03-27 17:03:44,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b80e02375b4506dfb443 HTTP/1.1" 200 None 2026-03-27 17:03:44,185 - lava_callback - INFO - Completed processing callback for node 69c6b80e02375b4506dfb443 INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40982 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:03:59,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:03:59,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:04:01,769 - lava_callback - INFO - Received callback for node 69c6b5fa02375b4506df8b61 INFO: 172.20.0.1:45506 - "POST /node/69c6b5fa02375b4506df8b61 HTTP/1.0" 202 Accepted 2026-03-27 17:04:01,776 - lava_callback - INFO - Starting async job submit for node 69c6b5fa02375b4506df8b61 2026-03-27 17:04:01,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:01,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fa02375b4506df8b61 HTTP/1.1" 200 None 2026-03-27 17:04:01,818 - lava_callback - DEBUG - Processing node 69c6b5fa02375b4506df8b61: baseline-nfs-arm64 2026-03-27 17:04:02,344 - lava_callback - INFO - Received callback for node 69c6b83a02375b4506dfb47e INFO: 172.20.0.1:45514 - "POST /node/69c6b83a02375b4506dfb47e HTTP/1.0" 202 Accepted 2026-03-27 17:04:02,371 - lava_callback - INFO - Starting async job submit for node 69c6b83a02375b4506dfb47e 2026-03-27 17:04:02,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:02,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83a02375b4506dfb47e HTTP/1.1" 200 None 2026-03-27 17:04:02,521 - lava_callback - DEBUG - Processing node 69c6b83a02375b4506dfb47e: baseline-arm 2026-03-27 17:04:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:02,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:02,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:02,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fa02375b4506df8b61/log.txt.gz 2026-03-27 17:04:02,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:02,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83a02375b4506dfb47e/log.txt.gz 2026-03-27 17:04:03,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:03,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:03,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:03,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83a02375b4506dfb47e/lava-logs.yaml 2026-03-27 17:04:03,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:03,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:03,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fa02375b4506df8b61/lava-logs.yaml 2026-03-27 17:04:03,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:03,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:03,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83a02375b4506dfb47e/lava_callback.json.gz 2026-03-27 17:04:03,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:03,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83a02375b4506dfb47e HTTP/1.1" 200 None 2026-03-27 17:04:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:03,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:03,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:03,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83a02375b4506dfb47e HTTP/1.1" 200 None 2026-03-27 17:04:03,809 - lava_callback - INFO - Completed processing callback for node 69c6b83a02375b4506dfb47e 2026-03-27 17:04:03,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:03,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5fa02375b4506df8b61/lava_callback.json.gz 2026-03-27 17:04:03,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:03,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5fa02375b4506df8b61 HTTP/1.1" 200 None 2026-03-27 17:04:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:03,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:04:04,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:04,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5fa02375b4506df8b61 HTTP/1.1" 200 None 2026-03-27 17:04:04,100 - lava_callback - INFO - Completed processing callback for node 69c6b5fa02375b4506df8b61 INFO: 172.20.0.1:45528 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:09,599 - lava_callback - INFO - Received callback for node 69c6b83602375b4506dfb472 INFO: 172.20.0.1:45538 - "POST /node/69c6b83602375b4506dfb472 HTTP/1.0" 202 Accepted 2026-03-27 17:04:09,605 - lava_callback - INFO - Starting async job submit for node 69c6b83602375b4506dfb472 2026-03-27 17:04:09,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:09,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83602375b4506dfb472 HTTP/1.1" 200 None 2026-03-27 17:04:09,662 - lava_callback - DEBUG - Processing node 69c6b83602375b4506dfb472: baseline-arm 2026-03-27 17:04:09,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:10,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:10,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83602375b4506dfb472/log.txt.gz 2026-03-27 17:04:10,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:10,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:10,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83602375b4506dfb472/lava-logs.yaml 2026-03-27 17:04:10,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:10,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:10,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83602375b4506dfb472/lava_callback.json.gz 2026-03-27 17:04:10,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:10,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83602375b4506dfb472 HTTP/1.1" 200 None 2026-03-27 17:04:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:10,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:10,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:10,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83602375b4506dfb472 HTTP/1.1" 200 None 2026-03-27 17:04:10,597 - lava_callback - INFO - Completed processing callback for node 69c6b83602375b4506dfb472 INFO: 172.20.0.1:38328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:22,307 - lava_callback - INFO - Received callback for node 69c41581944faaf0e7f610c1 INFO: 172.20.0.1:50390 - "POST /node/69c41581944faaf0e7f610c1 HTTP/1.0" 202 Accepted 2026-03-27 17:04:22,312 - lava_callback - INFO - Starting async job submit for node 69c41581944faaf0e7f610c1 2026-03-27 17:04:22,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:22,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41581944faaf0e7f610c1 HTTP/1.1" 200 None 2026-03-27 17:04:22,327 - lava_callback - DEBUG - Processing node 69c41581944faaf0e7f610c1: baseline-arm64-clabbe 2026-03-27 17:04:22,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41581944faaf0e7f610c1 2026-03-27 17:04:22,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:22,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41581944faaf0e7f610c1 HTTP/1.1" 200 None 2026-03-27 17:04:22,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:22,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-27 17:04:22,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:22,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41581944faaf0e7f610c1 HTTP/1.1" 200 None 2026-03-27 17:04:22,398 - lava_callback - ERROR - Error processing callback for node 69c41581944faaf0e7f610c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:29,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:29,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:04:31,019 - lava_callback - INFO - Received callback for node 69c6b85902375b4506dfb4f6 INFO: 172.20.0.1:32814 - "POST /node/69c6b85902375b4506dfb4f6 HTTP/1.0" 202 Accepted 2026-03-27 17:04:31,025 - lava_callback - INFO - Starting async job submit for node 69c6b85902375b4506dfb4f6 2026-03-27 17:04:31,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:31,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85902375b4506dfb4f6 HTTP/1.1" 200 None 2026-03-27 17:04:31,065 - lava_callback - DEBUG - Processing node 69c6b85902375b4506dfb4f6: baseline-arm-pengutronix 2026-03-27 17:04:31,114 - lava_callback - INFO - Received callback for node 69c6b84802375b4506dfb4b9 INFO: 172.20.0.1:32830 - "POST /node/69c6b84802375b4506dfb4b9 HTTP/1.0" 202 Accepted 2026-03-27 17:04:31,135 - lava_callback - INFO - Starting async job submit for node 69c6b84802375b4506dfb4b9 2026-03-27 17:04:31,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:31,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:31,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84802375b4506dfb4b9 HTTP/1.1" 200 None 2026-03-27 17:04:31,245 - lava_callback - DEBUG - Processing node 69c6b84802375b4506dfb4b9: baseline-arm-broonie 2026-03-27 17:04:31,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:31,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85902375b4506dfb4f6/log.txt.gz 2026-03-27 17:04:31,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:31,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:31,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:31,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84802375b4506dfb4b9/log.txt.gz 2026-03-27 17:04:31,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:31,813 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85902375b4506dfb4f6/lava-logs.yaml 2026-03-27 17:04:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:31,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:32,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:32,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:32,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85902375b4506dfb4f6/lava_callback.json.gz 2026-03-27 17:04:32,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84802375b4506dfb4b9/lava-logs.yaml 2026-03-27 17:04:32,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:32,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85902375b4506dfb4f6 HTTP/1.1" 200 None 2026-03-27 17:04:32,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:32,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85902375b4506dfb4f6 HTTP/1.1" 200 None 2026-03-27 17:04:32,109 - lava_callback - INFO - Completed processing callback for node 69c6b85902375b4506dfb4f6 2026-03-27 17:04:32,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:32,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84802375b4506dfb4b9/lava_callback.json.gz 2026-03-27 17:04:32,327 - lava_callback - INFO - Received callback for node 69c6b85a02375b4506dfb516 2026-03-27 17:04:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:32838 - "POST /node/69c6b85a02375b4506dfb516 HTTP/1.0" 202 Accepted 2026-03-27 17:04:32,334 - lava_callback - INFO - Starting async job submit for node 69c6b85a02375b4506dfb516 2026-03-27 17:04:32,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84802375b4506dfb4b9 HTTP/1.1" 200 None 2026-03-27 17:04:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85a02375b4506dfb516 HTTP/1.1" 200 None 2026-03-27 17:04:32,373 - lava_callback - DEBUG - Processing node 69c6b85a02375b4506dfb516: baseline-arm-pengutronix 2026-03-27 17:04:32,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:32,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:32,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b84802375b4506dfb4b9 HTTP/1.1" 200 None 2026-03-27 17:04:32,621 - lava_callback - INFO - Completed processing callback for node 69c6b84802375b4506dfb4b9 2026-03-27 17:04:32,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:32,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85a02375b4506dfb516/log.txt.gz 2026-03-27 17:04:32,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:33,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:33,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85a02375b4506dfb516/lava-logs.yaml 2026-03-27 17:04:33,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:33,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:33,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85a02375b4506dfb516/lava_callback.json.gz 2026-03-27 17:04:33,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:33,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85a02375b4506dfb516 HTTP/1.1" 200 None 2026-03-27 17:04:33,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:33,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:33,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85a02375b4506dfb516 HTTP/1.1" 200 None 2026-03-27 17:04:33,269 - lava_callback - INFO - Completed processing callback for node 69c6b85a02375b4506dfb516 INFO: 172.20.0.1:32854 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:40,291 - lava_callback - INFO - Received callback for node 69c6b84b02375b4506dfb4c1 INFO: 172.20.0.1:60270 - "POST /node/69c6b84b02375b4506dfb4c1 HTTP/1.0" 202 Accepted 2026-03-27 17:04:40,297 - lava_callback - INFO - Starting async job submit for node 69c6b84b02375b4506dfb4c1 2026-03-27 17:04:40,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:40,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84b02375b4506dfb4c1 HTTP/1.1" 200 None 2026-03-27 17:04:40,338 - lava_callback - DEBUG - Processing node 69c6b84b02375b4506dfb4c1: baseline-arm-broonie 2026-03-27 17:04:40,620 - lava_callback - INFO - Received callback for node 69c6b85d02375b4506dfb520 INFO: 172.20.0.1:60278 - "POST /node/69c6b85d02375b4506dfb520 HTTP/1.0" 202 Accepted 2026-03-27 17:04:40,675 - lava_callback - INFO - Starting async job submit for node 69c6b85d02375b4506dfb520 2026-03-27 17:04:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:40,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:40,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85d02375b4506dfb520 HTTP/1.1" 200 None 2026-03-27 17:04:40,727 - lava_callback - DEBUG - Processing node 69c6b85d02375b4506dfb520: baseline-arm-pengutronix 2026-03-27 17:04:40,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:40,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:40,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84b02375b4506dfb4c1/log.txt.gz 2026-03-27 17:04:41,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:41,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85d02375b4506dfb520/log.txt.gz 2026-03-27 17:04:41,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:41,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:41,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:41,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85d02375b4506dfb520/lava-logs.yaml 2026-03-27 17:04:41,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:41,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:41,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84b02375b4506dfb4c1/lava-logs.yaml 2026-03-27 17:04:41,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:41,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:41,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85d02375b4506dfb520/lava_callback.json.gz 2026-03-27 17:04:41,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85d02375b4506dfb520 HTTP/1.1" 200 None 2026-03-27 17:04:41,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:41,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:41,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84b02375b4506dfb4c1/lava_callback.json.gz 2026-03-27 17:04:41,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85d02375b4506dfb520 HTTP/1.1" 200 None 2026-03-27 17:04:41,590 - lava_callback - INFO - Completed processing callback for node 69c6b85d02375b4506dfb520 2026-03-27 17:04:41,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84b02375b4506dfb4c1 HTTP/1.1" 200 None 2026-03-27 17:04:41,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:41,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:41,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b84b02375b4506dfb4c1 HTTP/1.1" 200 None 2026-03-27 17:04:41,732 - lava_callback - INFO - Completed processing callback for node 69c6b84b02375b4506dfb4c1 2026-03-27 17:04:45,674 - lava_callback - INFO - Received callback for node 69c6b84f02375b4506dfb4d0 INFO: 172.20.0.1:60288 - "POST /node/69c6b84f02375b4506dfb4d0 HTTP/1.0" 202 Accepted 2026-03-27 17:04:45,685 - lava_callback - INFO - Starting async job submit for node 69c6b84f02375b4506dfb4d0 2026-03-27 17:04:45,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:45,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84f02375b4506dfb4d0 HTTP/1.1" 200 None 2026-03-27 17:04:45,743 - lava_callback - DEBUG - Processing node 69c6b84f02375b4506dfb4d0: baseline-arm-clabbe 2026-03-27 17:04:45,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:46,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:46,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b84f02375b4506dfb4d0/log.txt.gz 2026-03-27 17:04:46,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:46,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:46,524 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b84f02375b4506dfb4d0/lava-logs.yaml INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:46,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:46,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:46,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b84f02375b4506dfb4d0/lava_callback.json.gz 2026-03-27 17:04:46,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:46,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84f02375b4506dfb4d0 HTTP/1.1" 200 None 2026-03-27 17:04:46,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:46,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:46,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:46,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b84f02375b4506dfb4d0 HTTP/1.1" 200 None 2026-03-27 17:04:46,749 - lava_callback - INFO - Completed processing callback for node 69c6b84f02375b4506dfb4d0 2026-03-27 17:04:51,132 - lava_callback - INFO - Received callback for node 69c6b84a02375b4506dfb4bc INFO: 172.20.0.1:58812 - "POST /node/69c6b84a02375b4506dfb4bc HTTP/1.0" 202 Accepted 2026-03-27 17:04:51,140 - lava_callback - INFO - Starting async job submit for node 69c6b84a02375b4506dfb4bc 2026-03-27 17:04:51,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:51,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84a02375b4506dfb4bc HTTP/1.1" 200 None 2026-03-27 17:04:51,191 - lava_callback - DEBUG - Processing node 69c6b84a02375b4506dfb4bc: baseline-arm-broonie 2026-03-27 17:04:51,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:51,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:51,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84a02375b4506dfb4bc/log.txt.gz 2026-03-27 17:04:51,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:51,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:51,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84a02375b4506dfb4bc/lava-logs.yaml 2026-03-27 17:04:51,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:04:52,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:04:52,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84a02375b4506dfb4bc/lava_callback.json.gz 2026-03-27 17:04:52,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:52,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84a02375b4506dfb4bc HTTP/1.1" 200 None 2026-03-27 17:04:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:52,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:04:52,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:52,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b84a02375b4506dfb4bc HTTP/1.1" 200 None 2026-03-27 17:04:52,220 - lava_callback - INFO - Completed processing callback for node 69c6b84a02375b4506dfb4bc INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:04:59,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:04:59,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-27 17:05:00,510 - lava_callback - INFO - Received callback for node 69c6b84702375b4506dfb4b6 INFO: 172.20.0.1:57224 - "POST /node/69c6b84702375b4506dfb4b6 HTTP/1.0" 202 Accepted 2026-03-27 17:05:00,517 - lava_callback - INFO - Starting async job submit for node 69c6b84702375b4506dfb4b6 2026-03-27 17:05:00,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:00,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84702375b4506dfb4b6 HTTP/1.1" 200 None 2026-03-27 17:05:00,555 - lava_callback - DEBUG - Processing node 69c6b84702375b4506dfb4b6: baseline-arm-broonie 2026-03-27 17:05:00,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:00,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:00,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84702375b4506dfb4b6/log.txt.gz 2026-03-27 17:05:01,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:01,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:01,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84702375b4506dfb4b6/lava-logs.yaml 2026-03-27 17:05:01,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:01,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:01,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c6b84702375b4506dfb4b6/lava_callback.json.gz 2026-03-27 17:05:01,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:01,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b84702375b4506dfb4b6 HTTP/1.1" 200 None 2026-03-27 17:05:01,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:05:01,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:01,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b84702375b4506dfb4b6 HTTP/1.1" 200 None 2026-03-27 17:05:01,496 - lava_callback - INFO - Completed processing callback for node 69c6b84702375b4506dfb4b6 INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46244 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:05:29,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:29,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:05:34,110 - lava_callback - INFO - Received callback for node 69c6b87402375b4506dfb546 INFO: 172.20.0.1:48292 - "POST /node/69c6b87402375b4506dfb546 HTTP/1.0" 202 Accepted 2026-03-27 17:05:34,117 - lava_callback - INFO - Starting async job submit for node 69c6b87402375b4506dfb546 2026-03-27 17:05:34,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:34,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87402375b4506dfb546 HTTP/1.1" 200 None 2026-03-27 17:05:34,167 - lava_callback - DEBUG - Processing node 69c6b87402375b4506dfb546: ltp-dio 2026-03-27 17:05:34,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:34,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:34,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c6b87402375b4506dfb546/log.txt.gz 2026-03-27 17:05:35,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:35,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:35,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c6b87402375b4506dfb546/lava-logs.yaml 2026-03-27 17:05:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:35,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:35,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c6b87402375b4506dfb546/lava_callback.json.gz 2026-03-27 17:05:35,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:35,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87402375b4506dfb546 HTTP/1.1" 200 None 2026-03-27 17:05:35,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:35,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:05:35,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:35,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87402375b4506dfb546 HTTP/1.1" 200 None 2026-03-27 17:05:35,517 - lava_callback - INFO - Completed processing callback for node 69c6b87402375b4506dfb546 INFO: 172.20.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39150 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:05:52,591 - lava_callback - INFO - Received callback for node 69c6b5ee02375b4506df8b46 INFO: 172.20.0.1:42508 - "POST /node/69c6b5ee02375b4506df8b46 HTTP/1.0" 202 Accepted 2026-03-27 17:05:52,598 - lava_callback - INFO - Starting async job submit for node 69c6b5ee02375b4506df8b46 2026-03-27 17:05:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:52,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ee02375b4506df8b46 HTTP/1.1" 200 None 2026-03-27 17:05:52,648 - lava_callback - DEBUG - Processing node 69c6b5ee02375b4506df8b46: baseline-arm64 2026-03-27 17:05:53,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:53,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:53,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ee02375b4506df8b46/log.txt.gz 2026-03-27 17:05:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:53,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:53,891 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ee02375b4506df8b46/lava-logs.yaml 2026-03-27 17:05:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:05:54,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:05:54,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5ee02375b4506df8b46/lava_callback.json.gz DEBUG: Setup failed for 69c6b5ee02375b4506df8b46. Transitting job node result: incomplete -> fail 2026-03-27 17:05:54,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:54,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5ee02375b4506df8b46 HTTP/1.1" 200 None 2026-03-27 17:05:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:54,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:05:54,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:54,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5ee02375b4506df8b46 HTTP/1.1" 200 None 2026-03-27 17:05:54,461 - lava_callback - INFO - Completed processing callback for node 69c6b5ee02375b4506df8b46 INFO: 172.20.0.1:42514 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:05:59,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:05:59,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55748 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:06:36,715 - lava_callback - INFO - Received callback for node 69c6b85002375b4506dfb4d4 INFO: 172.20.0.1:55764 - "POST /node/69c6b85002375b4506dfb4d4 HTTP/1.0" 202 Accepted 2026-03-27 17:06:36,721 - lava_callback - INFO - Starting async job submit for node 69c6b85002375b4506dfb4d4 2026-03-27 17:06:36,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:06:36,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85002375b4506dfb4d4 HTTP/1.1" 200 None 2026-03-27 17:06:36,775 - lava_callback - DEBUG - Processing node 69c6b85002375b4506dfb4d4: baseline-arm-clabbe 2026-03-27 17:06:36,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:06:37,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:06:37,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85002375b4506dfb4d4/log.txt.gz 2026-03-27 17:06:37,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:06:37,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:06:37,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85002375b4506dfb4d4/lava-logs.yaml 2026-03-27 17:06:37,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:06:37,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:06:37,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85002375b4506dfb4d4/lava_callback.json.gz 2026-03-27 17:06:37,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:06:37,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85002375b4506dfb4d4 HTTP/1.1" 200 None 2026-03-27 17:06:37,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:06:37,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:06:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:06:37,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85002375b4506dfb4d4 HTTP/1.1" 200 None 2026-03-27 17:06:37,743 - lava_callback - INFO - Completed processing callback for node 69c6b85002375b4506dfb4d4 INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:06:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:06:59,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:07:27,585 - lava_callback - INFO - Received callback for node 69c6b5e902375b4506df8b3a INFO: 172.20.0.1:59100 - "POST /node/69c6b5e902375b4506df8b3a HTTP/1.0" 202 Accepted 2026-03-27 17:07:27,592 - lava_callback - INFO - Starting async job submit for node 69c6b5e902375b4506df8b3a 2026-03-27 17:07:27,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:27,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e902375b4506df8b3a HTTP/1.1" 200 None 2026-03-27 17:07:27,631 - lava_callback - DEBUG - Processing node 69c6b5e902375b4506df8b3a: baseline-arm64 2026-03-27 17:07:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:28,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:28,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e902375b4506df8b3a/log.txt.gz INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:07:28,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:28,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:28,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e902375b4506df8b3a/lava-logs.yaml 2026-03-27 17:07:28,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:28,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:28,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6b5e902375b4506df8b3a/lava_callback.json.gz 2026-03-27 17:07:28,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:28,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5e902375b4506df8b3a HTTP/1.1" 200 None 2026-03-27 17:07:28,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:28,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:07:28,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:28,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5e902375b4506df8b3a HTTP/1.1" 200 None 2026-03-27 17:07:29,039 - lava_callback - INFO - Completed processing callback for node 69c6b5e902375b4506df8b3a 2026-03-27 17:07:29,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:29,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:07:40,652 - lava_callback - INFO - Received callback for node 69c6b86d02375b4506dfb532 INFO: 172.20.0.1:57264 - "POST /node/69c6b86d02375b4506dfb532 HTTP/1.0" 202 Accepted 2026-03-27 17:07:40,658 - lava_callback - INFO - Starting async job submit for node 69c6b86d02375b4506dfb532 2026-03-27 17:07:40,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:40,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b86d02375b4506dfb532 HTTP/1.1" 200 None 2026-03-27 17:07:40,698 - lava_callback - DEBUG - Processing node 69c6b86d02375b4506dfb532: ltp-cap_bounds 2026-03-27 17:07:41,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:41,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:41,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c6b86d02375b4506dfb532/log.txt.gz 2026-03-27 17:07:41,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:41,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:41,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c6b86d02375b4506dfb532/lava-logs.yaml 2026-03-27 17:07:41,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:41,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:41,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c6b86d02375b4506dfb532/lava_callback.json.gz 2026-03-27 17:07:41,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:41,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b86d02375b4506dfb532 HTTP/1.1" 200 None 2026-03-27 17:07:41,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:41,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:07:41,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:41,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b86d02375b4506dfb532 HTTP/1.1" 200 None 2026-03-27 17:07:41,945 - lava_callback - INFO - Completed processing callback for node 69c6b86d02375b4506dfb532 INFO: 172.20.0.1:57270 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:07:51,684 - lava_callback - INFO - Received callback for node 69c6b87202375b4506dfb543 INFO: 172.20.0.1:51960 - "POST /node/69c6b87202375b4506dfb543 HTTP/1.0" 202 Accepted 2026-03-27 17:07:51,691 - lava_callback - INFO - Starting async job submit for node 69c6b87202375b4506dfb543 2026-03-27 17:07:51,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:51,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87202375b4506dfb543 HTTP/1.1" 200 None 2026-03-27 17:07:51,731 - lava_callback - DEBUG - Processing node 69c6b87202375b4506dfb543: ltp-cve 2026-03-27 17:07:52,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:52,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:52,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69c6b87202375b4506dfb543/log.txt.gz 2026-03-27 17:07:52,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:52,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:52,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69c6b87202375b4506dfb543/lava-logs.yaml 2026-03-27 17:07:52,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:07:52,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:07:52,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69c6b87202375b4506dfb543/lava_callback.json.gz 2026-03-27 17:07:52,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:52,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87202375b4506dfb543 HTTP/1.1" 200 None 2026-03-27 17:07:52,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:52,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:07:52,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:52,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87202375b4506dfb543 HTTP/1.1" 200 None 2026-03-27 17:07:52,937 - lava_callback - INFO - Completed processing callback for node 69c6b87202375b4506dfb543 INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:07:59,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:07:59,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:08:00,907 - lava_callback - INFO - Received callback for node 69c6b88002375b4506dfb57a INFO: 172.20.0.1:54992 - "POST /node/69c6b88002375b4506dfb57a HTTP/1.0" 202 Accepted 2026-03-27 17:08:00,916 - lava_callback - INFO - Starting async job submit for node 69c6b88002375b4506dfb57a 2026-03-27 17:08:00,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:00,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88002375b4506dfb57a HTTP/1.1" 200 None 2026-03-27 17:08:00,959 - lava_callback - DEBUG - Processing node 69c6b88002375b4506dfb57a: ltp-syscalls 2026-03-27 17:08:01,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:01,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:01,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c6b88002375b4506dfb57a/log.txt.gz 2026-03-27 17:08:02,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:02,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:02,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c6b88002375b4506dfb57a/lava-logs.yaml 2026-03-27 17:08:02,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:02,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:02,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c6b88002375b4506dfb57a/lava_callback.json.gz 2026-03-27 17:08:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:02,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88002375b4506dfb57a HTTP/1.1" 200 None 2026-03-27 17:08:02,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:02,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:08:02,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:02,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b88002375b4506dfb57a HTTP/1.1" 200 None 2026-03-27 17:08:02,696 - lava_callback - INFO - Completed processing callback for node 69c6b88002375b4506dfb57a INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47988 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 17:08:15,889 - lava_callback - INFO - Received callback for node 69c6b85302375b4506dfb4e0 INFO: 172.20.0.1:47998 - "POST /node/69c6b85302375b4506dfb4e0 HTTP/1.0" 202 Accepted 2026-03-27 17:08:15,895 - lava_callback - INFO - Starting async job submit for node 69c6b85302375b4506dfb4e0 2026-03-27 17:08:15,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:15,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85302375b4506dfb4e0 HTTP/1.1" 200 None 2026-03-27 17:08:15,931 - lava_callback - DEBUG - Processing node 69c6b85302375b4506dfb4e0: baseline-arm-clabbe 2026-03-27 17:08:16,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:16,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:16,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85302375b4506dfb4e0/log.txt.gz 2026-03-27 17:08:16,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48014 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:08:16,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:16,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85302375b4506dfb4e0/lava-logs.yaml 2026-03-27 17:08:16,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:16,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:16,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85302375b4506dfb4e0/lava_callback.json.gz 2026-03-27 17:08:16,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85302375b4506dfb4e0 HTTP/1.1" 200 None 2026-03-27 17:08:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:16,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:08:16,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:16,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85302375b4506dfb4e0 HTTP/1.1" 200 None 2026-03-27 17:08:16,798 - lava_callback - INFO - Completed processing callback for node 69c6b85302375b4506dfb4e0 2026-03-27 17:08:20,659 - lava_callback - INFO - Received callback for node 69c6b86e02375b4506dfb539 INFO: 172.20.0.1:59332 - "POST /node/69c6b86e02375b4506dfb539 HTTP/1.0" 202 Accepted 2026-03-27 17:08:20,666 - lava_callback - INFO - Starting async job submit for node 69c6b86e02375b4506dfb539 2026-03-27 17:08:20,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:20,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b86e02375b4506dfb539 HTTP/1.1" 200 None 2026-03-27 17:08:20,719 - lava_callback - DEBUG - Processing node 69c6b86e02375b4506dfb539: ltp-containers 2026-03-27 17:08:21,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:21,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:21,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69c6b86e02375b4506dfb539/log.txt.gz 2026-03-27 17:08:21,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:21,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:21,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69c6b86e02375b4506dfb539/lava-logs.yaml 2026-03-27 17:08:21,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:21,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:21,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69c6b86e02375b4506dfb539/lava_callback.json.gz 2026-03-27 17:08:21,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:21,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b86e02375b4506dfb539 HTTP/1.1" 200 None 2026-03-27 17:08:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:08:21,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:21,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b86e02375b4506dfb539 HTTP/1.1" 200 None 2026-03-27 17:08:21,941 - lava_callback - INFO - Completed processing callback for node 69c6b86e02375b4506dfb539 2026-03-27 17:08:22,267 - lava_callback - INFO - Received callback for node 69c6b87002375b4506dfb53c INFO: 172.20.0.1:59344 - "POST /node/69c6b87002375b4506dfb53c HTTP/1.0" 202 Accepted 2026-03-27 17:08:22,275 - lava_callback - INFO - Starting async job submit for node 69c6b87002375b4506dfb53c 2026-03-27 17:08:22,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:22,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87002375b4506dfb53c HTTP/1.1" 200 None 2026-03-27 17:08:22,317 - lava_callback - DEBUG - Processing node 69c6b87002375b4506dfb53c: ltp-controllers 2026-03-27 17:08:22,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:22,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:22,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69c6b87002375b4506dfb53c/log.txt.gz 2026-03-27 17:08:23,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:23,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:23,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69c6b87002375b4506dfb53c/lava-logs.yaml 2026-03-27 17:08:23,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:23,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:23,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69c6b87002375b4506dfb53c/lava_callback.json.gz 2026-03-27 17:08:23,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:23,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87002375b4506dfb53c HTTP/1.1" 200 None 2026-03-27 17:08:23,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:23,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:08:23,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:23,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87002375b4506dfb53c HTTP/1.1" 200 None 2026-03-27 17:08:23,712 - lava_callback - INFO - Completed processing callback for node 69c6b87002375b4506dfb53c INFO: 172.20.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:08:29,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:29,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:08:46,582 - lava_callback - INFO - Received callback for node 69c6b98402375b4506dfb634 INFO: 172.20.0.1:39998 - "POST /node/69c6b98402375b4506dfb634 HTTP/1.0" 202 Accepted 2026-03-27 17:08:46,588 - lava_callback - INFO - Starting async job submit for node 69c6b98402375b4506dfb634 2026-03-27 17:08:46,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:46,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b98402375b4506dfb634 HTTP/1.1" 200 None 2026-03-27 17:08:46,606 - lava_callback - DEBUG - Processing node 69c6b98402375b4506dfb634: baseline-nfs-arm64 2026-03-27 17:08:46,607 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:08:46,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:46,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:46,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b98402375b4506dfb634/lava-logs.yaml 2026-03-27 17:08:46,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:08:46,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:08:46,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b98402375b4506dfb634/lava_callback.json.gz 2026-03-27 17:08:46,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:46,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b98402375b4506dfb634 HTTP/1.1" 200 None 2026-03-27 17:08:46,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:46,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:08:46,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:46,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b98402375b4506dfb634 HTTP/1.1" 200 None 2026-03-27 17:08:46,981 - lava_callback - INFO - Completed processing callback for node 69c6b98402375b4506dfb634 INFO: 172.20.0.1:36436 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:08:59,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:08:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 17:09:00,673 - lava_callback - INFO - Received callback for node 69c6b87502375b4506dfb549 INFO: 172.20.0.1:60032 - "POST /node/69c6b87502375b4506dfb549 HTTP/1.0" 202 Accepted 2026-03-27 17:09:00,680 - lava_callback - INFO - Starting async job submit for node 69c6b87502375b4506dfb549 2026-03-27 17:09:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:00,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87502375b4506dfb549 HTTP/1.1" 200 None 2026-03-27 17:09:00,721 - lava_callback - DEBUG - Processing node 69c6b87502375b4506dfb549: ltp-fs_bind 2026-03-27 17:09:01,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:01,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:01,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c6b87502375b4506dfb549/log.txt.gz 2026-03-27 17:09:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:01,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:01,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c6b87502375b4506dfb549/lava-logs.yaml 2026-03-27 17:09:01,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:01,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:01,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c6b87502375b4506dfb549/lava_callback.json.gz 2026-03-27 17:09:01,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:01,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87502375b4506dfb549 HTTP/1.1" 200 None 2026-03-27 17:09:01,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:01,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:09:01,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:01,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87502375b4506dfb549 HTTP/1.1" 200 None 2026-03-27 17:09:01,987 - lava_callback - INFO - Completed processing callback for node 69c6b87502375b4506dfb549 INFO: 172.20.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:09:29,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:29,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:09:54,971 - lava_callback - INFO - Received callback for node 69c6b85402375b4506dfb4e3 INFO: 172.20.0.1:39058 - "POST /node/69c6b85402375b4506dfb4e3 HTTP/1.0" 202 Accepted 2026-03-27 17:09:54,977 - lava_callback - INFO - Starting async job submit for node 69c6b85402375b4506dfb4e3 2026-03-27 17:09:54,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:55,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85402375b4506dfb4e3 HTTP/1.1" 200 None 2026-03-27 17:09:55,022 - lava_callback - DEBUG - Processing node 69c6b85402375b4506dfb4e3: baseline-arm-clabbe 2026-03-27 17:09:55,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:55,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:55,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85402375b4506dfb4e3/log.txt.gz 2026-03-27 17:09:55,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:55,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:55,925 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85402375b4506dfb4e3/lava-logs.yaml 2026-03-27 17:09:55,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:09:56,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:09:56,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c6b85402375b4506dfb4e3/lava_callback.json.gz 2026-03-27 17:09:56,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:56,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85402375b4506dfb4e3 HTTP/1.1" 200 None 2026-03-27 17:09:56,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:56,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:09:56,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:56,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85402375b4506dfb4e3 HTTP/1.1" 200 None 2026-03-27 17:09:56,162 - lava_callback - INFO - Completed processing callback for node 69c6b85402375b4506dfb4e3 INFO: 172.20.0.1:39072 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:09:59,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:09:59,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:11:40,815 - lava_callback - INFO - Received callback for node 69c6b87702375b4506dfb54c INFO: 172.20.0.1:35768 - "POST /node/69c6b87702375b4506dfb54c HTTP/1.0" 202 Accepted 2026-03-27 17:11:40,822 - lava_callback - INFO - Starting async job submit for node 69c6b87702375b4506dfb54c 2026-03-27 17:11:40,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:40,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87702375b4506dfb54c HTTP/1.1" 200 None 2026-03-27 17:11:40,885 - lava_callback - DEBUG - Processing node 69c6b87702375b4506dfb54c: ltp-fsx 2026-03-27 17:11:41,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:41,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:41,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69c6b87702375b4506dfb54c/log.txt.gz 2026-03-27 17:11:41,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:42,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:42,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69c6b87702375b4506dfb54c/lava-logs.yaml 2026-03-27 17:11:42,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:42,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:42,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69c6b87702375b4506dfb54c/lava_callback.json.gz 2026-03-27 17:11:42,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:42,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87702375b4506dfb54c HTTP/1.1" 200 None 2026-03-27 17:11:42,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:42,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:11:42,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:42,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87702375b4506dfb54c HTTP/1.1" 200 None 2026-03-27 17:11:42,475 - lava_callback - INFO - Completed processing callback for node 69c6b87702375b4506dfb54c INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:11:51,583 - lava_callback - INFO - Received callback for node 69c6b87802375b4506dfb560 INFO: 172.20.0.1:36786 - "POST /node/69c6b87802375b4506dfb560 HTTP/1.0" 202 Accepted 2026-03-27 17:11:51,593 - lava_callback - INFO - Starting async job submit for node 69c6b87802375b4506dfb560 2026-03-27 17:11:51,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:51,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87802375b4506dfb560 HTTP/1.1" 200 None 2026-03-27 17:11:51,664 - lava_callback - DEBUG - Processing node 69c6b87802375b4506dfb560: ltp-input 2026-03-27 17:11:52,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:52,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:52,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69c6b87802375b4506dfb560/log.txt.gz 2026-03-27 17:11:52,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:53,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:53,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69c6b87802375b4506dfb560/lava-logs.yaml 2026-03-27 17:11:53,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:53,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:53,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69c6b87802375b4506dfb560/lava_callback.json.gz 2026-03-27 17:11:53,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:53,496 - lava_callback - INFO - Received callback for node 69c6ba1602375b4506dfb66f INFO: 172.20.0.1:36802 - "POST /node/69c6ba1602375b4506dfb66f HTTP/1.0" 202 Accepted 2026-03-27 17:11:53,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87802375b4506dfb560 HTTP/1.1" 200 None 2026-03-27 17:11:53,504 - lava_callback - INFO - Starting async job submit for node 69c6ba1602375b4506dfb66f 2026-03-27 17:11:53,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:53,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:53,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ba1602375b4506dfb66f HTTP/1.1" 200 None 2026-03-27 17:11:53,555 - lava_callback - DEBUG - Processing node 69c6ba1602375b4506dfb66f: baseline-arm64 2026-03-27 17:11:53,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:11:53,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:53,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87802375b4506dfb560 HTTP/1.1" 200 None 2026-03-27 17:11:53,753 - lava_callback - INFO - Completed processing callback for node 69c6b87802375b4506dfb560 2026-03-27 17:11:53,881 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:11:54,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:54,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:54,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6ba1602375b4506dfb66f/lava-logs.yaml 2026-03-27 17:11:54,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:11:54,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:11:54,466 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6ba1602375b4506dfb66f/lava_callback.json.gz 2026-03-27 17:11:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:54,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ba1602375b4506dfb66f HTTP/1.1" 200 None 2026-03-27 17:11:54,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:54,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:11:54,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:54,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6ba1602375b4506dfb66f HTTP/1.1" 200 None 2026-03-27 17:11:54,713 - lava_callback - INFO - Completed processing callback for node 69c6ba1602375b4506dfb66f INFO: 172.20.0.1:36818 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:11:59,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:11:59,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44660 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:13:00,857 - lava_callback - INFO - Received callback for node 69c6b87a02375b4506dfb563 INFO: 172.20.0.1:48736 - "POST /node/69c6b87a02375b4506dfb563 HTTP/1.0" 202 Accepted 2026-03-27 17:13:00,863 - lava_callback - INFO - Starting async job submit for node 69c6b87a02375b4506dfb563 2026-03-27 17:13:00,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:00,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87a02375b4506dfb563 HTTP/1.1" 200 None 2026-03-27 17:13:00,918 - lava_callback - DEBUG - Processing node 69c6b87a02375b4506dfb563: ltp-ipc 2026-03-27 17:13:01,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:01,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:01,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69c6b87a02375b4506dfb563/log.txt.gz 2026-03-27 17:13:01,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:01,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:01,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69c6b87a02375b4506dfb563/lava-logs.yaml 2026-03-27 17:13:01,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:02,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:02,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69c6b87a02375b4506dfb563/lava_callback.json.gz 2026-03-27 17:13:02,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87a02375b4506dfb563 HTTP/1.1" 200 None 2026-03-27 17:13:02,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:02,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:13:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:02,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87a02375b4506dfb563 HTTP/1.1" 200 None 2026-03-27 17:13:02,206 - lava_callback - INFO - Completed processing callback for node 69c6b87a02375b4506dfb563 INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48414 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 17:13:16,331 - lava_callback - INFO - Received callback for node 69c6b5f302375b4506df8b52 INFO: 172.20.0.1:48416 - "POST /node/69c6b5f302375b4506df8b52 HTTP/1.0" 202 Accepted 2026-03-27 17:13:16,340 - lava_callback - INFO - Starting async job submit for node 69c6b5f302375b4506df8b52 2026-03-27 17:13:16,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:16,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f302375b4506df8b52 HTTP/1.1" 200 None 2026-03-27 17:13:16,400 - lava_callback - DEBUG - Processing node 69c6b5f302375b4506df8b52: baseline-nfs-arm64 INFO: 172.20.0.1:48432 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:13:17,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:17,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:17,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f302375b4506df8b52/log.txt.gz 2026-03-27 17:13:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:18,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:18,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f302375b4506df8b52/lava-logs.yaml 2026-03-27 17:13:18,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:18,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:18,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6b5f302375b4506df8b52/lava_callback.json.gz DEBUG: Setup failed for 69c6b5f302375b4506df8b52. Transitting job node result: incomplete -> fail 2026-03-27 17:13:19,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:19,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b5f302375b4506df8b52 HTTP/1.1" 200 None 2026-03-27 17:13:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:19,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:13:19,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:19,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b5f302375b4506df8b52 HTTP/1.1" 200 None 2026-03-27 17:13:19,234 - lava_callback - INFO - Completed processing callback for node 69c6b5f302375b4506df8b52 2026-03-27 17:13:21,060 - lava_callback - INFO - Received callback for node 69c6b87d02375b4506dfb569 INFO: 172.20.0.1:45516 - "POST /node/69c6b87d02375b4506dfb569 HTTP/1.0" 202 Accepted 2026-03-27 17:13:21,066 - lava_callback - INFO - Starting async job submit for node 69c6b87d02375b4506dfb569 2026-03-27 17:13:21,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:21,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87d02375b4506dfb569 HTTP/1.1" 200 None 2026-03-27 17:13:21,106 - lava_callback - DEBUG - Processing node 69c6b87d02375b4506dfb569: ltp-sched 2026-03-27 17:13:21,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:21,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:21,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c6b87d02375b4506dfb569/log.txt.gz 2026-03-27 17:13:21,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:21,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:21,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c6b87d02375b4506dfb569/lava-logs.yaml 2026-03-27 17:13:21,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:13:22,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:13:22,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c6b87d02375b4506dfb569/lava_callback.json.gz 2026-03-27 17:13:22,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:22,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87d02375b4506dfb569 HTTP/1.1" 200 None 2026-03-27 17:13:22,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:22,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:13:22,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:22,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87d02375b4506dfb569 HTTP/1.1" 200 None 2026-03-27 17:13:22,275 - lava_callback - INFO - Completed processing callback for node 69c6b87d02375b4506dfb569 INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:13:29,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:13:29,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52726 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:15:40,930 - lava_callback - INFO - Received callback for node 69c6b88102375b4506dfb57f INFO: 172.20.0.1:53144 - "POST /node/69c6b88102375b4506dfb57f HTTP/1.0" 202 Accepted 2026-03-27 17:15:40,936 - lava_callback - INFO - Starting async job submit for node 69c6b88102375b4506dfb57f 2026-03-27 17:15:40,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:40,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88102375b4506dfb57f HTTP/1.1" 200 None 2026-03-27 17:15:40,976 - lava_callback - DEBUG - Processing node 69c6b88102375b4506dfb57f: ltp-syscalls-ipc 2026-03-27 17:15:41,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:41,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:41,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c6b88102375b4506dfb57f/log.txt.gz 2026-03-27 17:15:41,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:41,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:41,953 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c6b88102375b4506dfb57f/lava-logs.yaml 2026-03-27 17:15:41,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:42,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:42,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c6b88102375b4506dfb57f/lava_callback.json.gz 2026-03-27 17:15:42,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:42,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88102375b4506dfb57f HTTP/1.1" 200 None 2026-03-27 17:15:42,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:42,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:15:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:42,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b88102375b4506dfb57f HTTP/1.1" 200 None 2026-03-27 17:15:42,209 - lava_callback - INFO - Completed processing callback for node 69c6b88102375b4506dfb57f INFO: 172.20.0.1:53160 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:15:51,803 - lava_callback - INFO - Received callback for node 69c6b87e02375b4506dfb56c INFO: 172.20.0.1:45408 - "POST /node/69c6b87e02375b4506dfb56c HTTP/1.0" 202 Accepted 2026-03-27 17:15:51,809 - lava_callback - INFO - Starting async job submit for node 69c6b87e02375b4506dfb56c 2026-03-27 17:15:51,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:51,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87e02375b4506dfb56c HTTP/1.1" 200 None 2026-03-27 17:15:51,850 - lava_callback - DEBUG - Processing node 69c6b87e02375b4506dfb56c: ltp-smoke 2026-03-27 17:15:52,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:52,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:52,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b87e02375b4506dfb56c/log.txt.gz 2026-03-27 17:15:52,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:52,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:52,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b87e02375b4506dfb56c/lava-logs.yaml 2026-03-27 17:15:52,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:15:52,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:15:52,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6b87e02375b4506dfb56c/lava_callback.json.gz 2026-03-27 17:15:52,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:52,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87e02375b4506dfb56c HTTP/1.1" 200 None 2026-03-27 17:15:52,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:53,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:15:53,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:53,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87e02375b4506dfb56c HTTP/1.1" 200 None 2026-03-27 17:15:53,081 - lava_callback - INFO - Completed processing callback for node 69c6b87e02375b4506dfb56c INFO: 172.20.0.1:45420 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:15:59,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:15:59,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:16:32,111 - lava_callback - INFO - Received callback for node 69c6ba6502375b4506dfb68e INFO: 172.20.0.1:32942 - "POST /node/69c6ba6502375b4506dfb68e HTTP/1.0" 202 Accepted 2026-03-27 17:16:32,118 - lava_callback - INFO - Starting async job submit for node 69c6ba6502375b4506dfb68e 2026-03-27 17:16:32,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:32,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ba6502375b4506dfb68e HTTP/1.1" 200 None 2026-03-27 17:16:32,170 - lava_callback - DEBUG - Processing node 69c6ba6502375b4506dfb68e: baseline-arm64 2026-03-27 17:16:32,369 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:16:32,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:16:32,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:16:32,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6ba6502375b4506dfb68e/lava-logs.yaml 2026-03-27 17:16:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:16:32,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:16:32,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6ba6502375b4506dfb68e/lava_callback.json.gz 2026-03-27 17:16:32,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ba6502375b4506dfb68e HTTP/1.1" 200 None 2026-03-27 17:16:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:32,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:16:32,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:32,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6ba6502375b4506dfb68e HTTP/1.1" 200 None 2026-03-27 17:16:32,969 - lava_callback - INFO - Completed processing callback for node 69c6ba6502375b4506dfb68e INFO: 172.20.0.1:32952 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:16:41,290 - lava_callback - INFO - Received callback for node 69c41875944faaf0e7f61184 INFO: 172.20.0.1:43484 - "POST /node/69c41875944faaf0e7f61184 HTTP/1.0" 202 Accepted 2026-03-27 17:16:41,296 - lava_callback - INFO - Starting async job submit for node 69c41875944faaf0e7f61184 2026-03-27 17:16:41,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:41,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41875944faaf0e7f61184 HTTP/1.1" 200 None 2026-03-27 17:16:41,317 - lava_callback - DEBUG - Processing node 69c41875944faaf0e7f61184: baseline-arm64-baylibre 2026-03-27 17:16:41,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41875944faaf0e7f61184 2026-03-27 17:16:41,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:41,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41875944faaf0e7f61184 HTTP/1.1" 200 None 2026-03-27 17:16:41,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:16:41,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:41,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41875944faaf0e7f61184 HTTP/1.1" 200 None 2026-03-27 17:16:41,376 - lava_callback - ERROR - Error processing callback for node 69c41875944faaf0e7f61184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:16:59,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:16:59,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48118 - "GET /node/69936dd7cebe99dd8e0680f6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:17:21,027 - lava_callback - INFO - Received callback for node 69c6b88302375b4506dfb583 INFO: 172.20.0.1:48088 - "POST /node/69c6b88302375b4506dfb583 HTTP/1.0" 202 Accepted 2026-03-27 17:17:21,033 - lava_callback - INFO - Starting async job submit for node 69c6b88302375b4506dfb583 2026-03-27 17:17:21,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:21,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88302375b4506dfb583 HTTP/1.1" 200 None 2026-03-27 17:17:21,072 - lava_callback - DEBUG - Processing node 69c6b88302375b4506dfb583: ltp-timers 2026-03-27 17:17:21,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:21,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:21,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69c6b88302375b4506dfb583/log.txt.gz 2026-03-27 17:17:21,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:22,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:22,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69c6b88302375b4506dfb583/lava-logs.yaml 2026-03-27 17:17:22,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:22,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:22,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69c6b88302375b4506dfb583/lava_callback.json.gz 2026-03-27 17:17:22,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:22,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88302375b4506dfb583 HTTP/1.1" 200 None 2026-03-27 17:17:22,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:22,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:17:22,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:22,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b88302375b4506dfb583 HTTP/1.1" 200 None 2026-03-27 17:17:22,336 - lava_callback - INFO - Completed processing callback for node 69c6b88302375b4506dfb583 2026-03-27 17:17:22,648 - lava_callback - INFO - Received callback for node 69c6b88502375b4506dfb58c INFO: 172.20.0.1:48094 - "POST /node/69c6b88502375b4506dfb58c HTTP/1.0" 202 Accepted 2026-03-27 17:17:22,656 - lava_callback - INFO - Starting async job submit for node 69c6b88502375b4506dfb58c 2026-03-27 17:17:22,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:22,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88502375b4506dfb58c HTTP/1.1" 200 None 2026-03-27 17:17:22,700 - lava_callback - DEBUG - Processing node 69c6b88502375b4506dfb58c: ltp-watchqueue 2026-03-27 17:17:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:23,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:23,240 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c6b88502375b4506dfb58c/log.txt.gz 2026-03-27 17:17:23,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:23,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:23,660 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c6b88502375b4506dfb58c/lava-logs.yaml 2026-03-27 17:17:23,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:17:23,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:17:23,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c6b88502375b4506dfb58c/lava_callback.json.gz 2026-03-27 17:17:23,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b88502375b4506dfb58c HTTP/1.1" 200 None 2026-03-27 17:17:23,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:23,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:17:23,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:23,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b88502375b4506dfb58c HTTP/1.1" 200 None 2026-03-27 17:17:23,934 - lava_callback - INFO - Completed processing callback for node 69c6b88502375b4506dfb58c INFO: 172.20.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:17:29,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:17:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37288 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:19:08,392 - lava_callback - INFO - Received callback for node 69c6bacc02375b4506dfb6b1 INFO: 172.20.0.1:37304 - "POST /node/69c6bacc02375b4506dfb6b1 HTTP/1.0" 202 Accepted 2026-03-27 17:19:08,401 - lava_callback - INFO - Starting async job submit for node 69c6bacc02375b4506dfb6b1 2026-03-27 17:19:08,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:08,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bacc02375b4506dfb6b1 HTTP/1.1" 200 None 2026-03-27 17:19:08,465 - lava_callback - DEBUG - Processing node 69c6bacc02375b4506dfb6b1: baseline-arm64-foundriesio 2026-03-27 17:19:09,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:19:09,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:19:09,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6bacc02375b4506dfb6b1/log.txt.gz 2026-03-27 17:19:10,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:19:10,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:19:10,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6bacc02375b4506dfb6b1/lava-logs.yaml 2026-03-27 17:19:10,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:19:11,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:19:11,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6bacc02375b4506dfb6b1/lava_callback.json.gz DEBUG: 69c6bacc02375b4506dfb6b1 Transitting job node result: pass -> incomplete 2026-03-27 17:19:11,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:11,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bacc02375b4506dfb6b1 HTTP/1.1" 200 None 2026-03-27 17:19:11,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:11,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:19:11,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:11,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bacc02375b4506dfb6b1 HTTP/1.1" 200 None 2026-03-27 17:19:11,187 - lava_callback - INFO - Completed processing callback for node 69c6bacc02375b4506dfb6b1 INFO: 172.20.0.1:39670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET /node/693b40354b47c3f87266e80f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47068 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:19:29,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:29,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58266 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:19:40,094 - lava_callback - INFO - Received callback for node 69c6bc2602375b4506dfb724 INFO: 172.20.0.1:50460 - "POST /node/69c6bc2602375b4506dfb724 HTTP/1.0" 202 Accepted 2026-03-27 17:19:40,100 - lava_callback - INFO - Starting async job submit for node 69c6bc2602375b4506dfb724 2026-03-27 17:19:40,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bc2602375b4506dfb724 HTTP/1.1" 200 None 2026-03-27 17:19:40,128 - lava_callback - DEBUG - Processing node 69c6bc2602375b4506dfb724: baseline-arm 2026-03-27 17:19:40,133 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:19:40,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:19:40,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:19:40,258 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6bc2602375b4506dfb724/lava-logs.yaml 2026-03-27 17:19:40,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:19:40,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:19:40,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6bc2602375b4506dfb724/lava_callback.json.gz 2026-03-27 17:19:40,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:40,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bc2602375b4506dfb724 HTTP/1.1" 200 None 2026-03-27 17:19:40,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:40,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:19:40,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:40,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bc2602375b4506dfb724 HTTP/1.1" 200 None 2026-03-27 17:19:40,503 - lava_callback - INFO - Completed processing callback for node 69c6bc2602375b4506dfb724 2026-03-27 17:19:41,489 - lava_callback - INFO - Received callback for node 69c4191a944faaf0e7f611a4 INFO: 172.20.0.1:50462 - "POST /node/69c4191a944faaf0e7f611a4 HTTP/1.0" 202 Accepted 2026-03-27 17:19:41,494 - lava_callback - INFO - Starting async job submit for node 69c4191a944faaf0e7f611a4 2026-03-27 17:19:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:41,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4191a944faaf0e7f611a4 HTTP/1.1" 200 None 2026-03-27 17:19:41,515 - lava_callback - DEBUG - Processing node 69c4191a944faaf0e7f611a4: baseline-arm64-baylibre 2026-03-27 17:19:41,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4191a944faaf0e7f611a4 2026-03-27 17:19:41,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:41,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4191a944faaf0e7f611a4 HTTP/1.1" 200 None 2026-03-27 17:19:41,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:41,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:19:41,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:41,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4191a944faaf0e7f611a4 HTTP/1.1" 200 None 2026-03-27 17:19:41,573 - lava_callback - ERROR - Error processing callback for node 69c4191a944faaf0e7f611a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:19:59,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:19:59,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38502 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:20:48,109 - lava_callback - INFO - Received callback for node 69c6b83902375b4506dfb47b INFO: 172.20.0.1:38504 - "POST /node/69c6b83902375b4506dfb47b HTTP/1.0" 202 Accepted 2026-03-27 17:20:48,116 - lava_callback - INFO - Starting async job submit for node 69c6b83902375b4506dfb47b 2026-03-27 17:20:48,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:20:48,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83902375b4506dfb47b HTTP/1.1" 200 None 2026-03-27 17:20:48,184 - lava_callback - DEBUG - Processing node 69c6b83902375b4506dfb47b: baseline-arm 2026-03-27 17:20:48,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:20:49,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:20:49,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83902375b4506dfb47b/log.txt.gz 2026-03-27 17:20:49,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:20:49,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:20:49,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83902375b4506dfb47b/lava-logs.yaml 2026-03-27 17:20:49,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:20:49,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:20:49,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6b83902375b4506dfb47b/lava_callback.json.gz DEBUG: Setup failed for 69c6b83902375b4506dfb47b. Transitting job node result: incomplete -> fail 2026-03-27 17:20:50,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:20:50,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b83902375b4506dfb47b HTTP/1.1" 200 None 2026-03-27 17:20:50,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:20:50,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:20:50,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:20:50,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b83902375b4506dfb47b HTTP/1.1" 200 None 2026-03-27 17:20:50,203 - lava_callback - INFO - Completed processing callback for node 69c6b83902375b4506dfb47b INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:20:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:20:59,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58268 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:23:08,502 - lava_callback - INFO - Received callback for node 69c6b85c02375b4506dfb519 INFO: 172.20.0.1:58276 - "POST /node/69c6b85c02375b4506dfb519 HTTP/1.0" 202 Accepted 2026-03-27 17:23:08,549 - lava_callback - INFO - Starting async job submit for node 69c6b85c02375b4506dfb519 2026-03-27 17:23:08,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:23:08,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85c02375b4506dfb519 HTTP/1.1" 200 None 2026-03-27 17:23:08,589 - lava_callback - DEBUG - Processing node 69c6b85c02375b4506dfb519: baseline-arm-pengutronix 2026-03-27 17:23:08,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:23:08,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:23:08,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85c02375b4506dfb519/log.txt.gz 2026-03-27 17:23:08,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:23:09,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:23:09,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85c02375b4506dfb519/lava-logs.yaml 2026-03-27 17:23:09,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:23:09,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:23:09,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6b85c02375b4506dfb519/lava_callback.json.gz DEBUG: Setup failed for 69c6b85c02375b4506dfb519. Transitting job node result: incomplete -> fail 2026-03-27 17:23:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:23:09,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b85c02375b4506dfb519 HTTP/1.1" 200 None 2026-03-27 17:23:09,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:23:09,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:23:09,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:23:09,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b85c02375b4506dfb519 HTTP/1.1" 200 None 2026-03-27 17:23:09,335 - lava_callback - INFO - Completed processing callback for node 69c6b85c02375b4506dfb519 INFO: 172.20.0.1:45506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET /node/69280d71b1b5e06bf6c04cc8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:23:29,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:23:29,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54104 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:26:21,886 - lava_callback - INFO - Received callback for node 69c41aae944faaf0e7f611fb INFO: 172.20.0.1:52082 - "POST /node/69c41aae944faaf0e7f611fb HTTP/1.0" 202 Accepted 2026-03-27 17:26:21,892 - lava_callback - INFO - Starting async job submit for node 69c41aae944faaf0e7f611fb 2026-03-27 17:26:21,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:26:21,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41aae944faaf0e7f611fb HTTP/1.1" 200 None 2026-03-27 17:26:21,908 - lava_callback - DEBUG - Processing node 69c41aae944faaf0e7f611fb: baseline-arm64-baylibre 2026-03-27 17:26:21,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41aae944faaf0e7f611fb 2026-03-27 17:26:21,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:26:21,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41aae944faaf0e7f611fb HTTP/1.1" 200 None 2026-03-27 17:26:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:26:21,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:26:21,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:26:21,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41aae944faaf0e7f611fb HTTP/1.1" 200 None 2026-03-27 17:26:21,968 - lava_callback - ERROR - Error processing callback for node 69c41aae944faaf0e7f611fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:27:41,899 - lava_callback - INFO - Received callback for node 69c41afe944faaf0e7f61208 INFO: 172.20.0.1:44360 - "POST /node/69c41afe944faaf0e7f61208 HTTP/1.0" 202 Accepted 2026-03-27 17:27:41,905 - lava_callback - INFO - Starting async job submit for node 69c41afe944faaf0e7f61208 2026-03-27 17:27:41,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:27:41,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41afe944faaf0e7f61208 HTTP/1.1" 200 None 2026-03-27 17:27:41,920 - lava_callback - DEBUG - Processing node 69c41afe944faaf0e7f61208: baseline-arm64-baylibre 2026-03-27 17:27:41,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41afe944faaf0e7f61208 2026-03-27 17:27:41,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:27:41,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41afe944faaf0e7f61208 HTTP/1.1" 200 None 2026-03-27 17:27:41,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:27:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:27:41,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:27:41,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41afe944faaf0e7f61208 HTTP/1.1" 200 None 2026-03-27 17:27:41,983 - lava_callback - ERROR - Error processing callback for node 69c41afe944faaf0e7f61208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:29:02,092 - lava_callback - INFO - Received callback for node 69c41b53944faaf0e7f6121b INFO: 172.20.0.1:51276 - "POST /node/69c41b53944faaf0e7f6121b HTTP/1.0" 202 Accepted 2026-03-27 17:29:02,101 - lava_callback - INFO - Starting async job submit for node 69c41b53944faaf0e7f6121b 2026-03-27 17:29:02,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:29:02,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41b53944faaf0e7f6121b HTTP/1.1" 200 None 2026-03-27 17:29:02,139 - lava_callback - DEBUG - Processing node 69c41b53944faaf0e7f6121b: baseline-arm64-baylibre 2026-03-27 17:29:02,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41b53944faaf0e7f6121b 2026-03-27 17:29:02,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:29:02,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41b53944faaf0e7f6121b HTTP/1.1" 200 None 2026-03-27 17:29:02,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:29:02,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:29:02,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:29:02,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41b53944faaf0e7f6121b HTTP/1.1" 200 None 2026-03-27 17:29:02,217 - lava_callback - ERROR - Error processing callback for node 69c41b53944faaf0e7f6121b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:30:21,730 - lava_callback - INFO - Received callback for node 69c6b87b02375b4506dfb566 INFO: 172.20.0.1:43392 - "POST /node/69c6b87b02375b4506dfb566 HTTP/1.0" 202 Accepted 2026-03-27 17:30:21,777 - lava_callback - INFO - Starting async job submit for node 69c6b87b02375b4506dfb566 2026-03-27 17:30:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:21,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87b02375b4506dfb566 HTTP/1.1" 200 None 2026-03-27 17:30:21,817 - lava_callback - DEBUG - Processing node 69c6b87b02375b4506dfb566: ltp-pty 2026-03-27 17:30:21,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:30:22,050 - lava_callback - INFO - Received callback for node 69c41ba9944faaf0e7f61224 INFO: 172.20.0.1:43400 - "POST /node/69c41ba9944faaf0e7f61224 HTTP/1.0" 202 Accepted 2026-03-27 17:30:22,056 - lava_callback - INFO - Starting async job submit for node 69c41ba9944faaf0e7f61224 2026-03-27 17:30:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:30:22,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ba9944faaf0e7f61224 HTTP/1.1" 200 None 2026-03-27 17:30:22,075 - lava_callback - DEBUG - Processing node 69c41ba9944faaf0e7f61224: baseline-arm64-baylibre 2026-03-27 17:30:22,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41ba9944faaf0e7f61224 2026-03-27 17:30:22,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c6b87b02375b4506dfb566/log.txt.gz 2026-03-27 17:30:22,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41ba9944faaf0e7f61224 HTTP/1.1" 200 None 2026-03-27 17:30:22,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:30:22,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:30:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41ba9944faaf0e7f61224 HTTP/1.1" 200 None 2026-03-27 17:30:22,185 - lava_callback - ERROR - Error processing callback for node 69c41ba9944faaf0e7f61224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 17:30:22,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:30:22,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c6b87b02375b4506dfb566/lava-logs.yaml 2026-03-27 17:30:22,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:30:22,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:30:22,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c6b87b02375b4506dfb566/lava_callback.json.gz 2026-03-27 17:30:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6b87b02375b4506dfb566 HTTP/1.1" 200 None 2026-03-27 17:30:22,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:30:22,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:22,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6b87b02375b4506dfb566 HTTP/1.1" 200 None 2026-03-27 17:30:22,731 - lava_callback - INFO - Completed processing callback for node 69c6b87b02375b4506dfb566 INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:30:29,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:29,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:30:47,448 - lava_callback - INFO - Received callback for node 69c6beb002375b4506dfb7ca INFO: 172.20.0.1:32970 - "POST /node/69c6beb002375b4506dfb7ca HTTP/1.0" 202 Accepted 2026-03-27 17:30:47,454 - lava_callback - INFO - Starting async job submit for node 69c6beb002375b4506dfb7ca 2026-03-27 17:30:47,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:47,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6beb002375b4506dfb7ca HTTP/1.1" 200 None 2026-03-27 17:30:47,491 - lava_callback - DEBUG - Processing node 69c6beb002375b4506dfb7ca: baseline-nfs-arm64 2026-03-27 17:30:47,492 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:30:47,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:30:47,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:30:47,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6beb002375b4506dfb7ca/lava-logs.yaml 2026-03-27 17:30:47,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:30:47,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:30:47,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6beb002375b4506dfb7ca/lava_callback.json.gz 2026-03-27 17:30:47,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:47,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6beb002375b4506dfb7ca HTTP/1.1" 200 None 2026-03-27 17:30:47,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:47,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:30:47,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6beb002375b4506dfb7ca HTTP/1.1" 200 None 2026-03-27 17:30:47,865 - lava_callback - INFO - Completed processing callback for node 69c6beb002375b4506dfb7ca INFO: 172.20.0.1:54654 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:30:59,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:30:59,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51774 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:32:32,479 - lava_callback - INFO - Received callback for node 69c6bb0102375b4506dfb6b9 INFO: 172.20.0.1:60396 - "POST /node/69c6bb0102375b4506dfb6b9 HTTP/1.0" 202 Accepted 2026-03-27 17:32:32,486 - lava_callback - INFO - Starting async job submit for node 69c6bb0102375b4506dfb6b9 2026-03-27 17:32:32,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:32:32,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bb0102375b4506dfb6b9 HTTP/1.1" 200 None 2026-03-27 17:32:32,571 - lava_callback - DEBUG - Processing node 69c6bb0102375b4506dfb6b9: ltp-smoke 2026-03-27 17:32:33,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:32:33,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:32:33,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6bb0102375b4506dfb6b9/log.txt.gz 2026-03-27 17:32:33,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:32:33,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:32:33,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6bb0102375b4506dfb6b9/lava-logs.yaml 2026-03-27 17:32:33,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:32:34,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:32:34,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6bb0102375b4506dfb6b9/lava_callback.json.gz 2026-03-27 17:32:34,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:32:34,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bb0102375b4506dfb6b9 HTTP/1.1" 200 None 2026-03-27 17:32:34,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:32:34,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0a02375b4506df8995 HTTP/1.1" 200 None 2026-03-27 17:32:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:32:34,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bb0102375b4506dfb6b9 HTTP/1.1" 200 None 2026-03-27 17:32:34,349 - lava_callback - INFO - Completed processing callback for node 69c6bb0102375b4506dfb6b9 INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60418 - "GET /node/69936029cebe99dd8e063128%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:32:59,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:32:59,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48574 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:33:23,815 - lava_callback - INFO - Received callback for node 69c41c54944faaf0e7f6124c INFO: 172.20.0.1:33154 - "POST /node/69c41c54944faaf0e7f6124c HTTP/1.0" 202 Accepted 2026-03-27 17:33:23,820 - lava_callback - INFO - Starting async job submit for node 69c41c54944faaf0e7f6124c 2026-03-27 17:33:23,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:33:23,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c54944faaf0e7f6124c HTTP/1.1" 200 None 2026-03-27 17:33:23,836 - lava_callback - DEBUG - Processing node 69c41c54944faaf0e7f6124c: baseline-arm64-clabbe 2026-03-27 17:33:23,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41c54944faaf0e7f6124c 2026-03-27 17:33:23,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:33:23,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41c54944faaf0e7f6124c HTTP/1.1" 200 None 2026-03-27 17:33:23,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:33:23,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:33:23,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:33:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41c54944faaf0e7f6124c HTTP/1.1" 200 None 2026-03-27 17:33:23,894 - lava_callback - ERROR - Error processing callback for node 69c41c54944faaf0e7f6124c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:34:33,627 - lava_callback - INFO - Received callback for node 69c6bd2e02375b4506dfb789 INFO: 172.20.0.1:44688 - "POST /node/69c6bd2e02375b4506dfb789 HTTP/1.0" 202 Accepted 2026-03-27 17:34:33,634 - lava_callback - INFO - Starting async job submit for node 69c6bd2e02375b4506dfb789 2026-03-27 17:34:33,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:33,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bd2e02375b4506dfb789 HTTP/1.1" 200 None 2026-03-27 17:34:33,674 - lava_callback - DEBUG - Processing node 69c6bd2e02375b4506dfb789: baseline-nfs-arm64 2026-03-27 17:34:34,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:34:34,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:34:34,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bd2e02375b4506dfb789/log.txt.gz 2026-03-27 17:34:34,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:34:34,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:34:34,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bd2e02375b4506dfb789/lava-logs.yaml 2026-03-27 17:34:34,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:34:35,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:34:35,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bd2e02375b4506dfb789/lava_callback.json.gz 2026-03-27 17:34:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:35,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bd2e02375b4506dfb789 HTTP/1.1" 200 None 2026-03-27 17:34:35,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:35,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:34:35,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:35,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bd2e02375b4506dfb789 HTTP/1.1" 200 None 2026-03-27 17:34:35,236 - lava_callback - INFO - Completed processing callback for node 69c6bd2e02375b4506dfb789 INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:34:55,596 - lava_callback - INFO - Received callback for node 69c6bf8f02375b4506dfb7f9 INFO: 172.20.0.1:54334 - "POST /node/69c6bf8f02375b4506dfb7f9 HTTP/1.0" 202 Accepted 2026-03-27 17:34:55,603 - lava_callback - INFO - Starting async job submit for node 69c6bf8f02375b4506dfb7f9 2026-03-27 17:34:55,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:55,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bf8f02375b4506dfb7f9 HTTP/1.1" 200 None 2026-03-27 17:34:55,648 - lava_callback - DEBUG - Processing node 69c6bf8f02375b4506dfb7f9: baseline-arm64 2026-03-27 17:34:55,784 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:34:55,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:34:56,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:34:56,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6bf8f02375b4506dfb7f9/lava-logs.yaml 2026-03-27 17:34:56,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:34:56,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:34:56,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6bf8f02375b4506dfb7f9/lava_callback.json.gz 2026-03-27 17:34:56,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:56,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bf8f02375b4506dfb7f9 HTTP/1.1" 200 None 2026-03-27 17:34:56,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:56,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:34:56,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:56,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bf8f02375b4506dfb7f9 HTTP/1.1" 200 None 2026-03-27 17:34:56,340 - lava_callback - INFO - Completed processing callback for node 69c6bf8f02375b4506dfb7f9 INFO: 172.20.0.1:54346 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:34:59,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:34:59,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET /node/69876aafe31b58f834f1971f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:38:03,998 - lava_callback - INFO - Received callback for node 69c41d76944faaf0e7f612a0 INFO: 172.20.0.1:39678 - "POST /node/69c41d76944faaf0e7f612a0 HTTP/1.0" 202 Accepted 2026-03-27 17:38:04,007 - lava_callback - INFO - Starting async job submit for node 69c41d76944faaf0e7f612a0 2026-03-27 17:38:04,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:04,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41d76944faaf0e7f612a0 HTTP/1.1" 200 None 2026-03-27 17:38:04,025 - lava_callback - DEBUG - Processing node 69c41d76944faaf0e7f612a0: baseline-arm64-clabbe 2026-03-27 17:38:04,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41d76944faaf0e7f612a0 2026-03-27 17:38:04,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:04,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41d76944faaf0e7f612a0 HTTP/1.1" 200 None 2026-03-27 17:38:04,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:04,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:38:04,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41d76944faaf0e7f612a0 HTTP/1.1" 200 None 2026-03-27 17:38:04,084 - lava_callback - ERROR - Error processing callback for node 69c41d76944faaf0e7f612a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:38:35,219 - lava_callback - INFO - Received callback for node 69c6c07402375b4506dfb821 INFO: 172.20.0.1:42096 - "POST /node/69c6c07402375b4506dfb821 HTTP/1.0" 202 Accepted 2026-03-27 17:38:35,226 - lava_callback - INFO - Starting async job submit for node 69c6c07402375b4506dfb821 2026-03-27 17:38:35,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:35,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c07402375b4506dfb821 HTTP/1.1" 200 None 2026-03-27 17:38:35,272 - lava_callback - DEBUG - Processing node 69c6c07402375b4506dfb821: baseline-arm64 2026-03-27 17:38:35,407 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:38:35,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:38:35,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:38:35,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c07402375b4506dfb821/lava-logs.yaml 2026-03-27 17:38:35,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:38:35,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:38:35,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c07402375b4506dfb821/lava_callback.json.gz 2026-03-27 17:38:35,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:35,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c07402375b4506dfb821 HTTP/1.1" 200 None 2026-03-27 17:38:35,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:35,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:38:35,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:35,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c07402375b4506dfb821 HTTP/1.1" 200 None 2026-03-27 17:38:35,969 - lava_callback - INFO - Completed processing callback for node 69c6c07402375b4506dfb821 INFO: 172.20.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41122 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:38:59,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:38:59,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:39:44,098 - lava_callback - INFO - Received callback for node 69c41dca944faaf0e7f612a5 INFO: 172.20.0.1:34500 - "POST /node/69c41dca944faaf0e7f612a5 HTTP/1.0" 202 Accepted 2026-03-27 17:39:44,103 - lava_callback - INFO - Starting async job submit for node 69c41dca944faaf0e7f612a5 2026-03-27 17:39:44,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:39:44,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41dca944faaf0e7f612a5 HTTP/1.1" 200 None 2026-03-27 17:39:44,120 - lava_callback - DEBUG - Processing node 69c41dca944faaf0e7f612a5: baseline-arm64-clabbe 2026-03-27 17:39:44,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41dca944faaf0e7f612a5 2026-03-27 17:39:44,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:39:44,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41dca944faaf0e7f612a5 HTTP/1.1" 200 None 2026-03-27 17:39:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:39:44,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:39:44,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:39:44,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41dca944faaf0e7f612a5 HTTP/1.1" 200 None 2026-03-27 17:39:44,178 - lava_callback - ERROR - Error processing callback for node 69c41dca944faaf0e7f612a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:42:24,423 - lava_callback - INFO - Received callback for node 69c41e73944faaf0e7f612c4 INFO: 172.20.0.1:44284 - "POST /node/69c41e73944faaf0e7f612c4 HTTP/1.0" 202 Accepted 2026-03-27 17:42:24,428 - lava_callback - INFO - Starting async job submit for node 69c41e73944faaf0e7f612c4 2026-03-27 17:42:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:42:24,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41e73944faaf0e7f612c4 HTTP/1.1" 200 None 2026-03-27 17:42:24,445 - lava_callback - DEBUG - Processing node 69c41e73944faaf0e7f612c4: baseline-arm64-clabbe 2026-03-27 17:42:24,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41e73944faaf0e7f612c4 2026-03-27 17:42:24,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:42:24,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41e73944faaf0e7f612c4 HTTP/1.1" 200 None 2026-03-27 17:42:24,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:42:24,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:42:24,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:42:24,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41e73944faaf0e7f612c4 HTTP/1.1" 200 None 2026-03-27 17:42:24,500 - lava_callback - ERROR - Error processing callback for node 69c41e73944faaf0e7f612c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55110 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:45:04,590 - lava_callback - INFO - Received callback for node 69c41f1b944faaf0e7f612e1 INFO: 172.20.0.1:33250 - "POST /node/69c41f1b944faaf0e7f612e1 HTTP/1.0" 202 Accepted 2026-03-27 17:45:04,595 - lava_callback - INFO - Starting async job submit for node 69c41f1b944faaf0e7f612e1 2026-03-27 17:45:04,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:45:04,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f1b944faaf0e7f612e1 HTTP/1.1" 200 None 2026-03-27 17:45:04,611 - lava_callback - DEBUG - Processing node 69c41f1b944faaf0e7f612e1: baseline-arm64-clabbe 2026-03-27 17:45:04,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41f1b944faaf0e7f612e1 2026-03-27 17:45:04,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:45:04,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41f1b944faaf0e7f612e1 HTTP/1.1" 200 None 2026-03-27 17:45:04,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:45:04,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:45:04,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:45:04,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41f1b944faaf0e7f612e1 HTTP/1.1" 200 None 2026-03-27 17:45:04,690 - lava_callback - ERROR - Error processing callback for node 69c41f1b944faaf0e7f612e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:46:19,168 - lava_callback - INFO - Received callback for node 69c6bd7702375b4506dfb792 INFO: 172.20.0.1:60066 - "POST /node/69c6bd7702375b4506dfb792 HTTP/1.0" 202 Accepted 2026-03-27 17:46:19,175 - lava_callback - INFO - Starting async job submit for node 69c6bd7702375b4506dfb792 2026-03-27 17:46:19,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:19,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bd7702375b4506dfb792 HTTP/1.1" 200 None 2026-03-27 17:46:19,228 - lava_callback - DEBUG - Processing node 69c6bd7702375b4506dfb792: baseline-arm64 2026-03-27 17:46:19,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:19,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:19,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6bd7702375b4506dfb792/log.txt.gz 2026-03-27 17:46:19,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:20,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:20,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6bd7702375b4506dfb792/lava-logs.yaml 2026-03-27 17:46:20,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:20,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:20,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6bd7702375b4506dfb792/lava_callback.json.gz DEBUG: Setup failed for 69c6bd7702375b4506dfb792. Transitting job node result: incomplete -> fail 2026-03-27 17:46:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:20,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bd7702375b4506dfb792 HTTP/1.1" 200 None 2026-03-27 17:46:20,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:20,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:46:20,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:20,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bd7702375b4506dfb792 HTTP/1.1" 200 None 2026-03-27 17:46:20,669 - lava_callback - INFO - Completed processing callback for node 69c6bd7702375b4506dfb792 2026-03-27 17:46:21,636 - lava_callback - INFO - Received callback for node 69c6be1102375b4506dfb7ab INFO: 172.20.0.1:56712 - "POST /node/69c6be1102375b4506dfb7ab HTTP/1.0" 202 Accepted 2026-03-27 17:46:21,642 - lava_callback - INFO - Starting async job submit for node 69c6be1102375b4506dfb7ab 2026-03-27 17:46:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:21,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6be1102375b4506dfb7ab HTTP/1.1" 200 None 2026-03-27 17:46:21,681 - lava_callback - DEBUG - Processing node 69c6be1102375b4506dfb7ab: baseline-arm64 2026-03-27 17:46:22,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:22,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:22,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6be1102375b4506dfb7ab/log.txt.gz 2026-03-27 17:46:22,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:22,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:22,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6be1102375b4506dfb7ab/lava-logs.yaml 2026-03-27 17:46:22,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:22,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:22,953 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6be1102375b4506dfb7ab/lava_callback.json.gz 2026-03-27 17:46:22,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:22,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6be1102375b4506dfb7ab HTTP/1.1" 200 None 2026-03-27 17:46:22,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:46:23,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:23,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6be1102375b4506dfb7ab HTTP/1.1" 200 None 2026-03-27 17:46:23,157 - lava_callback - INFO - Completed processing callback for node 69c6be1102375b4506dfb7ab INFO: 172.20.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:46:29,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:29,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:46:40,278 - lava_callback - INFO - Received callback for node 69c6c27702375b4506dfb887 INFO: 172.20.0.1:57482 - "POST /node/69c6c27702375b4506dfb887 HTTP/1.0" 202 Accepted 2026-03-27 17:46:40,284 - lava_callback - INFO - Starting async job submit for node 69c6c27702375b4506dfb887 2026-03-27 17:46:40,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:40,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c27702375b4506dfb887 HTTP/1.1" 200 None 2026-03-27 17:46:40,302 - lava_callback - DEBUG - Processing node 69c6c27702375b4506dfb887: baseline-arm 2026-03-27 17:46:40,307 - lava_callback - WARNING - Failed to upload log 2026-03-27 17:46:40,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:40,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:40,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6c27702375b4506dfb887/lava-logs.yaml 2026-03-27 17:46:40,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:46:40,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:46:40,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6c27702375b4506dfb887/lava_callback.json.gz 2026-03-27 17:46:40,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:40,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c27702375b4506dfb887 HTTP/1.1" 200 None 2026-03-27 17:46:40,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:40,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 17:46:40,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:40,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c27702375b4506dfb887 HTTP/1.1" 200 None 2026-03-27 17:46:40,638 - lava_callback - INFO - Completed processing callback for node 69c6c27702375b4506dfb887 INFO: 172.20.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58434 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:46:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:46:59,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:48:04,437 - lava_callback - INFO - Received callback for node 69c41fc2944faaf0e7f612f0 INFO: 172.20.0.1:36304 - "POST /node/69c41fc2944faaf0e7f612f0 HTTP/1.0" 202 Accepted 2026-03-27 17:48:04,442 - lava_callback - INFO - Starting async job submit for node 69c41fc2944faaf0e7f612f0 2026-03-27 17:48:04,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:04,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41fc2944faaf0e7f612f0 HTTP/1.1" 200 None 2026-03-27 17:48:04,459 - lava_callback - DEBUG - Processing node 69c41fc2944faaf0e7f612f0: baseline-arm64-clabbe 2026-03-27 17:48:04,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c41fc2944faaf0e7f612f0 2026-03-27 17:48:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:04,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c41fc2944faaf0e7f612f0 HTTP/1.1" 200 None 2026-03-27 17:48:04,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:04,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 17:48:04,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:04,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c41fc2944faaf0e7f612f0 HTTP/1.1" 200 None 2026-03-27 17:48:04,510 - lava_callback - ERROR - Error processing callback for node 69c41fc2944faaf0e7f612f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43734 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:48:43,687 - lava_callback - INFO - Received callback for node 69c6c24402375b4506dfb877 INFO: 172.20.0.1:54974 - "POST /node/69c6c24402375b4506dfb877 HTTP/1.0" 202 Accepted 2026-03-27 17:48:43,696 - lava_callback - INFO - Starting async job submit for node 69c6c24402375b4506dfb877 2026-03-27 17:48:43,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:43,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c24402375b4506dfb877 HTTP/1.1" 200 None 2026-03-27 17:48:43,751 - lava_callback - DEBUG - Processing node 69c6c24402375b4506dfb877: baseline-arm64-foundriesio 2026-03-27 17:48:44,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:48:44,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:48:44,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6c24402375b4506dfb877/log.txt.gz 2026-03-27 17:48:45,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:48:45,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:48:45,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6c24402375b4506dfb877/lava-logs.yaml 2026-03-27 17:48:45,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:48:45,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:48:45,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6c24402375b4506dfb877/lava_callback.json.gz DEBUG: 69c6c24402375b4506dfb877 Transitting job node result: pass -> incomplete 2026-03-27 17:48:45,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:45,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c24402375b4506dfb877 HTTP/1.1" 200 None 2026-03-27 17:48:45,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:45,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:48:45,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:48:45,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c24402375b4506dfb877 HTTP/1.1" 200 None 2026-03-27 17:48:45,879 - lava_callback - INFO - Completed processing callback for node 69c6c24402375b4506dfb877 INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:49:00,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:49:00,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:50:23,146 - lava_callback - INFO - Received callback for node 69c42056944faaf0e7f6130f INFO: 172.20.0.1:44208 - "POST /node/69c42056944faaf0e7f6130f HTTP/1.0" 202 Accepted 2026-03-27 17:50:23,152 - lava_callback - INFO - Starting async job submit for node 69c42056944faaf0e7f6130f 2026-03-27 17:50:23,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:50:23,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42056944faaf0e7f6130f HTTP/1.1" 200 None 2026-03-27 17:50:23,168 - lava_callback - DEBUG - Processing node 69c42056944faaf0e7f6130f: baseline-arm-baylibre 2026-03-27 17:50:23,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42056944faaf0e7f6130f 2026-03-27 17:50:23,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:50:23,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42056944faaf0e7f6130f HTTP/1.1" 200 None 2026-03-27 17:50:23,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:50:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:50:23,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:50:23,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42056944faaf0e7f6130f HTTP/1.1" 200 None 2026-03-27 17:50:23,224 - lava_callback - ERROR - Error processing callback for node 69c42056944faaf0e7f6130f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:51:03,136 - lava_callback - INFO - Received callback for node 69c42080944faaf0e7f6131d INFO: 172.20.0.1:38646 - "POST /node/69c42080944faaf0e7f6131d HTTP/1.0" 202 Accepted 2026-03-27 17:51:03,141 - lava_callback - INFO - Starting async job submit for node 69c42080944faaf0e7f6131d 2026-03-27 17:51:03,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:03,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42080944faaf0e7f6131d HTTP/1.1" 200 None 2026-03-27 17:51:03,165 - lava_callback - DEBUG - Processing node 69c42080944faaf0e7f6131d: baseline-arm-baylibre 2026-03-27 17:51:03,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42080944faaf0e7f6131d 2026-03-27 17:51:03,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:03,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42080944faaf0e7f6131d HTTP/1.1" 200 None 2026-03-27 17:51:03,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:03,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:51:03,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:03,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42080944faaf0e7f6131d HTTP/1.1" 200 None 2026-03-27 17:51:03,217 - lava_callback - ERROR - Error processing callback for node 69c42080944faaf0e7f6131d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:51:43,180 - lava_callback - INFO - Received callback for node 69c420aa944faaf0e7f61326 INFO: 172.20.0.1:58928 - "POST /node/69c420aa944faaf0e7f61326 HTTP/1.0" 202 Accepted 2026-03-27 17:51:43,185 - lava_callback - INFO - Starting async job submit for node 69c420aa944faaf0e7f61326 2026-03-27 17:51:43,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:43,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420aa944faaf0e7f61326 HTTP/1.1" 200 None 2026-03-27 17:51:43,203 - lava_callback - DEBUG - Processing node 69c420aa944faaf0e7f61326: baseline-arm-baylibre 2026-03-27 17:51:43,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c420aa944faaf0e7f61326 2026-03-27 17:51:43,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:43,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420aa944faaf0e7f61326 HTTP/1.1" 200 None 2026-03-27 17:51:43,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:43,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:51:43,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:51:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c420aa944faaf0e7f61326 HTTP/1.1" 200 None 2026-03-27 17:51:43,258 - lava_callback - ERROR - Error processing callback for node 69c420aa944faaf0e7f61326: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34804 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:52:23,183 - lava_callback - INFO - Received callback for node 69c420d5944faaf0e7f61331 INFO: 172.20.0.1:46838 - "POST /node/69c420d5944faaf0e7f61331 HTTP/1.0" 202 Accepted 2026-03-27 17:52:23,189 - lava_callback - INFO - Starting async job submit for node 69c420d5944faaf0e7f61331 2026-03-27 17:52:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:52:23,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420d5944faaf0e7f61331 HTTP/1.1" 200 None 2026-03-27 17:52:23,214 - lava_callback - DEBUG - Processing node 69c420d5944faaf0e7f61331: baseline-arm-baylibre 2026-03-27 17:52:23,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c420d5944faaf0e7f61331 2026-03-27 17:52:23,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:52:23,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420d5944faaf0e7f61331 HTTP/1.1" 200 None 2026-03-27 17:52:23,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:52:23,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:52:23,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:52:23,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c420d5944faaf0e7f61331 HTTP/1.1" 200 None 2026-03-27 17:52:23,272 - lava_callback - ERROR - Error processing callback for node 69c420d5944faaf0e7f61331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:53:23,320 - lava_callback - INFO - Received callback for node 69c420ff944faaf0e7f6133d INFO: 172.20.0.1:50366 - "POST /node/69c420ff944faaf0e7f6133d HTTP/1.0" 202 Accepted 2026-03-27 17:53:23,325 - lava_callback - INFO - Starting async job submit for node 69c420ff944faaf0e7f6133d 2026-03-27 17:53:23,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:53:23,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420ff944faaf0e7f6133d HTTP/1.1" 200 None 2026-03-27 17:53:23,366 - lava_callback - DEBUG - Processing node 69c420ff944faaf0e7f6133d: baseline-arm-baylibre 2026-03-27 17:53:23,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c420ff944faaf0e7f6133d 2026-03-27 17:53:23,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:53:23,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c420ff944faaf0e7f6133d HTTP/1.1" 200 None 2026-03-27 17:53:23,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:53:23,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:53:23,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:53:23,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c420ff944faaf0e7f6133d HTTP/1.1" 200 None 2026-03-27 17:53:23,426 - lava_callback - ERROR - Error processing callback for node 69c420ff944faaf0e7f6133d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45434 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:54:03,336 - lava_callback - INFO - Received callback for node 69c4212a944faaf0e7f61355 INFO: 172.20.0.1:41258 - "POST /node/69c4212a944faaf0e7f61355 HTTP/1.0" 202 Accepted 2026-03-27 17:54:03,341 - lava_callback - INFO - Starting async job submit for node 69c4212a944faaf0e7f61355 2026-03-27 17:54:03,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:03,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4212a944faaf0e7f61355 HTTP/1.1" 200 None 2026-03-27 17:54:03,378 - lava_callback - DEBUG - Processing node 69c4212a944faaf0e7f61355: baseline-arm-baylibre 2026-03-27 17:54:03,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4212a944faaf0e7f61355 2026-03-27 17:54:03,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:03,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4212a944faaf0e7f61355 HTTP/1.1" 200 None 2026-03-27 17:54:03,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:03,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:54:03,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:03,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4212a944faaf0e7f61355 HTTP/1.1" 200 None 2026-03-27 17:54:03,429 - lava_callback - ERROR - Error processing callback for node 69c4212a944faaf0e7f61355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:54:44,770 - lava_callback - INFO - Received callback for node 69c42156944faaf0e7f61362 INFO: 172.20.0.1:44220 - "POST /node/69c42156944faaf0e7f61362 HTTP/1.0" 202 Accepted 2026-03-27 17:54:44,777 - lava_callback - INFO - Starting async job submit for node 69c42156944faaf0e7f61362 2026-03-27 17:54:44,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:44,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42156944faaf0e7f61362 HTTP/1.1" 200 None 2026-03-27 17:54:44,796 - lava_callback - DEBUG - Processing node 69c42156944faaf0e7f61362: baseline-arm-clabbe 2026-03-27 17:54:44,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42156944faaf0e7f61362 2026-03-27 17:54:44,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:44,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42156944faaf0e7f61362 HTTP/1.1" 200 None 2026-03-27 17:54:44,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:44,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:54:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:54:44,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42156944faaf0e7f61362 HTTP/1.1" 200 None 2026-03-27 17:54:44,860 - lava_callback - ERROR - Error processing callback for node 69c42156944faaf0e7f61362: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49846 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:55:23,797 - lava_callback - INFO - Received callback for node 69c6bfe302375b4506dfb80a INFO: 172.20.0.1:58204 - "POST /node/69c6bfe302375b4506dfb80a HTTP/1.0" 202 Accepted 2026-03-27 17:55:23,805 - lava_callback - INFO - Starting async job submit for node 69c6bfe302375b4506dfb80a 2026-03-27 17:55:23,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:55:23,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bfe302375b4506dfb80a HTTP/1.1" 200 None 2026-03-27 17:55:23,867 - lava_callback - DEBUG - Processing node 69c6bfe302375b4506dfb80a: baseline-nfs-arm64 2026-03-27 17:55:25,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:55:25,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:55:25,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bfe302375b4506dfb80a/log.txt.gz 2026-03-27 17:55:26,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 17:55:26,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:55:26,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bfe302375b4506dfb80a/lava-logs.yaml 2026-03-27 17:55:26,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:58212 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:55:26,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 17:55:26,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6bfe302375b4506dfb80a/lava_callback.json.gz DEBUG: Setup failed for 69c6bfe302375b4506dfb80a. Transitting job node result: incomplete -> fail 2026-03-27 17:55:26,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:55:26,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6bfe302375b4506dfb80a HTTP/1.1" 200 None 2026-03-27 17:55:26,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:55:26,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 17:55:26,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:55:26,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6bfe302375b4506dfb80a HTTP/1.1" 200 None 2026-03-27 17:55:26,777 - lava_callback - INFO - Completed processing callback for node 69c6bfe302375b4506dfb80a INFO: 172.20.0.1:58214 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:55:30,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:55:30,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55770 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:56:44,943 - lava_callback - INFO - Received callback for node 69c421d4944faaf0e7f61380 INFO: 172.20.0.1:44402 - "POST /node/69c421d4944faaf0e7f61380 HTTP/1.0" 202 Accepted 2026-03-27 17:56:44,949 - lava_callback - INFO - Starting async job submit for node 69c421d4944faaf0e7f61380 2026-03-27 17:56:44,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:56:44,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c421d4944faaf0e7f61380 HTTP/1.1" 200 None 2026-03-27 17:56:44,964 - lava_callback - DEBUG - Processing node 69c421d4944faaf0e7f61380: baseline-arm-clabbe 2026-03-27 17:56:44,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c421d4944faaf0e7f61380 2026-03-27 17:56:44,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:56:44,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c421d4944faaf0e7f61380 HTTP/1.1" 200 None 2026-03-27 17:56:44,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:56:44,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:56:44,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:56:45,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c421d4944faaf0e7f61380 HTTP/1.1" 200 None 2026-03-27 17:56:45,020 - lava_callback - ERROR - Error processing callback for node 69c421d4944faaf0e7f61380: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42330 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:57:24,939 - lava_callback - INFO - Received callback for node 69c421ff944faaf0e7f61395 INFO: 172.20.0.1:44472 - "POST /node/69c421ff944faaf0e7f61395 HTTP/1.0" 202 Accepted 2026-03-27 17:57:24,945 - lava_callback - INFO - Starting async job submit for node 69c421ff944faaf0e7f61395 2026-03-27 17:57:24,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:57:24,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c421ff944faaf0e7f61395 HTTP/1.1" 200 None 2026-03-27 17:57:24,971 - lava_callback - DEBUG - Processing node 69c421ff944faaf0e7f61395: baseline-arm-clabbe 2026-03-27 17:57:24,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c421ff944faaf0e7f61395 2026-03-27 17:57:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:57:24,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c421ff944faaf0e7f61395 HTTP/1.1" 200 None 2026-03-27 17:57:24,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:57:25,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:57:25,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:57:25,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c421ff944faaf0e7f61395 HTTP/1.1" 200 None 2026-03-27 17:57:25,034 - lava_callback - ERROR - Error processing callback for node 69c421ff944faaf0e7f61395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58904 - "GET / HTTP/1.0" 200 OK 2026-03-27 17:58:04,964 - lava_callback - INFO - Received callback for node 69c42229944faaf0e7f613a0 INFO: 172.20.0.1:59296 - "POST /node/69c42229944faaf0e7f613a0 HTTP/1.0" 202 Accepted 2026-03-27 17:58:04,969 - lava_callback - INFO - Starting async job submit for node 69c42229944faaf0e7f613a0 2026-03-27 17:58:04,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:58:04,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42229944faaf0e7f613a0 HTTP/1.1" 200 None 2026-03-27 17:58:04,985 - lava_callback - DEBUG - Processing node 69c42229944faaf0e7f613a0: baseline-arm-clabbe 2026-03-27 17:58:04,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42229944faaf0e7f613a0 2026-03-27 17:58:04,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:58:05,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42229944faaf0e7f613a0 HTTP/1.1" 200 None 2026-03-27 17:58:05,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:58:05,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 17:58:05,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 17:58:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42229944faaf0e7f613a0 HTTP/1.1" 200 None 2026-03-27 17:58:05,059 - lava_callback - ERROR - Error processing callback for node 69c42229944faaf0e7f613a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36360 - "GET /node/698ee512f0e3ffbba67d2100%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36368 - "GET /node/6992fad331166481c8dde34f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:00:25,105 - lava_callback - INFO - Received callback for node 69c422a8944faaf0e7f613be INFO: 172.20.0.1:46432 - "POST /node/69c422a8944faaf0e7f613be HTTP/1.0" 202 Accepted 2026-03-27 18:00:25,111 - lava_callback - INFO - Starting async job submit for node 69c422a8944faaf0e7f613be 2026-03-27 18:00:25,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:00:25,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422a8944faaf0e7f613be HTTP/1.1" 200 None 2026-03-27 18:00:25,127 - lava_callback - DEBUG - Processing node 69c422a8944faaf0e7f613be: baseline-arm-clabbe 2026-03-27 18:00:25,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c422a8944faaf0e7f613be 2026-03-27 18:00:25,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:00:25,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c422a8944faaf0e7f613be HTTP/1.1" 200 None 2026-03-27 18:00:25,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:00:25,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-27 18:00:25,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:00:25,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c422a8944faaf0e7f613be HTTP/1.1" 200 None 2026-03-27 18:00:25,192 - lava_callback - ERROR - Error processing callback for node 69c422a8944faaf0e7f613be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46450 - "GET /node/69408625575bc060ce15df12%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41390 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:02:08,731 - lava_callback - INFO - Received callback for node 69c6c60402375b4506dfb954 INFO: 172.20.0.1:41396 - "POST /node/69c6c60402375b4506dfb954 HTTP/1.0" 202 Accepted 2026-03-27 18:02:08,737 - lava_callback - INFO - Starting async job submit for node 69c6c60402375b4506dfb954 2026-03-27 18:02:08,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:02:08,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c60402375b4506dfb954 HTTP/1.1" 200 None 2026-03-27 18:02:08,753 - lava_callback - DEBUG - Processing node 69c6c60402375b4506dfb954: baseline-nfs-arm64 2026-03-27 18:02:08,754 - lava_callback - WARNING - Failed to upload log 2026-03-27 18:02:08,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:02:08,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:02:08,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6c60402375b4506dfb954/lava-logs.yaml 2026-03-27 18:02:08,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:02:09,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:02:09,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6c60402375b4506dfb954/lava_callback.json.gz 2026-03-27 18:02:09,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:02:09,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c60402375b4506dfb954 HTTP/1.1" 200 None 2026-03-27 18:02:09,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:02:09,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:02:09,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:02:09,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c60402375b4506dfb954 HTTP/1.1" 200 None 2026-03-27 18:02:09,163 - lava_callback - INFO - Completed processing callback for node 69c6c60402375b4506dfb954 INFO: 172.20.0.1:57730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:02:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:02:30,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:07:04,477 - lava_callback - INFO - Received callback for node 69c42432944faaf0e7f613f8 INFO: 172.20.0.1:60722 - "POST /node/69c42432944faaf0e7f613f8 HTTP/1.0" 202 Accepted 2026-03-27 18:07:04,483 - lava_callback - INFO - Starting async job submit for node 69c42432944faaf0e7f613f8 2026-03-27 18:07:04,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:04,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42432944faaf0e7f613f8 HTTP/1.1" 200 None 2026-03-27 18:07:04,505 - lava_callback - DEBUG - Processing node 69c42432944faaf0e7f613f8: baseline-arm-baylibre 2026-03-27 18:07:04,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42432944faaf0e7f613f8 2026-03-27 18:07:04,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:04,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42432944faaf0e7f613f8 HTTP/1.1" 200 None 2026-03-27 18:07:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:04,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:07:04,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:04,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42432944faaf0e7f613f8 HTTP/1.1" 200 None 2026-03-27 18:07:04,577 - lava_callback - ERROR - Error processing callback for node 69c42432944faaf0e7f613f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:07:43,205 - lava_callback - INFO - Received callback for node 69c6c72f02375b4506dfb98c INFO: 172.20.0.1:43740 - "POST /node/69c6c72f02375b4506dfb98c HTTP/1.0" 202 Accepted 2026-03-27 18:07:43,212 - lava_callback - INFO - Starting async job submit for node 69c6c72f02375b4506dfb98c 2026-03-27 18:07:43,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:43,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c72f02375b4506dfb98c HTTP/1.1" 200 None 2026-03-27 18:07:43,255 - lava_callback - DEBUG - Processing node 69c6c72f02375b4506dfb98c: baseline-arm64 2026-03-27 18:07:43,388 - lava_callback - WARNING - Failed to upload log 2026-03-27 18:07:43,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:07:43,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:07:43,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c72f02375b4506dfb98c/lava-logs.yaml 2026-03-27 18:07:43,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:07:43,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:07:43,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c72f02375b4506dfb98c/lava_callback.json.gz 2026-03-27 18:07:43,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:43,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c72f02375b4506dfb98c HTTP/1.1" 200 None 2026-03-27 18:07:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:43,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:07:43,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:43,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c72f02375b4506dfb98c HTTP/1.1" 200 None 2026-03-27 18:07:43,951 - lava_callback - INFO - Completed processing callback for node 69c6c72f02375b4506dfb98c 2026-03-27 18:07:44,056 - lava_callback - INFO - Received callback for node 69c4245d944faaf0e7f61402 INFO: 172.20.0.1:43752 - "POST /node/69c4245d944faaf0e7f61402 HTTP/1.0" 202 Accepted 2026-03-27 18:07:44,062 - lava_callback - INFO - Starting async job submit for node 69c4245d944faaf0e7f61402 2026-03-27 18:07:44,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:44,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4245d944faaf0e7f61402 HTTP/1.1" 200 None 2026-03-27 18:07:44,082 - lava_callback - DEBUG - Processing node 69c4245d944faaf0e7f61402: baseline-arm-baylibre 2026-03-27 18:07:44,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4245d944faaf0e7f61402 2026-03-27 18:07:44,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:44,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4245d944faaf0e7f61402 HTTP/1.1" 200 None 2026-03-27 18:07:44,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:44,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:07:44,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:07:44,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4245d944faaf0e7f61402 HTTP/1.1" 200 None 2026-03-27 18:07:44,173 - lava_callback - ERROR - Error processing callback for node 69c4245d944faaf0e7f61402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:08:00,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:00,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:08:09,941 - lava_callback - INFO - Received callback for node 69c6c35802375b4506dfb8be INFO: 172.20.0.1:50066 - "POST /node/69c6c35802375b4506dfb8be HTTP/1.0" 202 Accepted 2026-03-27 18:08:09,947 - lava_callback - INFO - Starting async job submit for node 69c6c35802375b4506dfb8be 2026-03-27 18:08:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:10,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c35802375b4506dfb8be HTTP/1.1" 200 None 2026-03-27 18:08:10,047 - lava_callback - DEBUG - Processing node 69c6c35802375b4506dfb8be: baseline-arm 2026-03-27 18:08:10,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:08:10,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:08:10,774 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6c35802375b4506dfb8be/log.txt.gz 2026-03-27 18:08:11,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:08:11,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:08:11,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6c35802375b4506dfb8be/lava-logs.yaml 2026-03-27 18:08:11,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:08:11,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:08:11,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6c35802375b4506dfb8be/lava_callback.json.gz DEBUG: Setup failed for 69c6c35802375b4506dfb8be. Transitting job node result: incomplete -> fail 2026-03-27 18:08:11,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:11,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c35802375b4506dfb8be HTTP/1.1" 200 None 2026-03-27 18:08:11,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:11,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 18:08:11,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:11,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c35802375b4506dfb8be HTTP/1.1" 200 None 2026-03-27 18:08:11,906 - lava_callback - INFO - Completed processing callback for node 69c6c35802375b4506dfb8be INFO: 172.20.0.1:50082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50094 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:08:24,099 - lava_callback - INFO - Received callback for node 69c42487944faaf0e7f6140c INFO: 172.20.0.1:41794 - "POST /node/69c42487944faaf0e7f6140c HTTP/1.0" 202 Accepted 2026-03-27 18:08:24,104 - lava_callback - INFO - Starting async job submit for node 69c42487944faaf0e7f6140c 2026-03-27 18:08:24,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:24,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42487944faaf0e7f6140c HTTP/1.1" 200 None 2026-03-27 18:08:24,122 - lava_callback - DEBUG - Processing node 69c42487944faaf0e7f6140c: baseline-arm-baylibre 2026-03-27 18:08:24,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42487944faaf0e7f6140c 2026-03-27 18:08:24,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:24,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42487944faaf0e7f6140c HTTP/1.1" 200 None 2026-03-27 18:08:24,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:24,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:08:24,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:24,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42487944faaf0e7f6140c HTTP/1.1" 200 None 2026-03-27 18:08:24,188 - lava_callback - ERROR - Error processing callback for node 69c42487944faaf0e7f6140c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41810 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:08:30,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:08:30,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:09:04,138 - lava_callback - INFO - Received callback for node 69c424b2944faaf0e7f61421 INFO: 172.20.0.1:32896 - "POST /node/69c424b2944faaf0e7f61421 HTTP/1.0" 202 Accepted 2026-03-27 18:09:04,144 - lava_callback - INFO - Starting async job submit for node 69c424b2944faaf0e7f61421 2026-03-27 18:09:04,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:04,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c424b2944faaf0e7f61421 HTTP/1.1" 200 None 2026-03-27 18:09:04,168 - lava_callback - DEBUG - Processing node 69c424b2944faaf0e7f61421: baseline-arm-baylibre 2026-03-27 18:09:04,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c424b2944faaf0e7f61421 2026-03-27 18:09:04,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:04,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c424b2944faaf0e7f61421 HTTP/1.1" 200 None 2026-03-27 18:09:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:09:04,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:04,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c424b2944faaf0e7f61421 HTTP/1.1" 200 None 2026-03-27 18:09:04,237 - lava_callback - ERROR - Error processing callback for node 69c424b2944faaf0e7f61421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32910 - "GET /node/69840347969566dcb0d2b825%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39640 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:09:33,943 - lava_callback - INFO - Received callback for node 69c6c5f702375b4506dfb951 INFO: 172.20.0.1:47668 - "POST /node/69c6c5f702375b4506dfb951 HTTP/1.0" 202 Accepted 2026-03-27 18:09:33,949 - lava_callback - INFO - Starting async job submit for node 69c6c5f702375b4506dfb951 2026-03-27 18:09:33,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:33,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c5f702375b4506dfb951 HTTP/1.1" 200 None 2026-03-27 18:09:33,989 - lava_callback - DEBUG - Processing node 69c6c5f702375b4506dfb951: ltp-pty 2026-03-27 18:09:34,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:09:34,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:09:34,523 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c6c5f702375b4506dfb951/log.txt.gz 2026-03-27 18:09:34,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:09:34,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:09:34,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c6c5f702375b4506dfb951/lava-logs.yaml 2026-03-27 18:09:34,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:09:35,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:09:35,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c6c5f702375b4506dfb951/lava_callback.json.gz 2026-03-27 18:09:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:35,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c5f702375b4506dfb951 HTTP/1.1" 200 None 2026-03-27 18:09:35,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:35,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 18:09:35,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:35,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c5f702375b4506dfb951 HTTP/1.1" 200 None 2026-03-27 18:09:35,268 - lava_callback - INFO - Completed processing callback for node 69c6c5f702375b4506dfb951 INFO: 172.20.0.1:47684 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:09:45,520 - lava_callback - INFO - Received callback for node 69c424df944faaf0e7f6142d INFO: 172.20.0.1:48924 - "POST /node/69c424df944faaf0e7f6142d HTTP/1.0" 202 Accepted 2026-03-27 18:09:45,526 - lava_callback - INFO - Starting async job submit for node 69c424df944faaf0e7f6142d 2026-03-27 18:09:45,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:45,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c424df944faaf0e7f6142d HTTP/1.1" 200 None 2026-03-27 18:09:45,542 - lava_callback - DEBUG - Processing node 69c424df944faaf0e7f6142d: baseline-arm-clabbe 2026-03-27 18:09:45,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c424df944faaf0e7f6142d 2026-03-27 18:09:45,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:45,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c424df944faaf0e7f6142d HTTP/1.1" 200 None 2026-03-27 18:09:45,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:09:45,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:09:45,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c424df944faaf0e7f6142d HTTP/1.1" 200 None 2026-03-27 18:09:45,622 - lava_callback - ERROR - Error processing callback for node 69c424df944faaf0e7f6142d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38906 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:10:00,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:00,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:10:24,267 - lava_callback - INFO - Received callback for node 69c42507944faaf0e7f61437 INFO: 172.20.0.1:32910 - "POST /node/69c42507944faaf0e7f61437 HTTP/1.0" 202 Accepted 2026-03-27 18:10:24,272 - lava_callback - INFO - Starting async job submit for node 69c42507944faaf0e7f61437 2026-03-27 18:10:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:24,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42507944faaf0e7f61437 HTTP/1.1" 200 None 2026-03-27 18:10:24,288 - lava_callback - DEBUG - Processing node 69c42507944faaf0e7f61437: baseline-arm-baylibre 2026-03-27 18:10:24,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42507944faaf0e7f61437 2026-03-27 18:10:24,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:24,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42507944faaf0e7f61437 HTTP/1.1" 200 None 2026-03-27 18:10:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:24,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:10:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:24,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42507944faaf0e7f61437 HTTP/1.1" 200 None 2026-03-27 18:10:24,343 - lava_callback - ERROR - Error processing callback for node 69c42507944faaf0e7f61437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-27 18:10:26,454 - lava_callback - INFO - Received callback for node 69c6c7c802375b4506dfb9b0 INFO: 172.20.0.1:32920 - "POST /node/69c6c7c802375b4506dfb9b0 HTTP/1.0" 202 Accepted 2026-03-27 18:10:26,461 - lava_callback - INFO - Starting async job submit for node 69c6c7c802375b4506dfb9b0 2026-03-27 18:10:26,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:26,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c7c802375b4506dfb9b0 HTTP/1.1" 200 None 2026-03-27 18:10:26,506 - lava_callback - DEBUG - Processing node 69c6c7c802375b4506dfb9b0: baseline-arm64 INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:10:26,740 - lava_callback - WARNING - Failed to upload log 2026-03-27 18:10:26,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:10:27,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:10:27,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c7c802375b4506dfb9b0/lava-logs.yaml 2026-03-27 18:10:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:10:27,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:10:27,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c7c802375b4506dfb9b0/lava_callback.json.gz 2026-03-27 18:10:27,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:27,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c7c802375b4506dfb9b0 HTTP/1.1" 200 None 2026-03-27 18:10:27,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:27,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:10:27,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:27,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c7c802375b4506dfb9b0 HTTP/1.1" 200 None 2026-03-27 18:10:27,385 - lava_callback - INFO - Completed processing callback for node 69c6c7c802375b4506dfb9b0 INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:10:30,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:10:30,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37682 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:11:05,619 - lava_callback - INFO - Received callback for node 69c42534944faaf0e7f61445 INFO: 172.20.0.1:60608 - "POST /node/69c42534944faaf0e7f61445 HTTP/1.0" 202 Accepted 2026-03-27 18:11:05,624 - lava_callback - INFO - Starting async job submit for node 69c42534944faaf0e7f61445 2026-03-27 18:11:05,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:05,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42534944faaf0e7f61445 HTTP/1.1" 200 None 2026-03-27 18:11:05,654 - lava_callback - DEBUG - Processing node 69c42534944faaf0e7f61445: baseline-arm-clabbe 2026-03-27 18:11:05,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42534944faaf0e7f61445 2026-03-27 18:11:05,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:05,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42534944faaf0e7f61445 HTTP/1.1" 200 None 2026-03-27 18:11:05,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:05,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:11:05,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:05,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42534944faaf0e7f61445 HTTP/1.1" 200 None 2026-03-27 18:11:05,711 - lava_callback - ERROR - Error processing callback for node 69c42534944faaf0e7f61445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:11:44,296 - lava_callback - INFO - Received callback for node 69c4255b944faaf0e7f6144c INFO: 172.20.0.1:35090 - "POST /node/69c4255b944faaf0e7f6144c HTTP/1.0" 202 Accepted 2026-03-27 18:11:44,302 - lava_callback - INFO - Starting async job submit for node 69c4255b944faaf0e7f6144c 2026-03-27 18:11:44,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:44,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4255b944faaf0e7f6144c HTTP/1.1" 200 None 2026-03-27 18:11:44,317 - lava_callback - DEBUG - Processing node 69c4255b944faaf0e7f6144c: baseline-arm-baylibre 2026-03-27 18:11:44,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4255b944faaf0e7f6144c 2026-03-27 18:11:44,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:44,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4255b944faaf0e7f6144c HTTP/1.1" 200 None 2026-03-27 18:11:44,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:44,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:11:44,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:11:44,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4255b944faaf0e7f6144c HTTP/1.1" 200 None 2026-03-27 18:11:44,383 - lava_callback - ERROR - Error processing callback for node 69c4255b944faaf0e7f6144c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:14:05,685 - lava_callback - INFO - Received callback for node 69c425da944faaf0e7f6145e INFO: 172.20.0.1:47530 - "POST /node/69c425da944faaf0e7f6145e HTTP/1.0" 202 Accepted 2026-03-27 18:14:05,691 - lava_callback - INFO - Starting async job submit for node 69c425da944faaf0e7f6145e 2026-03-27 18:14:05,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:05,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c425da944faaf0e7f6145e HTTP/1.1" 200 None 2026-03-27 18:14:05,707 - lava_callback - DEBUG - Processing node 69c425da944faaf0e7f6145e: baseline-arm-clabbe 2026-03-27 18:14:05,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c425da944faaf0e7f6145e 2026-03-27 18:14:05,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:05,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c425da944faaf0e7f6145e HTTP/1.1" 200 None 2026-03-27 18:14:05,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:05,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:14:05,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:05,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c425da944faaf0e7f6145e HTTP/1.1" 200 None 2026-03-27 18:14:05,770 - lava_callback - ERROR - Error processing callback for node 69c425da944faaf0e7f6145e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:14:45,612 - lava_callback - INFO - Received callback for node 69c42604944faaf0e7f6146b INFO: 172.20.0.1:50506 - "POST /node/69c42604944faaf0e7f6146b HTTP/1.0" 202 Accepted 2026-03-27 18:14:45,618 - lava_callback - INFO - Starting async job submit for node 69c42604944faaf0e7f6146b 2026-03-27 18:14:45,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:45,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42604944faaf0e7f6146b HTTP/1.1" 200 None 2026-03-27 18:14:45,659 - lava_callback - DEBUG - Processing node 69c42604944faaf0e7f6146b: baseline-arm-clabbe 2026-03-27 18:14:45,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42604944faaf0e7f6146b 2026-03-27 18:14:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42604944faaf0e7f6146b HTTP/1.1" 200 None 2026-03-27 18:14:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:45,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:14:45,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:14:45,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42604944faaf0e7f6146b HTTP/1.1" 200 None 2026-03-27 18:14:45,730 - lava_callback - ERROR - Error processing callback for node 69c42604944faaf0e7f6146b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:15:25,676 - lava_callback - INFO - Received callback for node 69c4262f944faaf0e7f61472 INFO: 172.20.0.1:60540 - "POST /node/69c4262f944faaf0e7f61472 HTTP/1.0" 202 Accepted 2026-03-27 18:15:25,682 - lava_callback - INFO - Starting async job submit for node 69c4262f944faaf0e7f61472 2026-03-27 18:15:25,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:15:25,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4262f944faaf0e7f61472 HTTP/1.1" 200 None 2026-03-27 18:15:25,698 - lava_callback - DEBUG - Processing node 69c4262f944faaf0e7f61472: baseline-arm-clabbe 2026-03-27 18:15:25,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4262f944faaf0e7f61472 2026-03-27 18:15:25,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:15:25,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4262f944faaf0e7f61472 HTTP/1.1" 200 None 2026-03-27 18:15:25,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:15:25,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-27 18:15:25,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:15:25,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4262f944faaf0e7f61472 HTTP/1.1" 200 None 2026-03-27 18:15:25,749 - lava_callback - ERROR - Error processing callback for node 69c4262f944faaf0e7f61472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:16:04,585 - lava_callback - INFO - Received callback for node 69c4265d944faaf0e7f61485 INFO: 172.20.0.1:39786 - "POST /node/69c4265d944faaf0e7f61485 HTTP/1.0" 202 Accepted 2026-03-27 18:16:04,590 - lava_callback - INFO - Starting async job submit for node 69c4265d944faaf0e7f61485 2026-03-27 18:16:04,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:04,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4265d944faaf0e7f61485 HTTP/1.1" 200 None 2026-03-27 18:16:04,613 - lava_callback - DEBUG - Processing node 69c4265d944faaf0e7f61485: baseline-arm64-baylibre 2026-03-27 18:16:04,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4265d944faaf0e7f61485 2026-03-27 18:16:04,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:04,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4265d944faaf0e7f61485 HTTP/1.1" 200 None 2026-03-27 18:16:04,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:04,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:16:04,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:04,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4265d944faaf0e7f61485 HTTP/1.1" 200 None 2026-03-27 18:16:04,665 - lava_callback - ERROR - Error processing callback for node 69c4265d944faaf0e7f61485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43840 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:16:17,672 - lava_callback - INFO - Received callback for node 69c6c6ec02375b4506dfb97d INFO: 172.20.0.1:43852 - "POST /node/69c6c6ec02375b4506dfb97d HTTP/1.0" 202 Accepted 2026-03-27 18:16:17,679 - lava_callback - INFO - Starting async job submit for node 69c6c6ec02375b4506dfb97d 2026-03-27 18:16:17,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:17,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c6ec02375b4506dfb97d HTTP/1.1" 200 None 2026-03-27 18:16:17,719 - lava_callback - DEBUG - Processing node 69c6c6ec02375b4506dfb97d: baseline-nfs-arm64 2026-03-27 18:16:18,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:16:18,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:16:18,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6c6ec02375b4506dfb97d/log.txt.gz 2026-03-27 18:16:18,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:16:18,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:16:18,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6c6ec02375b4506dfb97d/lava-logs.yaml 2026-03-27 18:16:18,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:16:19,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:16:19,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6c6ec02375b4506dfb97d/lava_callback.json.gz 2026-03-27 18:16:19,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:19,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c6ec02375b4506dfb97d HTTP/1.1" 200 None 2026-03-27 18:16:19,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:19,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:16:19,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c6ec02375b4506dfb97d HTTP/1.1" 200 None 2026-03-27 18:16:19,246 - lava_callback - INFO - Completed processing callback for node 69c6c6ec02375b4506dfb97d INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40766 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:16:30,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:16:30,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33190 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:17:24,634 - lava_callback - INFO - Received callback for node 69c426b1944faaf0e7f61491 INFO: 172.20.0.1:56342 - "POST /node/69c426b1944faaf0e7f61491 HTTP/1.0" 202 Accepted 2026-03-27 18:17:24,639 - lava_callback - INFO - Starting async job submit for node 69c426b1944faaf0e7f61491 2026-03-27 18:17:24,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:17:24,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c426b1944faaf0e7f61491 HTTP/1.1" 200 None 2026-03-27 18:17:24,656 - lava_callback - DEBUG - Processing node 69c426b1944faaf0e7f61491: baseline-arm64-baylibre 2026-03-27 18:17:24,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c426b1944faaf0e7f61491 2026-03-27 18:17:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:17:24,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c426b1944faaf0e7f61491 HTTP/1.1" 200 None 2026-03-27 18:17:24,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:17:24,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:17:24,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:17:24,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c426b1944faaf0e7f61491 HTTP/1.1" 200 None 2026-03-27 18:17:24,717 - lava_callback - ERROR - Error processing callback for node 69c426b1944faaf0e7f61491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46218 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:19:04,780 - lava_callback - INFO - Received callback for node 69c42705944faaf0e7f614b7 INFO: 172.20.0.1:59218 - "POST /node/69c42705944faaf0e7f614b7 HTTP/1.0" 202 Accepted 2026-03-27 18:19:04,786 - lava_callback - INFO - Starting async job submit for node 69c42705944faaf0e7f614b7 2026-03-27 18:19:04,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:04,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42705944faaf0e7f614b7 HTTP/1.1" 200 None 2026-03-27 18:19:04,812 - lava_callback - DEBUG - Processing node 69c42705944faaf0e7f614b7: baseline-arm64-baylibre 2026-03-27 18:19:04,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42705944faaf0e7f614b7 2026-03-27 18:19:04,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:04,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42705944faaf0e7f614b7 HTTP/1.1" 200 None 2026-03-27 18:19:04,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:04,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:19:04,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:04,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42705944faaf0e7f614b7 HTTP/1.1" 200 None 2026-03-27 18:19:04,874 - lava_callback - ERROR - Error processing callback for node 69c42705944faaf0e7f614b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57198 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:19:22,911 - lava_callback - INFO - Received callback for node 69c6ca1b02375b4506dfba23 INFO: 172.20.0.1:58034 - "POST /node/69c6ca1b02375b4506dfba23 HTTP/1.0" 202 Accepted 2026-03-27 18:19:22,917 - lava_callback - INFO - Starting async job submit for node 69c6ca1b02375b4506dfba23 2026-03-27 18:19:22,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:22,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ca1b02375b4506dfba23 HTTP/1.1" 200 None 2026-03-27 18:19:22,935 - lava_callback - DEBUG - Processing node 69c6ca1b02375b4506dfba23: baseline-arm 2026-03-27 18:19:22,940 - lava_callback - WARNING - Failed to upload log 2026-03-27 18:19:22,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:19:23,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:19:23,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6ca1b02375b4506dfba23/lava-logs.yaml 2026-03-27 18:19:23,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:19:23,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:19:23,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6ca1b02375b4506dfba23/lava_callback.json.gz 2026-03-27 18:19:23,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:23,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ca1b02375b4506dfba23 HTTP/1.1" 200 None 2026-03-27 18:19:23,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:23,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 18:19:23,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:23,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6ca1b02375b4506dfba23 HTTP/1.1" 200 None 2026-03-27 18:19:23,503 - lava_callback - INFO - Completed processing callback for node 69c6ca1b02375b4506dfba23 INFO: 172.20.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58044 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:19:30,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:19:30,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59574 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:20:24,855 - lava_callback - INFO - Received callback for node 69c42759944faaf0e7f614c1 INFO: 172.20.0.1:44378 - "POST /node/69c42759944faaf0e7f614c1 HTTP/1.0" 202 Accepted 2026-03-27 18:20:24,860 - lava_callback - INFO - Starting async job submit for node 69c42759944faaf0e7f614c1 2026-03-27 18:20:24,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:20:24,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42759944faaf0e7f614c1 HTTP/1.1" 200 None 2026-03-27 18:20:24,885 - lava_callback - DEBUG - Processing node 69c42759944faaf0e7f614c1: baseline-arm64-baylibre 2026-03-27 18:20:24,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42759944faaf0e7f614c1 2026-03-27 18:20:24,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:20:24,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42759944faaf0e7f614c1 HTTP/1.1" 200 None 2026-03-27 18:20:24,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:20:24,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:20:24,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:20:24,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42759944faaf0e7f614c1 HTTP/1.1" 200 None 2026-03-27 18:20:24,936 - lava_callback - ERROR - Error processing callback for node 69c42759944faaf0e7f614c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56830 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:21:44,921 - lava_callback - INFO - Received callback for node 69c427ab944faaf0e7f614cc INFO: 172.20.0.1:40642 - "POST /node/69c427ab944faaf0e7f614cc HTTP/1.0" 202 Accepted 2026-03-27 18:21:44,927 - lava_callback - INFO - Starting async job submit for node 69c427ab944faaf0e7f614cc 2026-03-27 18:21:44,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:44,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c427ab944faaf0e7f614cc HTTP/1.1" 200 None 2026-03-27 18:21:44,944 - lava_callback - DEBUG - Processing node 69c427ab944faaf0e7f614cc: baseline-arm64-baylibre 2026-03-27 18:21:44,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c427ab944faaf0e7f614cc 2026-03-27 18:21:44,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:44,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c427ab944faaf0e7f614cc HTTP/1.1" 200 None 2026-03-27 18:21:44,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:44,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:21:44,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:45,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c427ab944faaf0e7f614cc HTTP/1.1" 200 None 2026-03-27 18:21:45,004 - lava_callback - ERROR - Error processing callback for node 69c427ab944faaf0e7f614cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:21:54,529 - lava_callback - INFO - Received callback for node 69c6c69402375b4506dfb96c INFO: 172.20.0.1:44908 - "POST /node/69c6c69402375b4506dfb96c HTTP/1.0" 202 Accepted 2026-03-27 18:21:54,536 - lava_callback - INFO - Starting async job submit for node 69c6c69402375b4506dfb96c 2026-03-27 18:21:54,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:54,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c69402375b4506dfb96c HTTP/1.1" 200 None 2026-03-27 18:21:54,612 - lava_callback - DEBUG - Processing node 69c6c69402375b4506dfb96c: ltp-smoke 2026-03-27 18:21:55,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:21:55,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:21:55,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6c69402375b4506dfb96c/log.txt.gz 2026-03-27 18:21:55,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:21:55,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:21:55,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6c69402375b4506dfb96c/lava-logs.yaml 2026-03-27 18:21:55,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:21:56,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:21:56,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6c69402375b4506dfb96c/lava_callback.json.gz 2026-03-27 18:21:56,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:56,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c69402375b4506dfb96c HTTP/1.1" 200 None 2026-03-27 18:21:56,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:56,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0a02375b4506df8995 HTTP/1.1" 200 None 2026-03-27 18:21:56,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:21:56,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c69402375b4506dfb96c HTTP/1.1" 200 None 2026-03-27 18:21:56,393 - lava_callback - INFO - Completed processing callback for node 69c6c69402375b4506dfb96c INFO: 172.20.0.1:44914 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:22:00,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:22:00,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:23:05,197 - lava_callback - INFO - Received callback for node 69c427fc944faaf0e7f614d1 INFO: 172.20.0.1:43016 - "POST /node/69c427fc944faaf0e7f614d1 HTTP/1.0" 202 Accepted 2026-03-27 18:23:05,202 - lava_callback - INFO - Starting async job submit for node 69c427fc944faaf0e7f614d1 2026-03-27 18:23:05,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:23:05,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c427fc944faaf0e7f614d1 HTTP/1.1" 200 None 2026-03-27 18:23:05,218 - lava_callback - DEBUG - Processing node 69c427fc944faaf0e7f614d1: baseline-arm64-baylibre 2026-03-27 18:23:05,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c427fc944faaf0e7f614d1 2026-03-27 18:23:05,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:23:05,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c427fc944faaf0e7f614d1 HTTP/1.1" 200 None 2026-03-27 18:23:05,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:23:05,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:23:05,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:23:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c427fc944faaf0e7f614d1 HTTP/1.1" 200 None 2026-03-27 18:23:05,271 - lava_callback - ERROR - Error processing callback for node 69c427fc944faaf0e7f614d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:24:12,202 - lava_callback - INFO - Received callback for node 69c6c98702375b4506dfba0d INFO: 172.20.0.1:36480 - "POST /node/69c6c98702375b4506dfba0d HTTP/1.0" 202 Accepted 2026-03-27 18:24:12,209 - lava_callback - INFO - Starting async job submit for node 69c6c98702375b4506dfba0d 2026-03-27 18:24:12,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:12,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c98702375b4506dfba0d HTTP/1.1" 200 None 2026-03-27 18:24:12,262 - lava_callback - DEBUG - Processing node 69c6c98702375b4506dfba0d: baseline-arm64 2026-03-27 18:24:12,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:24:12,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:24:12,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c98702375b4506dfba0d/log.txt.gz 2026-03-27 18:24:13,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:24:13,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:24:13,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c98702375b4506dfba0d/lava-logs.yaml 2026-03-27 18:24:13,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:24:13,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:24:13,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c98702375b4506dfba0d/lava_callback.json.gz DEBUG: Setup failed for 69c6c98702375b4506dfba0d. Transitting job node result: incomplete -> fail 2026-03-27 18:24:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:13,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c98702375b4506dfba0d HTTP/1.1" 200 None 2026-03-27 18:24:13,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:13,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:24:13,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:13,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c98702375b4506dfba0d HTTP/1.1" 200 None 2026-03-27 18:24:13,659 - lava_callback - INFO - Completed processing callback for node 69c6c98702375b4506dfba0d INFO: 172.20.0.1:36492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:24:26,118 - lava_callback - INFO - Received callback for node 69c42856944faaf0e7f614db INFO: 172.20.0.1:55428 - "POST /node/69c42856944faaf0e7f614db HTTP/1.0" 202 Accepted 2026-03-27 18:24:26,124 - lava_callback - INFO - Starting async job submit for node 69c42856944faaf0e7f614db 2026-03-27 18:24:26,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:26,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42856944faaf0e7f614db HTTP/1.1" 200 None 2026-03-27 18:24:26,140 - lava_callback - DEBUG - Processing node 69c42856944faaf0e7f614db: baseline-arm64-clabbe 2026-03-27 18:24:26,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42856944faaf0e7f614db 2026-03-27 18:24:26,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:26,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42856944faaf0e7f614db HTTP/1.1" 200 None 2026-03-27 18:24:26,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:26,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:24:26,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:26,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42856944faaf0e7f614db HTTP/1.1" 200 None 2026-03-27 18:24:26,203 - lava_callback - ERROR - Error processing callback for node 69c42856944faaf0e7f614db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:24:30,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:24:30,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:26:06,194 - lava_callback - INFO - Received callback for node 69c428a9944faaf0e7f614e6 INFO: 172.20.0.1:53022 - "POST /node/69c428a9944faaf0e7f614e6 HTTP/1.0" 202 Accepted 2026-03-27 18:26:06,200 - lava_callback - INFO - Starting async job submit for node 69c428a9944faaf0e7f614e6 2026-03-27 18:26:06,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:26:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c428a9944faaf0e7f614e6 HTTP/1.1" 200 None 2026-03-27 18:26:06,216 - lava_callback - DEBUG - Processing node 69c428a9944faaf0e7f614e6: baseline-arm64-clabbe 2026-03-27 18:26:06,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c428a9944faaf0e7f614e6 2026-03-27 18:26:06,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:26:06,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c428a9944faaf0e7f614e6 HTTP/1.1" 200 None 2026-03-27 18:26:06,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:26:06,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:26:06,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:26:06,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c428a9944faaf0e7f614e6 HTTP/1.1" 200 None 2026-03-27 18:26:06,268 - lava_callback - ERROR - Error processing callback for node 69c428a9944faaf0e7f614e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50752 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:27:26,215 - lava_callback - INFO - Received callback for node 69c428fc944faaf0e7f614f0 INFO: 172.20.0.1:54452 - "POST /node/69c428fc944faaf0e7f614f0 HTTP/1.0" 202 Accepted 2026-03-27 18:27:26,221 - lava_callback - INFO - Starting async job submit for node 69c428fc944faaf0e7f614f0 2026-03-27 18:27:26,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:27:26,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c428fc944faaf0e7f614f0 HTTP/1.1" 200 None 2026-03-27 18:27:26,236 - lava_callback - DEBUG - Processing node 69c428fc944faaf0e7f614f0: baseline-arm64-clabbe 2026-03-27 18:27:26,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c428fc944faaf0e7f614f0 2026-03-27 18:27:26,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:27:26,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c428fc944faaf0e7f614f0 HTTP/1.1" 200 None 2026-03-27 18:27:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:27:26,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:27:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:27:26,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c428fc944faaf0e7f614f0 HTTP/1.1" 200 None 2026-03-27 18:27:26,305 - lava_callback - ERROR - Error processing callback for node 69c428fc944faaf0e7f614f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:28:03,140 - lava_callback - INFO - Received callback for node 69c6caa302375b4506dfba39 INFO: 172.20.0.1:56954 - "POST /node/69c6caa302375b4506dfba39 HTTP/1.0" 202 Accepted 2026-03-27 18:28:03,167 - lava_callback - INFO - Starting async job submit for node 69c6caa302375b4506dfba39 2026-03-27 18:28:03,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:03,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6caa302375b4506dfba39 HTTP/1.1" 200 None 2026-03-27 18:28:03,250 - lava_callback - DEBUG - Processing node 69c6caa302375b4506dfba39: baseline-arm64-foundriesio 2026-03-27 18:28:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:04,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:04,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6caa302375b4506dfba39/log.txt.gz 2026-03-27 18:28:05,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:05,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:05,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6caa302375b4506dfba39/lava-logs.yaml 2026-03-27 18:28:05,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:05,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:05,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c6caa302375b4506dfba39/lava_callback.json.gz DEBUG: Setup failed for 69c6caa302375b4506dfba39. Transitting job node result: incomplete -> fail 2026-03-27 18:28:05,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:05,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6caa302375b4506dfba39 HTTP/1.1" 200 None 2026-03-27 18:28:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:05,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:28:05,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:05,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6caa302375b4506dfba39 HTTP/1.1" 200 None 2026-03-27 18:28:06,035 - lava_callback - INFO - Completed processing callback for node 69c6caa302375b4506dfba39 INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52848 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 18:28:15,548 - lava_callback - INFO - Received callback for node 69c6c9d402375b4506dfba1a INFO: 172.20.0.1:52862 - "POST /node/69c6c9d402375b4506dfba1a HTTP/1.0" 202 Accepted 2026-03-27 18:28:15,554 - lava_callback - INFO - Starting async job submit for node 69c6c9d402375b4506dfba1a 2026-03-27 18:28:15,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:15,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c9d402375b4506dfba1a HTTP/1.1" 200 None 2026-03-27 18:28:15,594 - lava_callback - DEBUG - Processing node 69c6c9d402375b4506dfba1a: baseline-arm64 2026-03-27 18:28:16,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:16,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:16,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c9d402375b4506dfba1a/log.txt.gz INFO: 172.20.0.1:52878 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:28:16,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:16,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:16,735 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c9d402375b4506dfba1a/lava-logs.yaml 2026-03-27 18:28:16,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:28:17,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:28:17,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6c9d402375b4506dfba1a/lava_callback.json.gz 2026-03-27 18:28:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:17,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c9d402375b4506dfba1a HTTP/1.1" 200 None 2026-03-27 18:28:17,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:17,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:28:17,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:17,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c9d402375b4506dfba1a HTTP/1.1" 200 None 2026-03-27 18:28:17,234 - lava_callback - INFO - Completed processing callback for node 69c6c9d402375b4506dfba1a INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:28:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:30,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41382 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:28:46,320 - lava_callback - INFO - Received callback for node 69c4294f944faaf0e7f614fa INFO: 172.20.0.1:60956 - "POST /node/69c4294f944faaf0e7f614fa HTTP/1.0" 202 Accepted 2026-03-27 18:28:46,326 - lava_callback - INFO - Starting async job submit for node 69c4294f944faaf0e7f614fa 2026-03-27 18:28:46,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:46,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4294f944faaf0e7f614fa HTTP/1.1" 200 None 2026-03-27 18:28:46,342 - lava_callback - DEBUG - Processing node 69c4294f944faaf0e7f614fa: baseline-arm64-clabbe 2026-03-27 18:28:46,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4294f944faaf0e7f614fa 2026-03-27 18:28:46,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:46,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4294f944faaf0e7f614fa HTTP/1.1" 200 None 2026-03-27 18:28:46,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:46,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:28:46,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:28:46,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4294f944faaf0e7f614fa HTTP/1.1" 200 None 2026-03-27 18:28:46,395 - lava_callback - ERROR - Error processing callback for node 69c4294f944faaf0e7f614fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:30:06,501 - lava_callback - INFO - Received callback for node 69c429a2944faaf0e7f614ff INFO: 172.20.0.1:43482 - "POST /node/69c429a2944faaf0e7f614ff HTTP/1.0" 202 Accepted 2026-03-27 18:30:06,507 - lava_callback - INFO - Starting async job submit for node 69c429a2944faaf0e7f614ff 2026-03-27 18:30:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:30:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c429a2944faaf0e7f614ff HTTP/1.1" 200 None 2026-03-27 18:30:06,523 - lava_callback - DEBUG - Processing node 69c429a2944faaf0e7f614ff: baseline-arm64-clabbe 2026-03-27 18:30:06,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c429a2944faaf0e7f614ff 2026-03-27 18:30:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:30:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c429a2944faaf0e7f614ff HTTP/1.1" 200 None 2026-03-27 18:30:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:30:06,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:30:06,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:30:06,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c429a2944faaf0e7f614ff HTTP/1.1" 200 None 2026-03-27 18:30:06,583 - lava_callback - ERROR - Error processing callback for node 69c429a2944faaf0e7f614ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET /node/69885206e408e9ea60fadee5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37580 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:31:26,424 - lava_callback - INFO - Received callback for node 69c429f6944faaf0e7f6150a INFO: 172.20.0.1:41586 - "POST /node/69c429f6944faaf0e7f6150a HTTP/1.0" 202 Accepted 2026-03-27 18:31:26,430 - lava_callback - INFO - Starting async job submit for node 69c429f6944faaf0e7f6150a 2026-03-27 18:31:26,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:31:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c429f6944faaf0e7f6150a HTTP/1.1" 200 None 2026-03-27 18:31:26,447 - lava_callback - DEBUG - Processing node 69c429f6944faaf0e7f6150a: baseline-arm64-clabbe 2026-03-27 18:31:26,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c429f6944faaf0e7f6150a 2026-03-27 18:31:26,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:31:26,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c429f6944faaf0e7f6150a HTTP/1.1" 200 None 2026-03-27 18:31:26,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:31:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-27 18:31:26,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:31:26,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c429f6944faaf0e7f6150a HTTP/1.1" 200 None 2026-03-27 18:31:26,521 - lava_callback - ERROR - Error processing callback for node 69c429f6944faaf0e7f6150a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:32:30,804 - lava_callback - INFO - Received callback for node 69c6c48c02375b4506dfb90f INFO: 172.20.0.1:53298 - "POST /node/69c6c48c02375b4506dfb90f HTTP/1.0" 202 Accepted 2026-03-27 18:32:30,853 - lava_callback - INFO - Starting async job submit for node 69c6c48c02375b4506dfb90f 2026-03-27 18:32:30,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:32:30,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c48c02375b4506dfb90f HTTP/1.1" 200 None 2026-03-27 18:32:30,892 - lava_callback - DEBUG - Processing node 69c6c48c02375b4506dfb90f: baseline-arm-pengutronix 2026-03-27 18:32:30,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:32:31,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:32:31,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6c48c02375b4506dfb90f/log.txt.gz 2026-03-27 18:32:31,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:32:31,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:32:31,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6c48c02375b4506dfb90f/lava-logs.yaml 2026-03-27 18:32:31,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:32:31,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:32:31,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6c48c02375b4506dfb90f/lava_callback.json.gz DEBUG: Setup failed for 69c6c48c02375b4506dfb90f. Transitting job node result: incomplete -> fail 2026-03-27 18:32:31,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:32:31,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6c48c02375b4506dfb90f HTTP/1.1" 200 None 2026-03-27 18:32:31,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:32:31,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 18:32:31,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:32:31,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6c48c02375b4506dfb90f HTTP/1.1" 200 None 2026-03-27 18:32:31,681 - lava_callback - INFO - Completed processing callback for node 69c6c48c02375b4506dfb90f INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:33:00,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:33:00,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET /node/698f84973013abef95d01aa1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET /node/698cb30884a45b9037358f85%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35330 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:40:46,239 - lava_callback - INFO - Received callback for node 69c42c25944faaf0e7f61573 INFO: 172.20.0.1:49100 - "POST /node/69c42c25944faaf0e7f61573 HTTP/1.0" 202 Accepted 2026-03-27 18:40:46,244 - lava_callback - INFO - Starting async job submit for node 69c42c25944faaf0e7f61573 2026-03-27 18:40:46,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:40:46,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42c25944faaf0e7f61573 HTTP/1.1" 200 None 2026-03-27 18:40:46,260 - lava_callback - DEBUG - Processing node 69c42c25944faaf0e7f61573: baseline-arm-baylibre 2026-03-27 18:40:46,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42c25944faaf0e7f61573 2026-03-27 18:40:46,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:40:46,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42c25944faaf0e7f61573 HTTP/1.1" 200 None 2026-03-27 18:40:46,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:40:46,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:40:46,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:40:46,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42c25944faaf0e7f61573 HTTP/1.1" 200 None 2026-03-27 18:40:46,325 - lava_callback - ERROR - Error processing callback for node 69c42c25944faaf0e7f61573: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:41:25,907 - lava_callback - INFO - Received callback for node 69c42c4f944faaf0e7f6157e INFO: 172.20.0.1:55334 - "POST /node/69c42c4f944faaf0e7f6157e HTTP/1.0" 202 Accepted 2026-03-27 18:41:25,913 - lava_callback - INFO - Starting async job submit for node 69c42c4f944faaf0e7f6157e 2026-03-27 18:41:25,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:41:25,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42c4f944faaf0e7f6157e HTTP/1.1" 200 None 2026-03-27 18:41:25,928 - lava_callback - DEBUG - Processing node 69c42c4f944faaf0e7f6157e: baseline-arm-baylibre 2026-03-27 18:41:25,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42c4f944faaf0e7f6157e 2026-03-27 18:41:25,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:41:25,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42c4f944faaf0e7f6157e HTTP/1.1" 200 None 2026-03-27 18:41:25,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:41:25,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:41:25,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:41:25,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42c4f944faaf0e7f6157e HTTP/1.1" 200 None 2026-03-27 18:41:25,985 - lava_callback - ERROR - Error processing callback for node 69c42c4f944faaf0e7f6157e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47962 - "GET /node/699467915ae459b9df3e2ddc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:43:26,927 - lava_callback - INFO - Received callback for node 69c42ccb944faaf0e7f615aa INFO: 172.20.0.1:36846 - "POST /node/69c42ccb944faaf0e7f615aa HTTP/1.0" 202 Accepted 2026-03-27 18:43:26,932 - lava_callback - INFO - Starting async job submit for node 69c42ccb944faaf0e7f615aa 2026-03-27 18:43:26,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:43:26,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ccb944faaf0e7f615aa HTTP/1.1" 200 None 2026-03-27 18:43:26,949 - lava_callback - DEBUG - Processing node 69c42ccb944faaf0e7f615aa: baseline-arm-clabbe 2026-03-27 18:43:26,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42ccb944faaf0e7f615aa 2026-03-27 18:43:26,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:43:26,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42ccb944faaf0e7f615aa HTTP/1.1" 200 None 2026-03-27 18:43:26,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:43:26,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:43:26,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:43:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42ccb944faaf0e7f615aa HTTP/1.1" 200 None 2026-03-27 18:43:27,006 - lava_callback - ERROR - Error processing callback for node 69c42ccb944faaf0e7f615aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET /node/698a84d7d9a1cfa777a23bb2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:44:26,939 - lava_callback - INFO - Received callback for node 69c42cf4944faaf0e7f615bb INFO: 172.20.0.1:38108 - "POST /node/69c42cf4944faaf0e7f615bb HTTP/1.0" 202 Accepted 2026-03-27 18:44:26,945 - lava_callback - INFO - Starting async job submit for node 69c42cf4944faaf0e7f615bb 2026-03-27 18:44:26,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:44:26,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42cf4944faaf0e7f615bb HTTP/1.1" 200 None 2026-03-27 18:44:26,961 - lava_callback - DEBUG - Processing node 69c42cf4944faaf0e7f615bb: baseline-arm-clabbe 2026-03-27 18:44:26,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42cf4944faaf0e7f615bb 2026-03-27 18:44:26,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:44:26,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42cf4944faaf0e7f615bb HTTP/1.1" 200 None 2026-03-27 18:44:26,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:44:26,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:44:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:44:27,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42cf4944faaf0e7f615bb HTTP/1.1" 200 None 2026-03-27 18:44:27,020 - lava_callback - ERROR - Error processing callback for node 69c42cf4944faaf0e7f615bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:45:07,027 - lava_callback - INFO - Received callback for node 69c42d1d944faaf0e7f615c7 INFO: 172.20.0.1:57708 - "POST /node/69c42d1d944faaf0e7f615c7 HTTP/1.0" 202 Accepted 2026-03-27 18:45:07,032 - lava_callback - INFO - Starting async job submit for node 69c42d1d944faaf0e7f615c7 2026-03-27 18:45:07,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:07,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42d1d944faaf0e7f615c7 HTTP/1.1" 200 None 2026-03-27 18:45:07,048 - lava_callback - DEBUG - Processing node 69c42d1d944faaf0e7f615c7: baseline-arm-clabbe 2026-03-27 18:45:07,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42d1d944faaf0e7f615c7 2026-03-27 18:45:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:07,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42d1d944faaf0e7f615c7 HTTP/1.1" 200 None 2026-03-27 18:45:07,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:07,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:45:07,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:07,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42d1d944faaf0e7f615c7 HTTP/1.1" 200 None 2026-03-27 18:45:07,102 - lava_callback - ERROR - Error processing callback for node 69c42d1d944faaf0e7f615c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:45:29,748 - lava_callback - INFO - Received callback for node 69c6cdc402375b4506dfbb11 INFO: 172.20.0.1:46790 - "POST /node/69c6cdc402375b4506dfbb11 HTTP/1.0" 202 Accepted 2026-03-27 18:45:29,755 - lava_callback - INFO - Starting async job submit for node 69c6cdc402375b4506dfbb11 2026-03-27 18:45:29,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:29,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cdc402375b4506dfbb11 HTTP/1.1" 200 None 2026-03-27 18:45:29,796 - lava_callback - DEBUG - Processing node 69c6cdc402375b4506dfbb11: baseline-nfs-arm64 INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:45:30,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:45:30,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:45:30,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cdc402375b4506dfbb11/log.txt.gz 2026-03-27 18:45:30,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:45:31,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:45:31,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cdc402375b4506dfbb11/lava-logs.yaml 2026-03-27 18:45:31,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:45:31,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:45:31,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cdc402375b4506dfbb11/lava_callback.json.gz 2026-03-27 18:45:31,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:31,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cdc402375b4506dfbb11 HTTP/1.1" 200 None 2026-03-27 18:45:31,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:31,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:45:31,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:31,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6cdc402375b4506dfbb11 HTTP/1.1" 200 None 2026-03-27 18:45:31,388 - lava_callback - INFO - Completed processing callback for node 69c6cdc402375b4506dfbb11 INFO: 172.20.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37192 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:45:47,031 - lava_callback - INFO - Received callback for node 69c42d46944faaf0e7f615d4 INFO: 172.20.0.1:37206 - "POST /node/69c42d46944faaf0e7f615d4 HTTP/1.0" 202 Accepted 2026-03-27 18:45:47,037 - lava_callback - INFO - Starting async job submit for node 69c42d46944faaf0e7f615d4 2026-03-27 18:45:47,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:47,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42d46944faaf0e7f615d4 HTTP/1.1" 200 None 2026-03-27 18:45:47,056 - lava_callback - DEBUG - Processing node 69c42d46944faaf0e7f615d4: baseline-arm-clabbe 2026-03-27 18:45:47,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42d46944faaf0e7f615d4 2026-03-27 18:45:47,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42d46944faaf0e7f615d4 HTTP/1.1" 200 None 2026-03-27 18:45:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:47,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:45:47,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:45:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42d46944faaf0e7f615d4 HTTP/1.1" 200 None 2026-03-27 18:45:47,118 - lava_callback - ERROR - Error processing callback for node 69c42d46944faaf0e7f615d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:46:00,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:46:00,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57662 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:47:47,062 - lava_callback - INFO - Received callback for node 69c42dbf944faaf0e7f615f0 INFO: 172.20.0.1:57668 - "POST /node/69c42dbf944faaf0e7f615f0 HTTP/1.0" 202 Accepted 2026-03-27 18:47:47,068 - lava_callback - INFO - Starting async job submit for node 69c42dbf944faaf0e7f615f0 2026-03-27 18:47:47,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:47:47,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42dbf944faaf0e7f615f0 HTTP/1.1" 200 None 2026-03-27 18:47:47,084 - lava_callback - DEBUG - Processing node 69c42dbf944faaf0e7f615f0: baseline-arm-clabbe 2026-03-27 18:47:47,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c42dbf944faaf0e7f615f0 2026-03-27 18:47:47,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:47:47,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c42dbf944faaf0e7f615f0 HTTP/1.1" 200 None 2026-03-27 18:47:47,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:47:47,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3293e18a3717aa65d01ad HTTP/1.1" 200 None 2026-03-27 18:47:47,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:47:47,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c42dbf944faaf0e7f615f0 HTTP/1.1" 200 None 2026-03-27 18:47:47,150 - lava_callback - ERROR - Error processing callback for node 69c42dbf944faaf0e7f615f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:48:41,514 - lava_callback - INFO - Received callback for node 69c6cc6902375b4506dfbaca INFO: 172.20.0.1:50576 - "POST /node/69c6cc6902375b4506dfbaca HTTP/1.0" 202 Accepted 2026-03-27 18:48:41,522 - lava_callback - INFO - Starting async job submit for node 69c6cc6902375b4506dfbaca 2026-03-27 18:48:41,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:48:41,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cc6902375b4506dfbaca HTTP/1.1" 200 None 2026-03-27 18:48:41,582 - lava_callback - DEBUG - Processing node 69c6cc6902375b4506dfbaca: baseline-nfs-arm64 2026-03-27 18:48:42,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:48:42,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:48:42,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cc6902375b4506dfbaca/log.txt.gz 2026-03-27 18:48:43,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:48:43,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:48:43,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cc6902375b4506dfbaca/lava-logs.yaml 2026-03-27 18:48:43,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:48:44,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:48:44,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6cc6902375b4506dfbaca/lava_callback.json.gz DEBUG: Setup failed for 69c6cc6902375b4506dfbaca. Transitting job node result: incomplete -> fail 2026-03-27 18:48:44,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:48:44,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cc6902375b4506dfbaca HTTP/1.1" 200 None 2026-03-27 18:48:44,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:48:44,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:48:44,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:48:44,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6cc6902375b4506dfbaca HTTP/1.1" 200 None 2026-03-27 18:48:44,308 - lava_callback - INFO - Completed processing callback for node 69c6cc6902375b4506dfbaca INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:49:00,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:49:00,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43824 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:50:20,785 - lava_callback - INFO - Received callback for node 69c6cd4a02375b4506dfbafc INFO: 172.20.0.1:44326 - "POST /node/69c6cd4a02375b4506dfbafc HTTP/1.0" 202 Accepted 2026-03-27 18:50:20,792 - lava_callback - INFO - Starting async job submit for node 69c6cd4a02375b4506dfbafc 2026-03-27 18:50:20,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:20,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cd4a02375b4506dfbafc HTTP/1.1" 200 None 2026-03-27 18:50:20,884 - lava_callback - DEBUG - Processing node 69c6cd4a02375b4506dfbafc: baseline-arm 2026-03-27 18:50:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:21,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:21,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6cd4a02375b4506dfbafc/log.txt.gz 2026-03-27 18:50:22,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:22,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:22,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6cd4a02375b4506dfbafc/lava-logs.yaml 2026-03-27 18:50:22,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:22,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:22,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6cd4a02375b4506dfbafc/lava_callback.json.gz DEBUG: Setup failed for 69c6cd4a02375b4506dfbafc. Transitting job node result: incomplete -> fail 2026-03-27 18:50:22,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:22,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cd4a02375b4506dfbafc HTTP/1.1" 200 None 2026-03-27 18:50:22,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:22,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 18:50:22,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:22,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6cd4a02375b4506dfbafc HTTP/1.1" 200 None 2026-03-27 18:50:23,077 - lava_callback - INFO - Completed processing callback for node 69c6cd4a02375b4506dfbafc INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52888 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:50:30,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:30,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-27 18:50:32,977 - lava_callback - INFO - Received callback for node 69c6cf8802375b4506dfbb6e INFO: 172.20.0.1:52896 - "POST /node/69c6cf8802375b4506dfbb6e HTTP/1.0" 202 Accepted 2026-03-27 18:50:32,984 - lava_callback - INFO - Starting async job submit for node 69c6cf8802375b4506dfbb6e 2026-03-27 18:50:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:33,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cf8802375b4506dfbb6e HTTP/1.1" 200 None 2026-03-27 18:50:33,037 - lava_callback - DEBUG - Processing node 69c6cf8802375b4506dfbb6e: baseline-arm64 2026-03-27 18:50:33,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:33,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:33,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6cf8802375b4506dfbb6e/log.txt.gz 2026-03-27 18:50:33,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:34,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:34,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6cf8802375b4506dfbb6e/lava-logs.yaml 2026-03-27 18:50:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:50:34,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:50:34,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6cf8802375b4506dfbb6e/lava_callback.json.gz DEBUG: Setup failed for 69c6cf8802375b4506dfbb6e. Transitting job node result: incomplete -> fail 2026-03-27 18:50:34,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:34,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cf8802375b4506dfbb6e HTTP/1.1" 200 None 2026-03-27 18:50:34,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:34,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:50:34,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:50:34,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6cf8802375b4506dfbb6e HTTP/1.1" 200 None 2026-03-27 18:50:34,439 - lava_callback - INFO - Completed processing callback for node 69c6cf8802375b4506dfbb6e INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49532 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:51:00,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:51:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET /node/698a9aadd9a1cfa777a24ba9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45454 - "GET /node/6989314985773790cd34be35%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:57:23,721 - lava_callback - INFO - Received callback for node 69c6d0b702375b4506dfbbab INFO: 172.20.0.1:32866 - "POST /node/69c6d0b702375b4506dfbbab HTTP/1.0" 202 Accepted 2026-03-27 18:57:23,728 - lava_callback - INFO - Starting async job submit for node 69c6d0b702375b4506dfbbab 2026-03-27 18:57:23,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:57:23,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d0b702375b4506dfbbab HTTP/1.1" 200 None 2026-03-27 18:57:23,767 - lava_callback - DEBUG - Processing node 69c6d0b702375b4506dfbbab: baseline-arm64 2026-03-27 18:57:24,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:57:24,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:57:24,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6d0b702375b4506dfbbab/log.txt.gz 2026-03-27 18:57:24,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:57:24,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:57:24,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6d0b702375b4506dfbbab/lava-logs.yaml 2026-03-27 18:57:24,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:57:25,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:57:25,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c6d0b702375b4506dfbbab/lava_callback.json.gz 2026-03-27 18:57:25,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:57:25,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d0b702375b4506dfbbab HTTP/1.1" 200 None 2026-03-27 18:57:25,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:57:25,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 18:57:25,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:57:25,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6d0b702375b4506dfbbab HTTP/1.1" 200 None 2026-03-27 18:57:25,287 - lava_callback - INFO - Completed processing callback for node 69c6d0b702375b4506dfbbab INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:57:30,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:57:30,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 18:58:16,044 - lava_callback - INFO - Received callback for node 69c6cf3402375b4506dfbb57 INFO: 172.20.0.1:43286 - "POST /node/69c6cf3402375b4506dfbb57 HTTP/1.0" 202 Accepted 2026-03-27 18:58:16,050 - lava_callback - INFO - Starting async job submit for node 69c6cf3402375b4506dfbb57 2026-03-27 18:58:16,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:58:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cf3402375b4506dfbb57 HTTP/1.1" 200 None 2026-03-27 18:58:16,124 - lava_callback - DEBUG - Processing node 69c6cf3402375b4506dfbb57: ltp-smoke INFO: 172.20.0.1:43290 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:58:16,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:58:16,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:58:16,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6cf3402375b4506dfbb57/log.txt.gz 2026-03-27 18:58:17,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:58:17,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:58:17,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6cf3402375b4506dfbb57/lava-logs.yaml 2026-03-27 18:58:17,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 18:58:17,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 18:58:17,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c6cf3402375b4506dfbb57/lava_callback.json.gz 2026-03-27 18:58:17,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:58:17,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6cf3402375b4506dfbb57 HTTP/1.1" 200 None 2026-03-27 18:58:17,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:58:17,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0a02375b4506df8995 HTTP/1.1" 200 None 2026-03-27 18:58:17,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:58:17,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6cf3402375b4506dfbb57 HTTP/1.1" 200 None 2026-03-27 18:58:17,835 - lava_callback - INFO - Completed processing callback for node 69c6cf3402375b4506dfbb57 INFO: 172.20.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK 2026-03-27 18:58:30,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 18:58:30,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET /node/694934aeebaed71d43807907%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47510 - "GET /node/699371eccebe99dd8e069653%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45696 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:12:11,515 - lava_callback - INFO - Received callback for node 69c6d1f102375b4506dfbc03 INFO: 172.20.0.1:58372 - "POST /node/69c6d1f102375b4506dfbc03 HTTP/1.0" 202 Accepted 2026-03-27 19:12:11,562 - lava_callback - INFO - Starting async job submit for node 69c6d1f102375b4506dfbc03 2026-03-27 19:12:11,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:12:11,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d1f102375b4506dfbc03 HTTP/1.1" 200 None 2026-03-27 19:12:11,603 - lava_callback - DEBUG - Processing node 69c6d1f102375b4506dfbc03: baseline-arm-pengutronix 2026-03-27 19:12:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:12:11,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:12:11,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d1f102375b4506dfbc03/log.txt.gz 2026-03-27 19:12:11,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:12:12,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:12:12,104 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d1f102375b4506dfbc03/lava-logs.yaml 2026-03-27 19:12:12,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:12:12,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:12:12,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d1f102375b4506dfbc03/lava_callback.json.gz DEBUG: Setup failed for 69c6d1f102375b4506dfbc03. Transitting job node result: incomplete -> fail 2026-03-27 19:12:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:12:12,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d1f102375b4506dfbc03 HTTP/1.1" 200 None 2026-03-27 19:12:12,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:12:12,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 19:12:12,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:12:12,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6d1f102375b4506dfbc03 HTTP/1.1" 200 None 2026-03-27 19:12:12,609 - lava_callback - INFO - Completed processing callback for node 69c6d1f102375b4506dfbc03 INFO: 172.20.0.1:58376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43058 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:12:30,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:12:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET /node/6986006071989fb14149df72%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:19:28,382 - lava_callback - INFO - Received callback for node 69c43531944faaf0e7f616ab INFO: 172.20.0.1:38966 - "POST /node/69c43531944faaf0e7f616ab HTTP/1.0" 202 Accepted 2026-03-27 19:19:28,387 - lava_callback - INFO - Starting async job submit for node 69c43531944faaf0e7f616ab 2026-03-27 19:19:28,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:19:28,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43531944faaf0e7f616ab HTTP/1.1" 200 None 2026-03-27 19:19:28,428 - lava_callback - DEBUG - Processing node 69c43531944faaf0e7f616ab: baseline-arm64-baylibre 2026-03-27 19:19:28,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43531944faaf0e7f616ab 2026-03-27 19:19:28,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:19:28,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43531944faaf0e7f616ab HTTP/1.1" 200 None 2026-03-27 19:19:28,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:19:28,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:19:28,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:19:28,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43531944faaf0e7f616ab HTTP/1.1" 200 None 2026-03-27 19:19:28,488 - lava_callback - ERROR - Error processing callback for node 69c43531944faaf0e7f616ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET /node/698401d0969566dcb0d2b43e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:21:05,876 - lava_callback - INFO - Received callback for node 69c6d48202375b4506dfbcba INFO: 172.20.0.1:54800 - "POST /node/69c6d48202375b4506dfbcba HTTP/1.0" 202 Accepted 2026-03-27 19:21:05,883 - lava_callback - INFO - Starting async job submit for node 69c6d48202375b4506dfbcba 2026-03-27 19:21:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:05,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d48202375b4506dfbcba HTTP/1.1" 200 None 2026-03-27 19:21:05,956 - lava_callback - DEBUG - Processing node 69c6d48202375b4506dfbcba: baseline-arm INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:21:06,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:06,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:06,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c6d48202375b4506dfbcba/log.txt.gz 2026-03-27 19:21:07,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:07,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:07,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c6d48202375b4506dfbcba/lava-logs.yaml 2026-03-27 19:21:07,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:07,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:07,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c6d48202375b4506dfbcba/lava_callback.json.gz DEBUG: Setup failed for 69c6d48202375b4506dfbcba. Transitting job node result: incomplete -> fail 2026-03-27 19:21:07,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:07,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d48202375b4506dfbcba HTTP/1.1" 200 None 2026-03-27 19:21:07,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:07,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 19:21:07,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:07,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6d48202375b4506dfbcba HTTP/1.1" 200 None 2026-03-27 19:21:07,789 - lava_callback - INFO - Completed processing callback for node 69c6d48202375b4506dfbcba INFO: 172.20.0.1:55012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55024 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:21:20,866 - lava_callback - INFO - Received callback for node 69c6d41402375b4506dfbc9f INFO: 172.20.0.1:56058 - "POST /node/69c6d41402375b4506dfbc9f HTTP/1.0" 202 Accepted 2026-03-27 19:21:20,874 - lava_callback - INFO - Starting async job submit for node 69c6d41402375b4506dfbc9f 2026-03-27 19:21:20,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:20,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d41402375b4506dfbc9f HTTP/1.1" 200 None 2026-03-27 19:21:20,934 - lava_callback - DEBUG - Processing node 69c6d41402375b4506dfbc9f: baseline-nfs-arm64 2026-03-27 19:21:22,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:22,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:22,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6d41402375b4506dfbc9f/log.txt.gz 2026-03-27 19:21:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:23,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:23,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6d41402375b4506dfbc9f/lava-logs.yaml 2026-03-27 19:21:23,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:21:23,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:21:23,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c6d41402375b4506dfbc9f/lava_callback.json.gz DEBUG: Setup failed for 69c6d41402375b4506dfbc9f. Transitting job node result: incomplete -> fail 2026-03-27 19:21:23,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:23,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d41402375b4506dfbc9f HTTP/1.1" 200 None 2026-03-27 19:21:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:23,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-03-27 19:21:23,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:23,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6d41402375b4506dfbc9f HTTP/1.1" 200 None 2026-03-27 19:21:23,619 - lava_callback - INFO - Completed processing callback for node 69c6d41402375b4506dfbc9f INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:21:30,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:21:30,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60360 - "GET /node/698be0531e517752bab8c1c6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:22:08,437 - lava_callback - INFO - Received callback for node 69c435d8944faaf0e7f616c9 INFO: 172.20.0.1:60380 - "POST /node/69c435d8944faaf0e7f616c9 HTTP/1.0" 202 Accepted 2026-03-27 19:22:08,446 - lava_callback - INFO - Starting async job submit for node 69c435d8944faaf0e7f616c9 2026-03-27 19:22:08,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:22:08,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c435d8944faaf0e7f616c9 HTTP/1.1" 200 None 2026-03-27 19:22:08,461 - lava_callback - DEBUG - Processing node 69c435d8944faaf0e7f616c9: baseline-arm64-baylibre 2026-03-27 19:22:08,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c435d8944faaf0e7f616c9 2026-03-27 19:22:08,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:22:08,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c435d8944faaf0e7f616c9 HTTP/1.1" 200 None 2026-03-27 19:22:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:22:08,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:22:08,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:22:08,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c435d8944faaf0e7f616c9 HTTP/1.1" 200 None 2026-03-27 19:22:08,517 - lava_callback - ERROR - Error processing callback for node 69c435d8944faaf0e7f616c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:23:28,323 - lava_callback - INFO - Received callback for node 69c43627944faaf0e7f616d4 INFO: 172.20.0.1:35638 - "POST /node/69c43627944faaf0e7f616d4 HTTP/1.0" 202 Accepted 2026-03-27 19:23:28,328 - lava_callback - INFO - Starting async job submit for node 69c43627944faaf0e7f616d4 2026-03-27 19:23:28,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:23:28,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43627944faaf0e7f616d4 HTTP/1.1" 200 None 2026-03-27 19:23:28,345 - lava_callback - DEBUG - Processing node 69c43627944faaf0e7f616d4: baseline-arm64-baylibre 2026-03-27 19:23:28,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43627944faaf0e7f616d4 2026-03-27 19:23:28,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:23:28,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43627944faaf0e7f616d4 HTTP/1.1" 200 None 2026-03-27 19:23:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:23:28,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:23:28,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:23:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43627944faaf0e7f616d4 HTTP/1.1" 200 None 2026-03-27 19:23:28,401 - lava_callback - ERROR - Error processing callback for node 69c43627944faaf0e7f616d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55464 - "GET /node/693f155624745582e399ac61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50036 - "GET /node/6938c477e767fbc36e03e49a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50042 - "GET /node/6991960010b45da7d7d11966%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33266 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:27:48,983 - lava_callback - INFO - Received callback for node 69c43727944faaf0e7f616fc INFO: 172.20.0.1:33278 - "POST /node/69c43727944faaf0e7f616fc HTTP/1.0" 202 Accepted 2026-03-27 19:27:48,991 - lava_callback - INFO - Starting async job submit for node 69c43727944faaf0e7f616fc 2026-03-27 19:27:48,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:27:49,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43727944faaf0e7f616fc HTTP/1.1" 200 None 2026-03-27 19:27:49,017 - lava_callback - DEBUG - Processing node 69c43727944faaf0e7f616fc: baseline-arm64-clabbe 2026-03-27 19:27:49,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43727944faaf0e7f616fc 2026-03-27 19:27:49,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:27:49,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43727944faaf0e7f616fc HTTP/1.1" 200 None 2026-03-27 19:27:49,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:27:49,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:27:49,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:27:49,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43727944faaf0e7f616fc HTTP/1.1" 200 None 2026-03-27 19:27:49,079 - lava_callback - ERROR - Error processing callback for node 69c43727944faaf0e7f616fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:30:28,983 - lava_callback - INFO - Received callback for node 69c437cd944faaf0e7f61714 INFO: 172.20.0.1:43354 - "POST /node/69c437cd944faaf0e7f61714 HTTP/1.0" 202 Accepted 2026-03-27 19:30:28,988 - lava_callback - INFO - Starting async job submit for node 69c437cd944faaf0e7f61714 2026-03-27 19:30:28,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:30:29,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c437cd944faaf0e7f61714 HTTP/1.1" 200 None 2026-03-27 19:30:29,018 - lava_callback - DEBUG - Processing node 69c437cd944faaf0e7f61714: baseline-arm64-clabbe 2026-03-27 19:30:29,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c437cd944faaf0e7f61714 2026-03-27 19:30:29,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:30:29,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c437cd944faaf0e7f61714 HTTP/1.1" 200 None 2026-03-27 19:30:29,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:30:29,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:30:29,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:30:29,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c437cd944faaf0e7f61714 HTTP/1.1" 200 None 2026-03-27 19:30:29,075 - lava_callback - ERROR - Error processing callback for node 69c437cd944faaf0e7f61714: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58910 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:31:49,040 - lava_callback - INFO - Received callback for node 69c43821944faaf0e7f6172d INFO: 172.20.0.1:58920 - "POST /node/69c43821944faaf0e7f6172d HTTP/1.0" 202 Accepted 2026-03-27 19:31:49,045 - lava_callback - INFO - Starting async job submit for node 69c43821944faaf0e7f6172d 2026-03-27 19:31:49,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:31:49,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43821944faaf0e7f6172d HTTP/1.1" 200 None 2026-03-27 19:31:49,061 - lava_callback - DEBUG - Processing node 69c43821944faaf0e7f6172d: baseline-arm64-clabbe 2026-03-27 19:31:49,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43821944faaf0e7f6172d 2026-03-27 19:31:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:31:49,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43821944faaf0e7f6172d HTTP/1.1" 200 None 2026-03-27 19:31:49,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:31:49,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:31:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:31:49,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43821944faaf0e7f6172d HTTP/1.1" 200 None 2026-03-27 19:31:49,155 - lava_callback - ERROR - Error processing callback for node 69c43821944faaf0e7f6172d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:32:12,723 - lava_callback - INFO - Received callback for node 69c6d6ab02375b4506dfbd18 INFO: 172.20.0.1:41982 - "POST /node/69c6d6ab02375b4506dfbd18 HTTP/1.0" 202 Accepted 2026-03-27 19:32:12,769 - lava_callback - INFO - Starting async job submit for node 69c6d6ab02375b4506dfbd18 2026-03-27 19:32:12,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:32:12,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d6ab02375b4506dfbd18 HTTP/1.1" 200 None 2026-03-27 19:32:12,808 - lava_callback - DEBUG - Processing node 69c6d6ab02375b4506dfbd18: baseline-arm-pengutronix 2026-03-27 19:32:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:32:13,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:32:13,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d6ab02375b4506dfbd18/log.txt.gz 2026-03-27 19:32:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:32:13,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:32:13,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d6ab02375b4506dfbd18/lava-logs.yaml 2026-03-27 19:32:13,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-27 19:32:13,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-27 19:32:13,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c6d6ab02375b4506dfbd18/lava_callback.json.gz DEBUG: Setup failed for 69c6d6ab02375b4506dfbd18. Transitting job node result: incomplete -> fail 2026-03-27 19:32:13,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:32:13,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6d6ab02375b4506dfbd18 HTTP/1.1" 200 None 2026-03-27 19:32:13,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:32:13,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-03-27 19:32:13,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:32:13,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c6d6ab02375b4506dfbd18 HTTP/1.1" 200 None 2026-03-27 19:32:13,745 - lava_callback - INFO - Completed processing callback for node 69c6d6ab02375b4506dfbd18 INFO: 172.20.0.1:41986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50532 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:32:30,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:32:30,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:33:08,852 - lava_callback - INFO - Received callback for node 69c4386f944faaf0e7f61738 INFO: 172.20.0.1:40464 - "POST /node/69c4386f944faaf0e7f61738 HTTP/1.0" 202 Accepted 2026-03-27 19:33:08,858 - lava_callback - INFO - Starting async job submit for node 69c4386f944faaf0e7f61738 2026-03-27 19:33:08,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:33:08,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4386f944faaf0e7f61738 HTTP/1.1" 200 None 2026-03-27 19:33:08,874 - lava_callback - DEBUG - Processing node 69c4386f944faaf0e7f61738: baseline-arm64-baylibre 2026-03-27 19:33:08,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4386f944faaf0e7f61738 2026-03-27 19:33:08,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:33:08,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4386f944faaf0e7f61738 HTTP/1.1" 200 None 2026-03-27 19:33:08,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:33:08,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:33:08,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:33:08,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4386f944faaf0e7f61738 HTTP/1.1" 200 None 2026-03-27 19:33:08,937 - lava_callback - ERROR - Error processing callback for node 69c4386f944faaf0e7f61738: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37364 - "GET /node/698523843ff18e47df615242%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37376 - "GET /node/6991f80a01ff1e8e0859d4f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:34:49,226 - lava_callback - INFO - Received callback for node 69c438cd944faaf0e7f61747 INFO: 172.20.0.1:46374 - "POST /node/69c438cd944faaf0e7f61747 HTTP/1.0" 202 Accepted 2026-03-27 19:34:49,232 - lava_callback - INFO - Starting async job submit for node 69c438cd944faaf0e7f61747 2026-03-27 19:34:49,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:34:49,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c438cd944faaf0e7f61747 HTTP/1.1" 200 None 2026-03-27 19:34:49,251 - lava_callback - DEBUG - Processing node 69c438cd944faaf0e7f61747: baseline-arm64-clabbe 2026-03-27 19:34:49,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c438cd944faaf0e7f61747 2026-03-27 19:34:49,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:34:49,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c438cd944faaf0e7f61747 HTTP/1.1" 200 None 2026-03-27 19:34:49,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:34:49,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:34:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:34:49,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c438cd944faaf0e7f61747 HTTP/1.1" 200 None 2026-03-27 19:34:49,337 - lava_callback - ERROR - Error processing callback for node 69c438cd944faaf0e7f61747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55250 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:37:29,324 - lava_callback - INFO - Received callback for node 69c43973944faaf0e7f61758 INFO: 172.20.0.1:55266 - "POST /node/69c43973944faaf0e7f61758 HTTP/1.0" 202 Accepted 2026-03-27 19:37:29,330 - lava_callback - INFO - Starting async job submit for node 69c43973944faaf0e7f61758 2026-03-27 19:37:29,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:37:29,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43973944faaf0e7f61758 HTTP/1.1" 200 None 2026-03-27 19:37:29,347 - lava_callback - DEBUG - Processing node 69c43973944faaf0e7f61758: baseline-arm64-clabbe 2026-03-27 19:37:29,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43973944faaf0e7f61758 2026-03-27 19:37:29,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:37:29,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43973944faaf0e7f61758 HTTP/1.1" 200 None 2026-03-27 19:37:29,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:37:29,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:37:29,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:37:29,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43973944faaf0e7f61758 HTTP/1.1" 200 None 2026-03-27 19:37:29,413 - lava_callback - ERROR - Error processing callback for node 69c43973944faaf0e7f61758: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:38:49,506 - lava_callback - INFO - Received callback for node 69c439bf944faaf0e7f61763 INFO: 172.20.0.1:47202 - "POST /node/69c439bf944faaf0e7f61763 HTTP/1.0" 202 Accepted 2026-03-27 19:38:49,512 - lava_callback - INFO - Starting async job submit for node 69c439bf944faaf0e7f61763 2026-03-27 19:38:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:38:49,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c439bf944faaf0e7f61763 HTTP/1.1" 200 None 2026-03-27 19:38:49,528 - lava_callback - DEBUG - Processing node 69c439bf944faaf0e7f61763: baseline-arm64-baylibre 2026-03-27 19:38:49,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c439bf944faaf0e7f61763 2026-03-27 19:38:49,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:38:49,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c439bf944faaf0e7f61763 HTTP/1.1" 200 None 2026-03-27 19:38:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:38:49,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:38:49,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:38:49,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c439bf944faaf0e7f61763 HTTP/1.1" 200 None 2026-03-27 19:38:49,599 - lava_callback - ERROR - Error processing callback for node 69c439bf944faaf0e7f61763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:40:09,215 - lava_callback - INFO - Received callback for node 69c43a12944faaf0e7f6177c INFO: 172.20.0.1:54582 - "POST /node/69c43a12944faaf0e7f6177c HTTP/1.0" 202 Accepted 2026-03-27 19:40:09,221 - lava_callback - INFO - Starting async job submit for node 69c43a12944faaf0e7f6177c 2026-03-27 19:40:09,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:40:09,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43a12944faaf0e7f6177c HTTP/1.1" 200 None 2026-03-27 19:40:09,237 - lava_callback - DEBUG - Processing node 69c43a12944faaf0e7f6177c: baseline-arm64-baylibre 2026-03-27 19:40:09,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43a12944faaf0e7f6177c 2026-03-27 19:40:09,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:40:09,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43a12944faaf0e7f6177c HTTP/1.1" 200 None 2026-03-27 19:40:09,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:40:09,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:40:09,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:40:09,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43a12944faaf0e7f6177c HTTP/1.1" 200 None 2026-03-27 19:40:09,312 - lava_callback - ERROR - Error processing callback for node 69c43a12944faaf0e7f6177c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58626 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:41:49,501 - lava_callback - INFO - Received callback for node 69c43a6a944faaf0e7f6178b INFO: 172.20.0.1:58642 - "POST /node/69c43a6a944faaf0e7f6178b HTTP/1.0" 202 Accepted 2026-03-27 19:41:49,507 - lava_callback - INFO - Starting async job submit for node 69c43a6a944faaf0e7f6178b 2026-03-27 19:41:49,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:41:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43a6a944faaf0e7f6178b HTTP/1.1" 200 None 2026-03-27 19:41:49,549 - lava_callback - DEBUG - Processing node 69c43a6a944faaf0e7f6178b: baseline-arm64-clabbe 2026-03-27 19:41:49,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43a6a944faaf0e7f6178b 2026-03-27 19:41:49,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:41:49,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43a6a944faaf0e7f6178b HTTP/1.1" 200 None 2026-03-27 19:41:49,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:41:49,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-27 19:41:49,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:41:49,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43a6a944faaf0e7f6178b HTTP/1.1" 200 None 2026-03-27 19:41:49,611 - lava_callback - ERROR - Error processing callback for node 69c43a6a944faaf0e7f6178b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39652 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:42:49,404 - lava_callback - INFO - Received callback for node 69c43ab7944faaf0e7f61799 INFO: 172.20.0.1:39662 - "POST /node/69c43ab7944faaf0e7f61799 HTTP/1.0" 202 Accepted 2026-03-27 19:42:49,409 - lava_callback - INFO - Starting async job submit for node 69c43ab7944faaf0e7f61799 2026-03-27 19:42:49,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:42:49,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43ab7944faaf0e7f61799 HTTP/1.1" 200 None 2026-03-27 19:42:49,426 - lava_callback - DEBUG - Processing node 69c43ab7944faaf0e7f61799: baseline-arm64-baylibre 2026-03-27 19:42:49,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43ab7944faaf0e7f61799 2026-03-27 19:42:49,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:42:49,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43ab7944faaf0e7f61799 HTTP/1.1" 200 None 2026-03-27 19:42:49,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:42:49,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:42:49,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:42:49,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43ab7944faaf0e7f61799 HTTP/1.1" 200 None 2026-03-27 19:42:49,477 - lava_callback - ERROR - Error processing callback for node 69c43ab7944faaf0e7f61799: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:44:29,549 - lava_callback - INFO - Received callback for node 69c43b09944faaf0e7f617b0 INFO: 172.20.0.1:50968 - "POST /node/69c43b09944faaf0e7f617b0 HTTP/1.0" 202 Accepted 2026-03-27 19:44:29,557 - lava_callback - INFO - Starting async job submit for node 69c43b09944faaf0e7f617b0 2026-03-27 19:44:29,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:44:29,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43b09944faaf0e7f617b0 HTTP/1.1" 200 None 2026-03-27 19:44:29,585 - lava_callback - DEBUG - Processing node 69c43b09944faaf0e7f617b0: baseline-arm64-baylibre 2026-03-27 19:44:29,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43b09944faaf0e7f617b0 2026-03-27 19:44:29,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:44:29,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43b09944faaf0e7f617b0 HTTP/1.1" 200 None 2026-03-27 19:44:29,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:44:29,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:44:29,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:44:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43b09944faaf0e7f617b0 HTTP/1.1" 200 None 2026-03-27 19:44:29,836 - lava_callback - ERROR - Error processing callback for node 69c43b09944faaf0e7f617b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:45:49,730 - lava_callback - INFO - Received callback for node 69c43b63944faaf0e7f617bc INFO: 172.20.0.1:38016 - "POST /node/69c43b63944faaf0e7f617bc HTTP/1.0" 202 Accepted 2026-03-27 19:45:49,736 - lava_callback - INFO - Starting async job submit for node 69c43b63944faaf0e7f617bc 2026-03-27 19:45:49,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:45:49,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43b63944faaf0e7f617bc HTTP/1.1" 200 None 2026-03-27 19:45:49,752 - lava_callback - DEBUG - Processing node 69c43b63944faaf0e7f617bc: baseline-arm64-clabbe 2026-03-27 19:45:49,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43b63944faaf0e7f617bc 2026-03-27 19:45:49,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:45:49,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43b63944faaf0e7f617bc HTTP/1.1" 200 None 2026-03-27 19:45:49,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:45:49,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:45:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:45:49,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43b63944faaf0e7f617bc HTTP/1.1" 200 None 2026-03-27 19:45:49,834 - lava_callback - ERROR - Error processing callback for node 69c43b63944faaf0e7f617bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:47:09,724 - lava_callback - INFO - Received callback for node 69c43bb6944faaf0e7f617d1 INFO: 172.20.0.1:37014 - "POST /node/69c43bb6944faaf0e7f617d1 HTTP/1.0" 202 Accepted 2026-03-27 19:47:09,730 - lava_callback - INFO - Starting async job submit for node 69c43bb6944faaf0e7f617d1 2026-03-27 19:47:09,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:47:09,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43bb6944faaf0e7f617d1 HTTP/1.1" 200 None 2026-03-27 19:47:09,746 - lava_callback - DEBUG - Processing node 69c43bb6944faaf0e7f617d1: baseline-arm64-clabbe 2026-03-27 19:47:09,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43bb6944faaf0e7f617d1 2026-03-27 19:47:09,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:47:09,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43bb6944faaf0e7f617d1 HTTP/1.1" 200 None 2026-03-27 19:47:09,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:47:09,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:47:09,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:47:09,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43bb6944faaf0e7f617d1 HTTP/1.1" 200 None 2026-03-27 19:47:09,798 - lava_callback - ERROR - Error processing callback for node 69c43bb6944faaf0e7f617d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:48:49,816 - lava_callback - INFO - Received callback for node 69c43c0d944faaf0e7f617e0 INFO: 172.20.0.1:59504 - "POST /node/69c43c0d944faaf0e7f617e0 HTTP/1.0" 202 Accepted 2026-03-27 19:48:49,821 - lava_callback - INFO - Starting async job submit for node 69c43c0d944faaf0e7f617e0 2026-03-27 19:48:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:48:49,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43c0d944faaf0e7f617e0 HTTP/1.1" 200 None 2026-03-27 19:48:49,846 - lava_callback - DEBUG - Processing node 69c43c0d944faaf0e7f617e0: baseline-arm64-clabbe 2026-03-27 19:48:49,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43c0d944faaf0e7f617e0 2026-03-27 19:48:49,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:48:49,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43c0d944faaf0e7f617e0 HTTP/1.1" 200 None 2026-03-27 19:48:49,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:48:49,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:48:49,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:48:49,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43c0d944faaf0e7f617e0 HTTP/1.1" 200 None 2026-03-27 19:48:49,904 - lava_callback - ERROR - Error processing callback for node 69c43c0d944faaf0e7f617e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET /node/688caf8b262957198e43e515%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33884 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:50:09,867 - lava_callback - INFO - Received callback for node 69c43c61944faaf0e7f617ef INFO: 172.20.0.1:49142 - "POST /node/69c43c61944faaf0e7f617ef HTTP/1.0" 202 Accepted 2026-03-27 19:50:09,873 - lava_callback - INFO - Starting async job submit for node 69c43c61944faaf0e7f617ef 2026-03-27 19:50:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:50:09,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43c61944faaf0e7f617ef HTTP/1.1" 200 None 2026-03-27 19:50:09,895 - lava_callback - DEBUG - Processing node 69c43c61944faaf0e7f617ef: baseline-arm64-clabbe 2026-03-27 19:50:09,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43c61944faaf0e7f617ef 2026-03-27 19:50:09,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:50:09,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43c61944faaf0e7f617ef HTTP/1.1" 200 None 2026-03-27 19:50:09,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:50:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:50:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:50:09,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43c61944faaf0e7f617ef HTTP/1.1" 200 None 2026-03-27 19:50:09,946 - lava_callback - ERROR - Error processing callback for node 69c43c61944faaf0e7f617ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:51:29,912 - lava_callback - INFO - Received callback for node 69c43cb5944faaf0e7f617fc INFO: 172.20.0.1:42802 - "POST /node/69c43cb5944faaf0e7f617fc HTTP/1.0" 202 Accepted 2026-03-27 19:51:29,918 - lava_callback - INFO - Starting async job submit for node 69c43cb5944faaf0e7f617fc 2026-03-27 19:51:29,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:51:29,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43cb5944faaf0e7f617fc HTTP/1.1" 200 None 2026-03-27 19:51:29,935 - lava_callback - DEBUG - Processing node 69c43cb5944faaf0e7f617fc: baseline-arm64-clabbe 2026-03-27 19:51:29,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43cb5944faaf0e7f617fc 2026-03-27 19:51:29,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:51:29,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43cb5944faaf0e7f617fc HTTP/1.1" 200 None 2026-03-27 19:51:29,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:51:29,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:51:29,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:51:29,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43cb5944faaf0e7f617fc HTTP/1.1" 200 None 2026-03-27 19:51:29,987 - lava_callback - ERROR - Error processing callback for node 69c43cb5944faaf0e7f617fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET / HTTP/1.0" 200 OK 2026-03-27 19:52:50,044 - lava_callback - INFO - Received callback for node 69c43d09944faaf0e7f61808 INFO: 172.20.0.1:55112 - "POST /node/69c43d09944faaf0e7f61808 HTTP/1.0" 202 Accepted 2026-03-27 19:52:50,050 - lava_callback - INFO - Starting async job submit for node 69c43d09944faaf0e7f61808 2026-03-27 19:52:50,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:52:50,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43d09944faaf0e7f61808 HTTP/1.1" 200 None 2026-03-27 19:52:50,088 - lava_callback - DEBUG - Processing node 69c43d09944faaf0e7f61808: baseline-arm64-clabbe 2026-03-27 19:52:50,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c43d09944faaf0e7f61808 2026-03-27 19:52:50,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:52:50,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c43d09944faaf0e7f61808 HTTP/1.1" 200 None 2026-03-27 19:52:50,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:52:50,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c3295318a3717aa65d01c3 HTTP/1.1" 200 None 2026-03-27 19:52:50,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 19:52:50,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c43d09944faaf0e7f61808 HTTP/1.1" 200 None 2026-03-27 19:52:50,156 - lava_callback - ERROR - Error processing callback for node 69c43d09944faaf0e7f61808: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET /node/68fb408e5818c913a1e19dcb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42252 - "GET /node/69376d4d0c55536e7ddd9f64%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET /node/69876cbde31b58f834f19a10%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40442 - "GET /node/69b0cbc99d19175818252c3c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40450 - "GET /node/698ff16c76d4b6342e9db7c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50208 - "GET /node/6991ffaa01ff1e8e0859fa79%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48746 - "GET /node/69868eef2de8e2dea3665aed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46012 - "GET /node/6986fc8d6e077e4126a7d6c9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET /node/69840342969566dcb0d2b804%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET /node/69863544177ca0f097bd2aea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET /node/693f030224745582e39959ab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:38:52,594 - lava_callback - INFO - Received callback for node 69c447d7944faaf0e7f61884 INFO: 172.20.0.1:42462 - "POST /node/69c447d7944faaf0e7f61884 HTTP/1.0" 202 Accepted 2026-03-27 20:38:52,599 - lava_callback - INFO - Starting async job submit for node 69c447d7944faaf0e7f61884 2026-03-27 20:38:52,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:38:52,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c447d7944faaf0e7f61884 HTTP/1.1" 200 None 2026-03-27 20:38:52,615 - lava_callback - DEBUG - Processing node 69c447d7944faaf0e7f61884: baseline-arm-baylibre 2026-03-27 20:38:52,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c447d7944faaf0e7f61884 2026-03-27 20:38:52,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:38:52,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c447d7944faaf0e7f61884 HTTP/1.1" 200 None 2026-03-27 20:38:52,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:38:52,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:38:52,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:38:52,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c447d7944faaf0e7f61884 HTTP/1.1" 200 None 2026-03-27 20:38:52,679 - lava_callback - ERROR - Error processing callback for node 69c447d7944faaf0e7f61884: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:39:52,419 - lava_callback - INFO - Received callback for node 69c44813944faaf0e7f61892 INFO: 172.20.0.1:55224 - "POST /node/69c44813944faaf0e7f61892 HTTP/1.0" 202 Accepted 2026-03-27 20:39:52,425 - lava_callback - INFO - Starting async job submit for node 69c44813944faaf0e7f61892 2026-03-27 20:39:52,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:39:52,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44813944faaf0e7f61892 HTTP/1.1" 200 None 2026-03-27 20:39:52,441 - lava_callback - DEBUG - Processing node 69c44813944faaf0e7f61892: baseline-arm-baylibre 2026-03-27 20:39:52,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44813944faaf0e7f61892 2026-03-27 20:39:52,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:39:52,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44813944faaf0e7f61892 HTTP/1.1" 200 None 2026-03-27 20:39:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:39:52,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:39:52,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:39:52,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44813944faaf0e7f61892 HTTP/1.1" 200 None 2026-03-27 20:39:52,499 - lava_callback - ERROR - Error processing callback for node 69c44813944faaf0e7f61892: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35006 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:40:32,505 - lava_callback - INFO - Received callback for node 69c4483d944faaf0e7f618a2 INFO: 172.20.0.1:35018 - "POST /node/69c4483d944faaf0e7f618a2 HTTP/1.0" 202 Accepted 2026-03-27 20:40:32,510 - lava_callback - INFO - Starting async job submit for node 69c4483d944faaf0e7f618a2 2026-03-27 20:40:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:40:32,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4483d944faaf0e7f618a2 HTTP/1.1" 200 None 2026-03-27 20:40:32,527 - lava_callback - DEBUG - Processing node 69c4483d944faaf0e7f618a2: baseline-arm-baylibre 2026-03-27 20:40:32,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4483d944faaf0e7f618a2 2026-03-27 20:40:32,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:40:32,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4483d944faaf0e7f618a2 HTTP/1.1" 200 None 2026-03-27 20:40:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:40:32,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:40:32,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:40:32,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4483d944faaf0e7f618a2 HTTP/1.1" 200 None 2026-03-27 20:40:32,606 - lava_callback - ERROR - Error processing callback for node 69c4483d944faaf0e7f618a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:41:12,501 - lava_callback - INFO - Received callback for node 69c44865944faaf0e7f618ac INFO: 172.20.0.1:33754 - "POST /node/69c44865944faaf0e7f618ac HTTP/1.0" 202 Accepted 2026-03-27 20:41:12,506 - lava_callback - INFO - Starting async job submit for node 69c44865944faaf0e7f618ac 2026-03-27 20:41:12,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:41:12,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44865944faaf0e7f618ac HTTP/1.1" 200 None 2026-03-27 20:41:12,526 - lava_callback - DEBUG - Processing node 69c44865944faaf0e7f618ac: baseline-arm-baylibre 2026-03-27 20:41:12,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44865944faaf0e7f618ac 2026-03-27 20:41:12,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:41:12,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44865944faaf0e7f618ac HTTP/1.1" 200 None 2026-03-27 20:41:12,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:41:12,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:41:12,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:41:12,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44865944faaf0e7f618ac HTTP/1.1" 200 None 2026-03-27 20:41:12,583 - lava_callback - ERROR - Error processing callback for node 69c44865944faaf0e7f618ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55170 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:42:12,758 - lava_callback - INFO - Received callback for node 69c4488f944faaf0e7f618bc INFO: 172.20.0.1:51224 - "POST /node/69c4488f944faaf0e7f618bc HTTP/1.0" 202 Accepted 2026-03-27 20:42:12,763 - lava_callback - INFO - Starting async job submit for node 69c4488f944faaf0e7f618bc 2026-03-27 20:42:12,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:12,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4488f944faaf0e7f618bc HTTP/1.1" 200 None 2026-03-27 20:42:12,780 - lava_callback - DEBUG - Processing node 69c4488f944faaf0e7f618bc: baseline-arm-baylibre 2026-03-27 20:42:12,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4488f944faaf0e7f618bc 2026-03-27 20:42:12,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:12,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4488f944faaf0e7f618bc HTTP/1.1" 200 None 2026-03-27 20:42:12,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:12,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:42:12,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:12,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4488f944faaf0e7f618bc HTTP/1.1" 200 None 2026-03-27 20:42:12,842 - lava_callback - ERROR - Error processing callback for node 69c4488f944faaf0e7f618bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41880 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:42:52,611 - lava_callback - INFO - Received callback for node 69c448b8944faaf0e7f618cd INFO: 172.20.0.1:40458 - "POST /node/69c448b8944faaf0e7f618cd HTTP/1.0" 202 Accepted 2026-03-27 20:42:52,617 - lava_callback - INFO - Starting async job submit for node 69c448b8944faaf0e7f618cd 2026-03-27 20:42:52,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:52,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c448b8944faaf0e7f618cd HTTP/1.1" 200 None 2026-03-27 20:42:52,634 - lava_callback - DEBUG - Processing node 69c448b8944faaf0e7f618cd: baseline-arm-baylibre 2026-03-27 20:42:52,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c448b8944faaf0e7f618cd 2026-03-27 20:42:52,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:52,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c448b8944faaf0e7f618cd HTTP/1.1" 200 None 2026-03-27 20:42:52,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:52,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:42:52,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:42:52,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c448b8944faaf0e7f618cd HTTP/1.1" 200 None 2026-03-27 20:42:52,690 - lava_callback - ERROR - Error processing callback for node 69c448b8944faaf0e7f618cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET /node/69c24ed34a2c5046eb880030%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:44:52,374 - lava_callback - INFO - Received callback for node 69c44935944faaf0e7f618fb INFO: 172.20.0.1:59028 - "POST /node/69c44935944faaf0e7f618fb HTTP/1.0" 202 Accepted 2026-03-27 20:44:52,379 - lava_callback - INFO - Starting async job submit for node 69c44935944faaf0e7f618fb 2026-03-27 20:44:52,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:44:52,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44935944faaf0e7f618fb HTTP/1.1" 200 None 2026-03-27 20:44:52,396 - lava_callback - DEBUG - Processing node 69c44935944faaf0e7f618fb: baseline-arm-clabbe 2026-03-27 20:44:52,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44935944faaf0e7f618fb 2026-03-27 20:44:52,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:44:52,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44935944faaf0e7f618fb HTTP/1.1" 200 None 2026-03-27 20:44:52,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:44:52,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:44:52,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:44:52,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44935944faaf0e7f618fb HTTP/1.1" 200 None 2026-03-27 20:44:52,448 - lava_callback - ERROR - Error processing callback for node 69c44935944faaf0e7f618fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:45:32,333 - lava_callback - INFO - Received callback for node 69c4495f944faaf0e7f6190a INFO: 172.20.0.1:55698 - "POST /node/69c4495f944faaf0e7f6190a HTTP/1.0" 202 Accepted 2026-03-27 20:45:32,339 - lava_callback - INFO - Starting async job submit for node 69c4495f944faaf0e7f6190a 2026-03-27 20:45:32,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:45:32,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4495f944faaf0e7f6190a HTTP/1.1" 200 None 2026-03-27 20:45:32,354 - lava_callback - DEBUG - Processing node 69c4495f944faaf0e7f6190a: baseline-arm-clabbe 2026-03-27 20:45:32,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4495f944faaf0e7f6190a 2026-03-27 20:45:32,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:45:32,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4495f944faaf0e7f6190a HTTP/1.1" 200 None 2026-03-27 20:45:32,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:45:32,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:45:32,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:45:32,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4495f944faaf0e7f6190a HTTP/1.1" 200 None 2026-03-27 20:45:32,415 - lava_callback - ERROR - Error processing callback for node 69c4495f944faaf0e7f6190a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35244 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:46:12,397 - lava_callback - INFO - Received callback for node 69c4498a944faaf0e7f6191e INFO: 172.20.0.1:35198 - "POST /node/69c4498a944faaf0e7f6191e HTTP/1.0" 202 Accepted 2026-03-27 20:46:12,403 - lava_callback - INFO - Starting async job submit for node 69c4498a944faaf0e7f6191e 2026-03-27 20:46:12,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:12,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4498a944faaf0e7f6191e HTTP/1.1" 200 None 2026-03-27 20:46:12,418 - lava_callback - DEBUG - Processing node 69c4498a944faaf0e7f6191e: baseline-arm-clabbe 2026-03-27 20:46:12,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4498a944faaf0e7f6191e 2026-03-27 20:46:12,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:12,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4498a944faaf0e7f6191e HTTP/1.1" 200 None 2026-03-27 20:46:12,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:12,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:46:12,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:12,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4498a944faaf0e7f6191e HTTP/1.1" 200 None 2026-03-27 20:46:12,482 - lava_callback - ERROR - Error processing callback for node 69c4498a944faaf0e7f6191e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:46:52,374 - lava_callback - INFO - Received callback for node 69c449b3944faaf0e7f61927 INFO: 172.20.0.1:46360 - "POST /node/69c449b3944faaf0e7f61927 HTTP/1.0" 202 Accepted 2026-03-27 20:46:52,380 - lava_callback - INFO - Starting async job submit for node 69c449b3944faaf0e7f61927 2026-03-27 20:46:52,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:52,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c449b3944faaf0e7f61927 HTTP/1.1" 200 None 2026-03-27 20:46:52,404 - lava_callback - DEBUG - Processing node 69c449b3944faaf0e7f61927: baseline-arm-clabbe 2026-03-27 20:46:52,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c449b3944faaf0e7f61927 2026-03-27 20:46:52,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:52,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c449b3944faaf0e7f61927 HTTP/1.1" 200 None 2026-03-27 20:46:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:52,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:46:52,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:46:52,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c449b3944faaf0e7f61927 HTTP/1.1" 200 None 2026-03-27 20:46:52,457 - lava_callback - ERROR - Error processing callback for node 69c449b3944faaf0e7f61927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:47:32,460 - lava_callback - INFO - Received callback for node 69c449dc944faaf0e7f61935 INFO: 172.20.0.1:48372 - "POST /node/69c449dc944faaf0e7f61935 HTTP/1.0" 202 Accepted 2026-03-27 20:47:32,465 - lava_callback - INFO - Starting async job submit for node 69c449dc944faaf0e7f61935 2026-03-27 20:47:32,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:47:32,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c449dc944faaf0e7f61935 HTTP/1.1" 200 None 2026-03-27 20:47:32,482 - lava_callback - DEBUG - Processing node 69c449dc944faaf0e7f61935: baseline-arm-clabbe 2026-03-27 20:47:32,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c449dc944faaf0e7f61935 2026-03-27 20:47:32,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:47:32,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c449dc944faaf0e7f61935 HTTP/1.1" 200 None 2026-03-27 20:47:32,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:47:32,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-03-27 20:47:32,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:47:32,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c449dc944faaf0e7f61935 HTTP/1.1" 200 None 2026-03-27 20:47:32,587 - lava_callback - ERROR - Error processing callback for node 69c449dc944faaf0e7f61935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET /node/69487b959214b4938716945c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51710 - "GET /node/698468443a8748f282086be1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET /node/6981c883f633e773758fb9f6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET /node/6984b65f3a8748f282088749%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:58:33,601 - lava_callback - INFO - Received callback for node 69c44c6d944faaf0e7f61978 INFO: 172.20.0.1:55360 - "POST /node/69c44c6d944faaf0e7f61978 HTTP/1.0" 202 Accepted 2026-03-27 20:58:33,606 - lava_callback - INFO - Starting async job submit for node 69c44c6d944faaf0e7f61978 2026-03-27 20:58:33,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:58:33,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44c6d944faaf0e7f61978 HTTP/1.1" 200 None 2026-03-27 20:58:33,621 - lava_callback - DEBUG - Processing node 69c44c6d944faaf0e7f61978: baseline-arm-baylibre 2026-03-27 20:58:33,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44c6d944faaf0e7f61978 2026-03-27 20:58:33,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:58:33,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44c6d944faaf0e7f61978 HTTP/1.1" 200 None 2026-03-27 20:58:33,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:58:33,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 20:58:33,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:58:33,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44c6d944faaf0e7f61978 HTTP/1.1" 200 None 2026-03-27 20:58:33,686 - lava_callback - ERROR - Error processing callback for node 69c44c6d944faaf0e7f61978: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42200 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:59:13,498 - lava_callback - INFO - Received callback for node 69c44c98944faaf0e7f61986 INFO: 172.20.0.1:40352 - "POST /node/69c44c98944faaf0e7f61986 HTTP/1.0" 202 Accepted 2026-03-27 20:59:13,504 - lava_callback - INFO - Starting async job submit for node 69c44c98944faaf0e7f61986 2026-03-27 20:59:13,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:13,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44c98944faaf0e7f61986 HTTP/1.1" 200 None 2026-03-27 20:59:13,520 - lava_callback - DEBUG - Processing node 69c44c98944faaf0e7f61986: baseline-arm-baylibre 2026-03-27 20:59:13,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44c98944faaf0e7f61986 2026-03-27 20:59:13,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:13,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44c98944faaf0e7f61986 HTTP/1.1" 200 None 2026-03-27 20:59:13,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:13,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 20:59:13,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:13,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44c98944faaf0e7f61986 HTTP/1.1" 200 None 2026-03-27 20:59:13,588 - lava_callback - ERROR - Error processing callback for node 69c44c98944faaf0e7f61986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45472 - "GET / HTTP/1.0" 200 OK 2026-03-27 20:59:53,605 - lava_callback - INFO - Received callback for node 69c44cc2944faaf0e7f61992 INFO: 172.20.0.1:52428 - "POST /node/69c44cc2944faaf0e7f61992 HTTP/1.0" 202 Accepted 2026-03-27 20:59:53,612 - lava_callback - INFO - Starting async job submit for node 69c44cc2944faaf0e7f61992 2026-03-27 20:59:53,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:53,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44cc2944faaf0e7f61992 HTTP/1.1" 200 None 2026-03-27 20:59:53,628 - lava_callback - DEBUG - Processing node 69c44cc2944faaf0e7f61992: baseline-arm-baylibre 2026-03-27 20:59:53,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44cc2944faaf0e7f61992 2026-03-27 20:59:53,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:53,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44cc2944faaf0e7f61992 HTTP/1.1" 200 None 2026-03-27 20:59:53,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 20:59:53,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 20:59:53,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44cc2944faaf0e7f61992 HTTP/1.1" 200 None 2026-03-27 20:59:53,681 - lava_callback - ERROR - Error processing callback for node 69c44cc2944faaf0e7f61992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:00:33,575 - lava_callback - INFO - Received callback for node 69c44ceb944faaf0e7f619a2 INFO: 172.20.0.1:50184 - "POST /node/69c44ceb944faaf0e7f619a2 HTTP/1.0" 202 Accepted 2026-03-27 21:00:33,581 - lava_callback - INFO - Starting async job submit for node 69c44ceb944faaf0e7f619a2 2026-03-27 21:00:33,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:00:33,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44ceb944faaf0e7f619a2 HTTP/1.1" 200 None 2026-03-27 21:00:33,597 - lava_callback - DEBUG - Processing node 69c44ceb944faaf0e7f619a2: baseline-arm-baylibre 2026-03-27 21:00:33,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44ceb944faaf0e7f619a2 2026-03-27 21:00:33,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:00:33,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44ceb944faaf0e7f619a2 HTTP/1.1" 200 None 2026-03-27 21:00:33,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:00:33,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:00:33,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:00:33,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44ceb944faaf0e7f619a2 HTTP/1.1" 200 None 2026-03-27 21:00:33,691 - lava_callback - ERROR - Error processing callback for node 69c44ceb944faaf0e7f619a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET /node/6948929648abaf7e25584c13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:01:13,621 - lava_callback - INFO - Received callback for node 69c44d16944faaf0e7f619b0 INFO: 172.20.0.1:47276 - "POST /node/69c44d16944faaf0e7f619b0 HTTP/1.0" 202 Accepted 2026-03-27 21:01:13,629 - lava_callback - INFO - Starting async job submit for node 69c44d16944faaf0e7f619b0 2026-03-27 21:01:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:13,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44d16944faaf0e7f619b0 HTTP/1.1" 200 None 2026-03-27 21:01:13,647 - lava_callback - DEBUG - Processing node 69c44d16944faaf0e7f619b0: baseline-arm-baylibre 2026-03-27 21:01:13,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44d16944faaf0e7f619b0 2026-03-27 21:01:13,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44d16944faaf0e7f619b0 HTTP/1.1" 200 None 2026-03-27 21:01:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:13,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:01:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:13,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44d16944faaf0e7f619b0 HTTP/1.1" 200 None 2026-03-27 21:01:13,728 - lava_callback - ERROR - Error processing callback for node 69c44d16944faaf0e7f619b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:01:53,657 - lava_callback - INFO - Received callback for node 69c44d3f944faaf0e7f619bd INFO: 172.20.0.1:55706 - "POST /node/69c44d3f944faaf0e7f619bd HTTP/1.0" 202 Accepted 2026-03-27 21:01:53,662 - lava_callback - INFO - Starting async job submit for node 69c44d3f944faaf0e7f619bd 2026-03-27 21:01:53,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44d3f944faaf0e7f619bd HTTP/1.1" 200 None 2026-03-27 21:01:53,678 - lava_callback - DEBUG - Processing node 69c44d3f944faaf0e7f619bd: baseline-arm-baylibre 2026-03-27 21:01:53,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44d3f944faaf0e7f619bd 2026-03-27 21:01:53,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:53,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44d3f944faaf0e7f619bd HTTP/1.1" 200 None 2026-03-27 21:01:53,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:53,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:01:53,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:01:53,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44d3f944faaf0e7f619bd HTTP/1.1" 200 None 2026-03-27 21:01:53,763 - lava_callback - ERROR - Error processing callback for node 69c44d3f944faaf0e7f619bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:05:33,128 - lava_callback - INFO - Received callback for node 69c44e0d944faaf0e7f619de INFO: 172.20.0.1:33686 - "POST /node/69c44e0d944faaf0e7f619de HTTP/1.0" 202 Accepted 2026-03-27 21:05:33,133 - lava_callback - INFO - Starting async job submit for node 69c44e0d944faaf0e7f619de 2026-03-27 21:05:33,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:05:33,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e0d944faaf0e7f619de HTTP/1.1" 200 None 2026-03-27 21:05:33,149 - lava_callback - DEBUG - Processing node 69c44e0d944faaf0e7f619de: baseline-arm-clabbe 2026-03-27 21:05:33,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44e0d944faaf0e7f619de 2026-03-27 21:05:33,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:05:33,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e0d944faaf0e7f619de HTTP/1.1" 200 None 2026-03-27 21:05:33,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:05:33,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:05:33,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:05:33,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44e0d944faaf0e7f619de HTTP/1.1" 200 None 2026-03-27 21:05:33,227 - lava_callback - ERROR - Error processing callback for node 69c44e0d944faaf0e7f619de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:06:13,132 - lava_callback - INFO - Received callback for node 69c44e39944faaf0e7f619ed INFO: 172.20.0.1:52468 - "POST /node/69c44e39944faaf0e7f619ed HTTP/1.0" 202 Accepted 2026-03-27 21:06:13,137 - lava_callback - INFO - Starting async job submit for node 69c44e39944faaf0e7f619ed 2026-03-27 21:06:13,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:13,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e39944faaf0e7f619ed HTTP/1.1" 200 None 2026-03-27 21:06:13,162 - lava_callback - DEBUG - Processing node 69c44e39944faaf0e7f619ed: baseline-arm-clabbe 2026-03-27 21:06:13,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44e39944faaf0e7f619ed 2026-03-27 21:06:13,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:13,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e39944faaf0e7f619ed HTTP/1.1" 200 None 2026-03-27 21:06:13,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:13,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:06:13,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:13,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44e39944faaf0e7f619ed HTTP/1.1" 200 None 2026-03-27 21:06:13,217 - lava_callback - ERROR - Error processing callback for node 69c44e39944faaf0e7f619ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47358 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:06:53,212 - lava_callback - INFO - Received callback for node 69c44e61944faaf0e7f619f5 INFO: 172.20.0.1:47520 - "POST /node/69c44e61944faaf0e7f619f5 HTTP/1.0" 202 Accepted 2026-03-27 21:06:53,218 - lava_callback - INFO - Starting async job submit for node 69c44e61944faaf0e7f619f5 2026-03-27 21:06:53,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:53,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e61944faaf0e7f619f5 HTTP/1.1" 200 None 2026-03-27 21:06:53,234 - lava_callback - DEBUG - Processing node 69c44e61944faaf0e7f619f5: baseline-arm-clabbe 2026-03-27 21:06:53,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44e61944faaf0e7f619f5 2026-03-27 21:06:53,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:53,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44e61944faaf0e7f619f5 HTTP/1.1" 200 None 2026-03-27 21:06:53,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:53,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:06:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:06:53,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44e61944faaf0e7f619f5 HTTP/1.1" 200 None 2026-03-27 21:06:53,292 - lava_callback - ERROR - Error processing callback for node 69c44e61944faaf0e7f619f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52122 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:10:13,445 - lava_callback - INFO - Received callback for node 69c44f2d944faaf0e7f61a2c INFO: 172.20.0.1:55272 - "POST /node/69c44f2d944faaf0e7f61a2c HTTP/1.0" 202 Accepted 2026-03-27 21:10:13,450 - lava_callback - INFO - Starting async job submit for node 69c44f2d944faaf0e7f61a2c 2026-03-27 21:10:13,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:13,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44f2d944faaf0e7f61a2c HTTP/1.1" 200 None 2026-03-27 21:10:13,485 - lava_callback - DEBUG - Processing node 69c44f2d944faaf0e7f61a2c: baseline-arm-clabbe 2026-03-27 21:10:13,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44f2d944faaf0e7f61a2c 2026-03-27 21:10:13,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:13,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44f2d944faaf0e7f61a2c HTTP/1.1" 200 None 2026-03-27 21:10:13,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:13,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:10:13,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:13,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44f2d944faaf0e7f61a2c HTTP/1.1" 200 None 2026-03-27 21:10:13,580 - lava_callback - ERROR - Error processing callback for node 69c44f2d944faaf0e7f61a2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:10:53,363 - lava_callback - INFO - Received callback for node 69c44f57944faaf0e7f61a34 INFO: 172.20.0.1:56052 - "POST /node/69c44f57944faaf0e7f61a34 HTTP/1.0" 202 Accepted 2026-03-27 21:10:53,368 - lava_callback - INFO - Starting async job submit for node 69c44f57944faaf0e7f61a34 2026-03-27 21:10:53,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:53,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44f57944faaf0e7f61a34 HTTP/1.1" 200 None 2026-03-27 21:10:53,385 - lava_callback - DEBUG - Processing node 69c44f57944faaf0e7f61a34: baseline-arm-clabbe 2026-03-27 21:10:53,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c44f57944faaf0e7f61a34 2026-03-27 21:10:53,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:53,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c44f57944faaf0e7f61a34 HTTP/1.1" 200 None 2026-03-27 21:10:53,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:53,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:10:53,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:10:53,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c44f57944faaf0e7f61a34 HTTP/1.1" 200 None 2026-03-27 21:10:53,442 - lava_callback - ERROR - Error processing callback for node 69c44f57944faaf0e7f61a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:15:54,788 - lava_callback - INFO - Received callback for node 69c4507b944faaf0e7f61a65 INFO: 172.20.0.1:47002 - "POST /node/69c4507b944faaf0e7f61a65 HTTP/1.0" 202 Accepted 2026-03-27 21:15:54,794 - lava_callback - INFO - Starting async job submit for node 69c4507b944faaf0e7f61a65 2026-03-27 21:15:54,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:15:54,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4507b944faaf0e7f61a65 HTTP/1.1" 200 None 2026-03-27 21:15:54,810 - lava_callback - DEBUG - Processing node 69c4507b944faaf0e7f61a65: baseline-arm64-baylibre 2026-03-27 21:15:54,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4507b944faaf0e7f61a65 2026-03-27 21:15:54,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:15:54,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4507b944faaf0e7f61a65 HTTP/1.1" 200 None 2026-03-27 21:15:54,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:15:54,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:15:54,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:15:54,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4507b944faaf0e7f61a65 HTTP/1.1" 200 None 2026-03-27 21:15:54,875 - lava_callback - ERROR - Error processing callback for node 69c4507b944faaf0e7f61a65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47590 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:16:54,489 - lava_callback - INFO - Received callback for node 69c450c1944faaf0e7f61a72 INFO: 172.20.0.1:41156 - "POST /node/69c450c1944faaf0e7f61a72 HTTP/1.0" 202 Accepted 2026-03-27 21:16:54,494 - lava_callback - INFO - Starting async job submit for node 69c450c1944faaf0e7f61a72 2026-03-27 21:16:54,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:16:54,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c450c1944faaf0e7f61a72 HTTP/1.1" 200 None 2026-03-27 21:16:54,510 - lava_callback - DEBUG - Processing node 69c450c1944faaf0e7f61a72: baseline-arm-baylibre 2026-03-27 21:16:54,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c450c1944faaf0e7f61a72 2026-03-27 21:16:54,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:16:54,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c450c1944faaf0e7f61a72 HTTP/1.1" 200 None 2026-03-27 21:16:54,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:16:54,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:16:54,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:16:54,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c450c1944faaf0e7f61a72 HTTP/1.1" 200 None 2026-03-27 21:16:54,567 - lava_callback - ERROR - Error processing callback for node 69c450c1944faaf0e7f61a72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:17:54,619 - lava_callback - INFO - Received callback for node 69c450f7944faaf0e7f61a7f INFO: 172.20.0.1:60474 - "POST /node/69c450f7944faaf0e7f61a7f HTTP/1.0" 202 Accepted 2026-03-27 21:17:54,625 - lava_callback - INFO - Starting async job submit for node 69c450f7944faaf0e7f61a7f 2026-03-27 21:17:54,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:17:54,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c450f7944faaf0e7f61a7f HTTP/1.1" 200 None 2026-03-27 21:17:54,641 - lava_callback - DEBUG - Processing node 69c450f7944faaf0e7f61a7f: baseline-arm64-baylibre 2026-03-27 21:17:54,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c450f7944faaf0e7f61a7f 2026-03-27 21:17:54,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:17:54,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c450f7944faaf0e7f61a7f HTTP/1.1" 200 None 2026-03-27 21:17:54,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:17:54,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:17:54,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:17:54,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c450f7944faaf0e7f61a7f HTTP/1.1" 200 None 2026-03-27 21:17:54,706 - lava_callback - ERROR - Error processing callback for node 69c450f7944faaf0e7f61a7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33970 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:20:54,782 - lava_callback - INFO - Received callback for node 69c451a1944faaf0e7f61a9f INFO: 172.20.0.1:56864 - "POST /node/69c451a1944faaf0e7f61a9f HTTP/1.0" 202 Accepted 2026-03-27 21:20:54,790 - lava_callback - INFO - Starting async job submit for node 69c451a1944faaf0e7f61a9f 2026-03-27 21:20:54,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:20:54,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c451a1944faaf0e7f61a9f HTTP/1.1" 200 None 2026-03-27 21:20:54,810 - lava_callback - DEBUG - Processing node 69c451a1944faaf0e7f61a9f: baseline-arm64-baylibre 2026-03-27 21:20:54,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c451a1944faaf0e7f61a9f 2026-03-27 21:20:54,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:20:54,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c451a1944faaf0e7f61a9f HTTP/1.1" 200 None 2026-03-27 21:20:54,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:20:54,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:20:54,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:20:54,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c451a1944faaf0e7f61a9f HTTP/1.1" 200 None 2026-03-27 21:20:54,876 - lava_callback - ERROR - Error processing callback for node 69c451a1944faaf0e7f61a9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33866 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:22:14,824 - lava_callback - INFO - Received callback for node 69c451f2944faaf0e7f61aac INFO: 172.20.0.1:35868 - "POST /node/69c451f2944faaf0e7f61aac HTTP/1.0" 202 Accepted 2026-03-27 21:22:14,830 - lava_callback - INFO - Starting async job submit for node 69c451f2944faaf0e7f61aac 2026-03-27 21:22:14,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:22:14,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c451f2944faaf0e7f61aac HTTP/1.1" 200 None 2026-03-27 21:22:14,858 - lava_callback - DEBUG - Processing node 69c451f2944faaf0e7f61aac: baseline-arm64-baylibre 2026-03-27 21:22:14,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c451f2944faaf0e7f61aac 2026-03-27 21:22:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:22:14,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c451f2944faaf0e7f61aac HTTP/1.1" 200 None 2026-03-27 21:22:14,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:22:14,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:22:14,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:22:14,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c451f2944faaf0e7f61aac HTTP/1.1" 200 None 2026-03-27 21:22:14,910 - lava_callback - ERROR - Error processing callback for node 69c451f2944faaf0e7f61aac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:23:33,931 - lava_callback - INFO - Received callback for node 69c4524d944faaf0e7f61ab9 INFO: 172.20.0.1:51236 - "POST /node/69c4524d944faaf0e7f61ab9 HTTP/1.0" 202 Accepted 2026-03-27 21:23:33,937 - lava_callback - INFO - Starting async job submit for node 69c4524d944faaf0e7f61ab9 2026-03-27 21:23:33,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:23:33,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4524d944faaf0e7f61ab9 HTTP/1.1" 200 None 2026-03-27 21:23:33,953 - lava_callback - DEBUG - Processing node 69c4524d944faaf0e7f61ab9: baseline-arm64-clabbe 2026-03-27 21:23:33,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4524d944faaf0e7f61ab9 2026-03-27 21:23:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:23:33,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4524d944faaf0e7f61ab9 HTTP/1.1" 200 None 2026-03-27 21:23:33,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:23:33,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:23:33,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:23:34,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4524d944faaf0e7f61ab9 HTTP/1.1" 200 None 2026-03-27 21:23:34,013 - lava_callback - ERROR - Error processing callback for node 69c4524d944faaf0e7f61ab9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:24:55,003 - lava_callback - INFO - Received callback for node 69c45296944faaf0e7f61ac9 INFO: 172.20.0.1:58990 - "POST /node/69c45296944faaf0e7f61ac9 HTTP/1.0" 202 Accepted 2026-03-27 21:24:55,008 - lava_callback - INFO - Starting async job submit for node 69c45296944faaf0e7f61ac9 2026-03-27 21:24:55,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:24:55,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45296944faaf0e7f61ac9 HTTP/1.1" 200 None 2026-03-27 21:24:55,025 - lava_callback - DEBUG - Processing node 69c45296944faaf0e7f61ac9: baseline-arm64-baylibre 2026-03-27 21:24:55,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45296944faaf0e7f61ac9 2026-03-27 21:24:55,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:24:55,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45296944faaf0e7f61ac9 HTTP/1.1" 200 None 2026-03-27 21:24:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:24:55,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:24:55,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:24:55,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45296944faaf0e7f61ac9 HTTP/1.1" 200 None 2026-03-27 21:24:55,089 - lava_callback - ERROR - Error processing callback for node 69c45296944faaf0e7f61ac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51052 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:26:15,065 - lava_callback - INFO - Received callback for node 69c452e8944faaf0e7f61add INFO: 172.20.0.1:43384 - "POST /node/69c452e8944faaf0e7f61add HTTP/1.0" 202 Accepted 2026-03-27 21:26:15,070 - lava_callback - INFO - Starting async job submit for node 69c452e8944faaf0e7f61add 2026-03-27 21:26:15,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:26:15,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c452e8944faaf0e7f61add HTTP/1.1" 200 None 2026-03-27 21:26:15,096 - lava_callback - DEBUG - Processing node 69c452e8944faaf0e7f61add: baseline-arm64-baylibre 2026-03-27 21:26:15,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c452e8944faaf0e7f61add 2026-03-27 21:26:15,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:26:15,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c452e8944faaf0e7f61add HTTP/1.1" 200 None 2026-03-27 21:26:15,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:26:15,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:26:15,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:43390 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:26:15,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c452e8944faaf0e7f61add HTTP/1.1" 200 None 2026-03-27 21:26:15,183 - lava_callback - ERROR - Error processing callback for node 69c452e8944faaf0e7f61add: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41050 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:27:34,089 - lava_callback - INFO - Received callback for node 69c45343944faaf0e7f61aec INFO: 172.20.0.1:41054 - "POST /node/69c45343944faaf0e7f61aec HTTP/1.0" 202 Accepted 2026-03-27 21:27:34,094 - lava_callback - INFO - Starting async job submit for node 69c45343944faaf0e7f61aec 2026-03-27 21:27:34,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:27:34,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45343944faaf0e7f61aec HTTP/1.1" 200 None 2026-03-27 21:27:34,110 - lava_callback - DEBUG - Processing node 69c45343944faaf0e7f61aec: baseline-arm64-clabbe 2026-03-27 21:27:34,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45343944faaf0e7f61aec 2026-03-27 21:27:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:27:34,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45343944faaf0e7f61aec HTTP/1.1" 200 None 2026-03-27 21:27:34,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:27:34,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:27:34,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:27:34,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45343944faaf0e7f61aec HTTP/1.1" 200 None 2026-03-27 21:27:34,168 - lava_callback - ERROR - Error processing callback for node 69c45343944faaf0e7f61aec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44162 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:29:14,175 - lava_callback - INFO - Received callback for node 69c45395944faaf0e7f61af4 INFO: 172.20.0.1:41222 - "POST /node/69c45395944faaf0e7f61af4 HTTP/1.0" 202 Accepted 2026-03-27 21:29:14,180 - lava_callback - INFO - Starting async job submit for node 69c45395944faaf0e7f61af4 2026-03-27 21:29:14,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:29:14,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45395944faaf0e7f61af4 HTTP/1.1" 200 None 2026-03-27 21:29:14,197 - lava_callback - DEBUG - Processing node 69c45395944faaf0e7f61af4: baseline-arm64-clabbe 2026-03-27 21:29:14,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45395944faaf0e7f61af4 2026-03-27 21:29:14,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:29:14,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45395944faaf0e7f61af4 HTTP/1.1" 200 None 2026-03-27 21:29:14,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:29:14,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:29:14,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:29:14,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45395944faaf0e7f61af4 HTTP/1.1" 200 None 2026-03-27 21:29:14,248 - lava_callback - ERROR - Error processing callback for node 69c45395944faaf0e7f61af4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:30:34,258 - lava_callback - INFO - Received callback for node 69c453ea944faaf0e7f61b0e INFO: 172.20.0.1:37782 - "POST /node/69c453ea944faaf0e7f61b0e HTTP/1.0" 202 Accepted 2026-03-27 21:30:34,263 - lava_callback - INFO - Starting async job submit for node 69c453ea944faaf0e7f61b0e 2026-03-27 21:30:34,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:30:34,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c453ea944faaf0e7f61b0e HTTP/1.1" 200 None 2026-03-27 21:30:34,279 - lava_callback - DEBUG - Processing node 69c453ea944faaf0e7f61b0e: baseline-arm64-clabbe 2026-03-27 21:30:34,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c453ea944faaf0e7f61b0e 2026-03-27 21:30:34,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:30:34,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c453ea944faaf0e7f61b0e HTTP/1.1" 200 None 2026-03-27 21:30:34,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:30:34,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:30:34,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:30:34,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c453ea944faaf0e7f61b0e HTTP/1.1" 200 None 2026-03-27 21:30:34,330 - lava_callback - ERROR - Error processing callback for node 69c453ea944faaf0e7f61b0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:31:35,401 - lava_callback - INFO - Received callback for node 69c45435944faaf0e7f61b1f INFO: 172.20.0.1:47384 - "POST /node/69c45435944faaf0e7f61b1f HTTP/1.0" 202 Accepted 2026-03-27 21:31:35,406 - lava_callback - INFO - Starting async job submit for node 69c45435944faaf0e7f61b1f 2026-03-27 21:31:35,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:31:35,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45435944faaf0e7f61b1f HTTP/1.1" 200 None 2026-03-27 21:31:35,422 - lava_callback - DEBUG - Processing node 69c45435944faaf0e7f61b1f: baseline-arm64-baylibre 2026-03-27 21:31:35,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45435944faaf0e7f61b1f 2026-03-27 21:31:35,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:31:35,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45435944faaf0e7f61b1f HTTP/1.1" 200 None 2026-03-27 21:31:35,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:31:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:31:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:31:35,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45435944faaf0e7f61b1f HTTP/1.1" 200 None 2026-03-27 21:31:35,481 - lava_callback - ERROR - Error processing callback for node 69c45435944faaf0e7f61b1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39760 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:33:14,300 - lava_callback - INFO - Received callback for node 69c4548f944faaf0e7f61b38 INFO: 172.20.0.1:53406 - "POST /node/69c4548f944faaf0e7f61b38 HTTP/1.0" 202 Accepted 2026-03-27 21:33:14,306 - lava_callback - INFO - Starting async job submit for node 69c4548f944faaf0e7f61b38 2026-03-27 21:33:14,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:33:14,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4548f944faaf0e7f61b38 HTTP/1.1" 200 None 2026-03-27 21:33:14,332 - lava_callback - DEBUG - Processing node 69c4548f944faaf0e7f61b38: baseline-arm64-clabbe 2026-03-27 21:33:14,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4548f944faaf0e7f61b38 2026-03-27 21:33:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:33:14,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4548f944faaf0e7f61b38 HTTP/1.1" 200 None 2026-03-27 21:33:14,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:33:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:33:14,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:33:14,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4548f944faaf0e7f61b38 HTTP/1.1" 200 None 2026-03-27 21:33:14,391 - lava_callback - ERROR - Error processing callback for node 69c4548f944faaf0e7f61b38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37700 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:34:35,547 - lava_callback - INFO - Received callback for node 69c454dc944faaf0e7f61b42 INFO: 172.20.0.1:37706 - "POST /node/69c454dc944faaf0e7f61b42 HTTP/1.0" 202 Accepted 2026-03-27 21:34:35,552 - lava_callback - INFO - Starting async job submit for node 69c454dc944faaf0e7f61b42 2026-03-27 21:34:35,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:34:35,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c454dc944faaf0e7f61b42 HTTP/1.1" 200 None 2026-03-27 21:34:35,567 - lava_callback - DEBUG - Processing node 69c454dc944faaf0e7f61b42: baseline-arm64-baylibre 2026-03-27 21:34:35,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c454dc944faaf0e7f61b42 2026-03-27 21:34:35,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:34:35,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c454dc944faaf0e7f61b42 HTTP/1.1" 200 None 2026-03-27 21:34:35,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:34:35,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:34:35,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:34:35,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c454dc944faaf0e7f61b42 HTTP/1.1" 200 None 2026-03-27 21:34:35,623 - lava_callback - ERROR - Error processing callback for node 69c454dc944faaf0e7f61b42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59700 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:35:54,420 - lava_callback - INFO - Received callback for node 69c45535944faaf0e7f61b53 INFO: 172.20.0.1:60918 - "POST /node/69c45535944faaf0e7f61b53 HTTP/1.0" 202 Accepted 2026-03-27 21:35:54,425 - lava_callback - INFO - Starting async job submit for node 69c45535944faaf0e7f61b53 2026-03-27 21:35:54,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:35:54,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45535944faaf0e7f61b53 HTTP/1.1" 200 None 2026-03-27 21:35:54,452 - lava_callback - DEBUG - Processing node 69c45535944faaf0e7f61b53: baseline-arm64-clabbe 2026-03-27 21:35:54,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45535944faaf0e7f61b53 2026-03-27 21:35:54,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:35:54,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45535944faaf0e7f61b53 HTTP/1.1" 200 None 2026-03-27 21:35:54,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:35:54,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-03-27 21:35:54,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:35:54,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45535944faaf0e7f61b53 HTTP/1.1" 200 None 2026-03-27 21:35:54,512 - lava_callback - ERROR - Error processing callback for node 69c45535944faaf0e7f61b53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:37:15,700 - lava_callback - INFO - Received callback for node 69c45581944faaf0e7f61b6c INFO: 172.20.0.1:56028 - "POST /node/69c45581944faaf0e7f61b6c HTTP/1.0" 202 Accepted 2026-03-27 21:37:15,706 - lava_callback - INFO - Starting async job submit for node 69c45581944faaf0e7f61b6c 2026-03-27 21:37:15,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:37:15,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45581944faaf0e7f61b6c HTTP/1.1" 200 None 2026-03-27 21:37:15,722 - lava_callback - DEBUG - Processing node 69c45581944faaf0e7f61b6c: baseline-arm64-baylibre 2026-03-27 21:37:15,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45581944faaf0e7f61b6c 2026-03-27 21:37:15,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:37:15,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45581944faaf0e7f61b6c HTTP/1.1" 200 None 2026-03-27 21:37:15,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:37:15,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:37:15,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:37:15,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45581944faaf0e7f61b6c HTTP/1.1" 200 None 2026-03-27 21:37:15,784 - lava_callback - ERROR - Error processing callback for node 69c45581944faaf0e7f61b6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:38:54,538 - lava_callback - INFO - Received callback for node 69c455da944faaf0e7f61b81 INFO: 172.20.0.1:50742 - "POST /node/69c455da944faaf0e7f61b81 HTTP/1.0" 202 Accepted 2026-03-27 21:38:54,544 - lava_callback - INFO - Starting async job submit for node 69c455da944faaf0e7f61b81 2026-03-27 21:38:54,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:38:54,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c455da944faaf0e7f61b81 HTTP/1.1" 200 None 2026-03-27 21:38:54,568 - lava_callback - DEBUG - Processing node 69c455da944faaf0e7f61b81: baseline-arm64-clabbe 2026-03-27 21:38:54,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c455da944faaf0e7f61b81 2026-03-27 21:38:54,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:38:54,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c455da944faaf0e7f61b81 HTTP/1.1" 200 None 2026-03-27 21:38:54,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:38:54,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:38:54,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:38:54,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c455da944faaf0e7f61b81 HTTP/1.1" 200 None 2026-03-27 21:38:54,628 - lava_callback - ERROR - Error processing callback for node 69c455da944faaf0e7f61b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:39:55,881 - lava_callback - INFO - Received callback for node 69c45618944faaf0e7f61b8c INFO: 172.20.0.1:51148 - "POST /node/69c45618944faaf0e7f61b8c HTTP/1.0" 202 Accepted 2026-03-27 21:39:55,887 - lava_callback - INFO - Starting async job submit for node 69c45618944faaf0e7f61b8c 2026-03-27 21:39:55,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:39:55,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45618944faaf0e7f61b8c HTTP/1.1" 200 None 2026-03-27 21:39:55,913 - lava_callback - DEBUG - Processing node 69c45618944faaf0e7f61b8c: baseline-arm-baylibre 2026-03-27 21:39:55,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45618944faaf0e7f61b8c 2026-03-27 21:39:55,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:39:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45618944faaf0e7f61b8c HTTP/1.1" 200 None 2026-03-27 21:39:55,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:39:55,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:39:55,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:39:55,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45618944faaf0e7f61b8c HTTP/1.1" 200 None 2026-03-27 21:39:55,973 - lava_callback - ERROR - Error processing callback for node 69c45618944faaf0e7f61b8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51772 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:40:54,692 - lava_callback - INFO - Received callback for node 69c45653944faaf0e7f61ba1 INFO: 172.20.0.1:46168 - "POST /node/69c45653944faaf0e7f61ba1 HTTP/1.0" 202 Accepted 2026-03-27 21:40:54,697 - lava_callback - INFO - Starting async job submit for node 69c45653944faaf0e7f61ba1 2026-03-27 21:40:54,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:40:54,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45653944faaf0e7f61ba1 HTTP/1.1" 200 None 2026-03-27 21:40:54,717 - lava_callback - DEBUG - Processing node 69c45653944faaf0e7f61ba1: baseline-arm64-clabbe 2026-03-27 21:40:54,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45653944faaf0e7f61ba1 2026-03-27 21:40:54,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:40:54,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45653944faaf0e7f61ba1 HTTP/1.1" 200 None 2026-03-27 21:40:54,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:40:54,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:40:54,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:40:54,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45653944faaf0e7f61ba1 HTTP/1.1" 200 None 2026-03-27 21:40:54,801 - lava_callback - ERROR - Error processing callback for node 69c45653944faaf0e7f61ba1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:42:14,766 - lava_callback - INFO - Received callback for node 69c456a4944faaf0e7f61baf INFO: 172.20.0.1:59314 - "POST /node/69c456a4944faaf0e7f61baf HTTP/1.0" 202 Accepted 2026-03-27 21:42:14,772 - lava_callback - INFO - Starting async job submit for node 69c456a4944faaf0e7f61baf 2026-03-27 21:42:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:42:14,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c456a4944faaf0e7f61baf HTTP/1.1" 200 None 2026-03-27 21:42:14,793 - lava_callback - DEBUG - Processing node 69c456a4944faaf0e7f61baf: baseline-arm64-clabbe 2026-03-27 21:42:14,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c456a4944faaf0e7f61baf 2026-03-27 21:42:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:42:14,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c456a4944faaf0e7f61baf HTTP/1.1" 200 None 2026-03-27 21:42:14,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:42:14,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:42:14,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:42:14,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c456a4944faaf0e7f61baf HTTP/1.1" 200 None 2026-03-27 21:42:14,844 - lava_callback - ERROR - Error processing callback for node 69c456a4944faaf0e7f61baf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48186 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:43:16,111 - lava_callback - INFO - Received callback for node 69c456e1944faaf0e7f61bbd INFO: 172.20.0.1:48200 - "POST /node/69c456e1944faaf0e7f61bbd HTTP/1.0" 202 Accepted 2026-03-27 21:43:16,116 - lava_callback - INFO - Starting async job submit for node 69c456e1944faaf0e7f61bbd 2026-03-27 21:43:16,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:16,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c456e1944faaf0e7f61bbd HTTP/1.1" 200 None 2026-03-27 21:43:16,156 - lava_callback - DEBUG - Processing node 69c456e1944faaf0e7f61bbd: baseline-arm-baylibre 2026-03-27 21:43:16,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c456e1944faaf0e7f61bbd 2026-03-27 21:43:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:16,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c456e1944faaf0e7f61bbd HTTP/1.1" 200 None 2026-03-27 21:43:16,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:16,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:43:16,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:16,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c456e1944faaf0e7f61bbd HTTP/1.1" 200 None 2026-03-27 21:43:16,225 - lava_callback - ERROR - Error processing callback for node 69c456e1944faaf0e7f61bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:43:55,971 - lava_callback - INFO - Received callback for node 69c4570b944faaf0e7f61bc8 INFO: 172.20.0.1:56648 - "POST /node/69c4570b944faaf0e7f61bc8 HTTP/1.0" 202 Accepted 2026-03-27 21:43:55,977 - lava_callback - INFO - Starting async job submit for node 69c4570b944faaf0e7f61bc8 2026-03-27 21:43:55,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:55,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4570b944faaf0e7f61bc8 HTTP/1.1" 200 None 2026-03-27 21:43:55,993 - lava_callback - DEBUG - Processing node 69c4570b944faaf0e7f61bc8: baseline-arm-baylibre 2026-03-27 21:43:55,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4570b944faaf0e7f61bc8 2026-03-27 21:43:55,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:56,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4570b944faaf0e7f61bc8 HTTP/1.1" 200 None 2026-03-27 21:43:56,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:56,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:43:56,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:43:56,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4570b944faaf0e7f61bc8 HTTP/1.1" 200 None 2026-03-27 21:43:56,059 - lava_callback - ERROR - Error processing callback for node 69c4570b944faaf0e7f61bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40632 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:44:36,096 - lava_callback - INFO - Received callback for node 69c45731944faaf0e7f61bd5 INFO: 172.20.0.1:40644 - "POST /node/69c45731944faaf0e7f61bd5 HTTP/1.0" 202 Accepted 2026-03-27 21:44:36,101 - lava_callback - INFO - Starting async job submit for node 69c45731944faaf0e7f61bd5 2026-03-27 21:44:36,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:44:36,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45731944faaf0e7f61bd5 HTTP/1.1" 200 None 2026-03-27 21:44:36,128 - lava_callback - DEBUG - Processing node 69c45731944faaf0e7f61bd5: baseline-arm-baylibre 2026-03-27 21:44:36,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45731944faaf0e7f61bd5 2026-03-27 21:44:36,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:44:36,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45731944faaf0e7f61bd5 HTTP/1.1" 200 None 2026-03-27 21:44:36,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:44:36,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:44:36,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:44:36,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45731944faaf0e7f61bd5 HTTP/1.1" 200 None 2026-03-27 21:44:36,188 - lava_callback - ERROR - Error processing callback for node 69c45731944faaf0e7f61bd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49728 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:45:34,930 - lava_callback - INFO - Received callback for node 69c4576c944faaf0e7f61be6 INFO: 172.20.0.1:49738 - "POST /node/69c4576c944faaf0e7f61be6 HTTP/1.0" 202 Accepted 2026-03-27 21:45:34,936 - lava_callback - INFO - Starting async job submit for node 69c4576c944faaf0e7f61be6 2026-03-27 21:45:34,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:45:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4576c944faaf0e7f61be6 HTTP/1.1" 200 None 2026-03-27 21:45:34,958 - lava_callback - DEBUG - Processing node 69c4576c944faaf0e7f61be6: baseline-arm64-clabbe 2026-03-27 21:45:34,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4576c944faaf0e7f61be6 2026-03-27 21:45:34,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:45:34,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4576c944faaf0e7f61be6 HTTP/1.1" 200 None 2026-03-27 21:45:34,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:45:34,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:45:34,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:45:35,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4576c944faaf0e7f61be6 HTTP/1.1" 200 None 2026-03-27 21:45:35,014 - lava_callback - ERROR - Error processing callback for node 69c4576c944faaf0e7f61be6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:46:54,947 - lava_callback - INFO - Received callback for node 69c457be944faaf0e7f61bfa INFO: 172.20.0.1:45202 - "POST /node/69c457be944faaf0e7f61bfa HTTP/1.0" 202 Accepted 2026-03-27 21:46:54,952 - lava_callback - INFO - Starting async job submit for node 69c457be944faaf0e7f61bfa 2026-03-27 21:46:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:46:54,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c457be944faaf0e7f61bfa HTTP/1.1" 200 None 2026-03-27 21:46:54,970 - lava_callback - DEBUG - Processing node 69c457be944faaf0e7f61bfa: baseline-arm64-clabbe 2026-03-27 21:46:54,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c457be944faaf0e7f61bfa 2026-03-27 21:46:54,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:46:54,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c457be944faaf0e7f61bfa HTTP/1.1" 200 None 2026-03-27 21:46:54,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:46:54,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:46:55,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:46:55,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c457be944faaf0e7f61bfa HTTP/1.1" 200 None 2026-03-27 21:46:55,022 - lava_callback - ERROR - Error processing callback for node 69c457be944faaf0e7f61bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:47:56,253 - lava_callback - INFO - Received callback for node 69c457fd944faaf0e7f61c03 INFO: 172.20.0.1:50118 - "POST /node/69c457fd944faaf0e7f61c03 HTTP/1.0" 202 Accepted 2026-03-27 21:47:56,261 - lava_callback - INFO - Starting async job submit for node 69c457fd944faaf0e7f61c03 2026-03-27 21:47:56,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:47:56,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c457fd944faaf0e7f61c03 HTTP/1.1" 200 None 2026-03-27 21:47:56,280 - lava_callback - DEBUG - Processing node 69c457fd944faaf0e7f61c03: baseline-arm-baylibre 2026-03-27 21:47:56,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c457fd944faaf0e7f61c03 2026-03-27 21:47:56,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:47:56,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c457fd944faaf0e7f61c03 HTTP/1.1" 200 None 2026-03-27 21:47:56,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:47:56,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:47:56,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:47:56,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c457fd944faaf0e7f61c03 HTTP/1.1" 200 None 2026-03-27 21:47:56,354 - lava_callback - ERROR - Error processing callback for node 69c457fd944faaf0e7f61c03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44494 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:48:36,387 - lava_callback - INFO - Received callback for node 69c45825944faaf0e7f61c10 INFO: 172.20.0.1:44506 - "POST /node/69c45825944faaf0e7f61c10 HTTP/1.0" 202 Accepted 2026-03-27 21:48:36,392 - lava_callback - INFO - Starting async job submit for node 69c45825944faaf0e7f61c10 2026-03-27 21:48:36,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:48:36,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45825944faaf0e7f61c10 HTTP/1.1" 200 None 2026-03-27 21:48:36,413 - lava_callback - DEBUG - Processing node 69c45825944faaf0e7f61c10: baseline-arm-baylibre 2026-03-27 21:48:36,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45825944faaf0e7f61c10 2026-03-27 21:48:36,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:48:36,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45825944faaf0e7f61c10 HTTP/1.1" 200 None 2026-03-27 21:48:36,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:48:36,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:48:36,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:48:36,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45825944faaf0e7f61c10 HTTP/1.1" 200 None 2026-03-27 21:48:36,469 - lava_callback - ERROR - Error processing callback for node 69c45825944faaf0e7f61c10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44990 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:49:35,049 - lava_callback - INFO - Received callback for node 69c4585e944faaf0e7f61c21 INFO: 172.20.0.1:44996 - "POST /node/69c4585e944faaf0e7f61c21 HTTP/1.0" 202 Accepted 2026-03-27 21:49:35,055 - lava_callback - INFO - Starting async job submit for node 69c4585e944faaf0e7f61c21 2026-03-27 21:49:35,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:49:35,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4585e944faaf0e7f61c21 HTTP/1.1" 200 None 2026-03-27 21:49:35,094 - lava_callback - DEBUG - Processing node 69c4585e944faaf0e7f61c21: baseline-arm64-clabbe 2026-03-27 21:49:35,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4585e944faaf0e7f61c21 2026-03-27 21:49:35,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:49:35,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4585e944faaf0e7f61c21 HTTP/1.1" 200 None 2026-03-27 21:49:35,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:49:35,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:49:35,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:49:35,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4585e944faaf0e7f61c21 HTTP/1.1" 200 None 2026-03-27 21:49:35,151 - lava_callback - ERROR - Error processing callback for node 69c4585e944faaf0e7f61c21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42160 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:50:36,440 - lava_callback - INFO - Received callback for node 69c4589e944faaf0e7f61c2d INFO: 172.20.0.1:42166 - "POST /node/69c4589e944faaf0e7f61c2d HTTP/1.0" 202 Accepted 2026-03-27 21:50:36,446 - lava_callback - INFO - Starting async job submit for node 69c4589e944faaf0e7f61c2d 2026-03-27 21:50:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:50:36,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4589e944faaf0e7f61c2d HTTP/1.1" 200 None 2026-03-27 21:50:36,461 - lava_callback - DEBUG - Processing node 69c4589e944faaf0e7f61c2d: baseline-arm-baylibre 2026-03-27 21:50:36,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4589e944faaf0e7f61c2d 2026-03-27 21:50:36,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:50:36,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4589e944faaf0e7f61c2d HTTP/1.1" 200 None 2026-03-27 21:50:36,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:50:36,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:50:36,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42172 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:50:36,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4589e944faaf0e7f61c2d HTTP/1.1" 200 None 2026-03-27 21:50:36,536 - lava_callback - ERROR - Error processing callback for node 69c4589e944faaf0e7f61c2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38686 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:51:15,082 - lava_callback - INFO - Received callback for node 69c458c8944faaf0e7f61c3c INFO: 172.20.0.1:49010 - "POST /node/69c458c8944faaf0e7f61c3c HTTP/1.0" 202 Accepted 2026-03-27 21:51:15,088 - lava_callback - INFO - Starting async job submit for node 69c458c8944faaf0e7f61c3c 2026-03-27 21:51:15,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:51:15,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c458c8944faaf0e7f61c3c HTTP/1.1" 200 None 2026-03-27 21:51:15,115 - lava_callback - DEBUG - Processing node 69c458c8944faaf0e7f61c3c: baseline-arm-clabbe 2026-03-27 21:51:15,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c458c8944faaf0e7f61c3c 2026-03-27 21:51:15,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:51:15,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c458c8944faaf0e7f61c3c HTTP/1.1" 200 None 2026-03-27 21:51:15,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:51:15,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:51:15,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:49026 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:51:15,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c458c8944faaf0e7f61c3c HTTP/1.1" 200 None 2026-03-27 21:51:15,172 - lava_callback - ERROR - Error processing callback for node 69c458c8944faaf0e7f61c3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49164 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:52:35,183 - lava_callback - INFO - Received callback for node 69c45916944faaf0e7f61c4d INFO: 172.20.0.1:49174 - "POST /node/69c45916944faaf0e7f61c4d HTTP/1.0" 202 Accepted 2026-03-27 21:52:35,188 - lava_callback - INFO - Starting async job submit for node 69c45916944faaf0e7f61c4d 2026-03-27 21:52:35,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:52:35,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45916944faaf0e7f61c4d HTTP/1.1" 200 None 2026-03-27 21:52:35,203 - lava_callback - DEBUG - Processing node 69c45916944faaf0e7f61c4d: baseline-arm-clabbe 2026-03-27 21:52:35,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45916944faaf0e7f61c4d 2026-03-27 21:52:35,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:52:35,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45916944faaf0e7f61c4d HTTP/1.1" 200 None 2026-03-27 21:52:35,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:52:35,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:52:35,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:52:35,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45916944faaf0e7f61c4d HTTP/1.1" 200 None 2026-03-27 21:52:35,268 - lava_callback - ERROR - Error processing callback for node 69c45916944faaf0e7f61c4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:53:15,115 - lava_callback - INFO - Received callback for node 69c4593e944faaf0e7f61c5d INFO: 172.20.0.1:47658 - "POST /node/69c4593e944faaf0e7f61c5d HTTP/1.0" 202 Accepted 2026-03-27 21:53:15,120 - lava_callback - INFO - Starting async job submit for node 69c4593e944faaf0e7f61c5d 2026-03-27 21:53:15,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:15,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4593e944faaf0e7f61c5d HTTP/1.1" 200 None 2026-03-27 21:53:15,137 - lava_callback - DEBUG - Processing node 69c4593e944faaf0e7f61c5d: baseline-arm-clabbe 2026-03-27 21:53:15,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4593e944faaf0e7f61c5d 2026-03-27 21:53:15,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:15,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4593e944faaf0e7f61c5d HTTP/1.1" 200 None 2026-03-27 21:53:15,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:47662 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:53:15,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:53:15,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:15,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4593e944faaf0e7f61c5d HTTP/1.1" 200 None 2026-03-27 21:53:15,214 - lava_callback - ERROR - Error processing callback for node 69c4593e944faaf0e7f61c5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:53:55,184 - lava_callback - INFO - Received callback for node 69c45966944faaf0e7f61c64 INFO: 172.20.0.1:47042 - "POST /node/69c45966944faaf0e7f61c64 HTTP/1.0" 202 Accepted 2026-03-27 21:53:55,189 - lava_callback - INFO - Starting async job submit for node 69c45966944faaf0e7f61c64 2026-03-27 21:53:55,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:55,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45966944faaf0e7f61c64 HTTP/1.1" 200 None 2026-03-27 21:53:55,206 - lava_callback - DEBUG - Processing node 69c45966944faaf0e7f61c64: baseline-arm-clabbe 2026-03-27 21:53:55,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45966944faaf0e7f61c64 2026-03-27 21:53:55,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:55,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45966944faaf0e7f61c64 HTTP/1.1" 200 None 2026-03-27 21:53:55,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:53:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:53:55,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45966944faaf0e7f61c64 HTTP/1.1" 200 None 2026-03-27 21:53:55,261 - lava_callback - ERROR - Error processing callback for node 69c45966944faaf0e7f61c64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:54:35,173 - lava_callback - INFO - Received callback for node 69c4598d944faaf0e7f61c71 INFO: 172.20.0.1:40896 - "POST /node/69c4598d944faaf0e7f61c71 HTTP/1.0" 202 Accepted 2026-03-27 21:54:35,178 - lava_callback - INFO - Starting async job submit for node 69c4598d944faaf0e7f61c71 2026-03-27 21:54:35,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:54:35,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4598d944faaf0e7f61c71 HTTP/1.1" 200 None 2026-03-27 21:54:35,197 - lava_callback - DEBUG - Processing node 69c4598d944faaf0e7f61c71: baseline-arm-clabbe 2026-03-27 21:54:35,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4598d944faaf0e7f61c71 2026-03-27 21:54:35,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:54:35,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4598d944faaf0e7f61c71 HTTP/1.1" 200 None 2026-03-27 21:54:35,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:54:35,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:54:35,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:54:35,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4598d944faaf0e7f61c71 HTTP/1.1" 200 None 2026-03-27 21:54:35,258 - lava_callback - ERROR - Error processing callback for node 69c4598d944faaf0e7f61c71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41328 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:55:15,158 - lava_callback - INFO - Received callback for node 69c459b5944faaf0e7f61c80 INFO: 172.20.0.1:47050 - "POST /node/69c459b5944faaf0e7f61c80 HTTP/1.0" 202 Accepted 2026-03-27 21:55:15,163 - lava_callback - INFO - Starting async job submit for node 69c459b5944faaf0e7f61c80 INFO: 172.20.0.1:47054 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:55:15,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:15,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c459b5944faaf0e7f61c80 HTTP/1.1" 200 None 2026-03-27 21:55:15,180 - lava_callback - DEBUG - Processing node 69c459b5944faaf0e7f61c80: baseline-arm-clabbe 2026-03-27 21:55:15,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c459b5944faaf0e7f61c80 2026-03-27 21:55:15,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c459b5944faaf0e7f61c80 HTTP/1.1" 200 None 2026-03-27 21:55:15,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:15,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:55:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:15,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c459b5944faaf0e7f61c80 HTTP/1.1" 200 None 2026-03-27 21:55:15,240 - lava_callback - ERROR - Error processing callback for node 69c459b5944faaf0e7f61c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42804 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:55:55,182 - lava_callback - INFO - Received callback for node 69c459dd944faaf0e7f61c85 INFO: 172.20.0.1:56408 - "POST /node/69c459dd944faaf0e7f61c85 HTTP/1.0" 202 Accepted 2026-03-27 21:55:55,188 - lava_callback - INFO - Starting async job submit for node 69c459dd944faaf0e7f61c85 2026-03-27 21:55:55,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:55,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c459dd944faaf0e7f61c85 HTTP/1.1" 200 None 2026-03-27 21:55:55,204 - lava_callback - DEBUG - Processing node 69c459dd944faaf0e7f61c85: baseline-arm-clabbe 2026-03-27 21:55:55,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c459dd944faaf0e7f61c85 2026-03-27 21:55:55,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:55,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c459dd944faaf0e7f61c85 HTTP/1.1" 200 None 2026-03-27 21:55:55,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:55:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:55:55,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c459dd944faaf0e7f61c85 HTTP/1.1" 200 None 2026-03-27 21:55:55,258 - lava_callback - ERROR - Error processing callback for node 69c459dd944faaf0e7f61c85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52158 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:56:35,329 - lava_callback - INFO - Received callback for node 69c45a05944faaf0e7f61c92 INFO: 172.20.0.1:52164 - "POST /node/69c45a05944faaf0e7f61c92 HTTP/1.0" 202 Accepted 2026-03-27 21:56:35,334 - lava_callback - INFO - Starting async job submit for node 69c45a05944faaf0e7f61c92 2026-03-27 21:56:35,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:56:35,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a05944faaf0e7f61c92 HTTP/1.1" 200 None 2026-03-27 21:56:35,350 - lava_callback - DEBUG - Processing node 69c45a05944faaf0e7f61c92: baseline-arm-clabbe 2026-03-27 21:56:35,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45a05944faaf0e7f61c92 2026-03-27 21:56:35,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:56:35,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a05944faaf0e7f61c92 HTTP/1.1" 200 None 2026-03-27 21:56:35,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:56:35,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:56:35,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:56:35,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45a05944faaf0e7f61c92 HTTP/1.1" 200 None 2026-03-27 21:56:35,420 - lava_callback - ERROR - Error processing callback for node 69c45a05944faaf0e7f61c92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48860 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-27 21:57:15,284 - lava_callback - INFO - Received callback for node 69c45a2d944faaf0e7f61c9f INFO: 172.20.0.1:48864 - "POST /node/69c45a2d944faaf0e7f61c9f HTTP/1.0" 202 Accepted 2026-03-27 21:57:15,290 - lava_callback - INFO - Starting async job submit for node 69c45a2d944faaf0e7f61c9f 2026-03-27 21:57:15,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:15,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a2d944faaf0e7f61c9f HTTP/1.1" 200 None 2026-03-27 21:57:15,306 - lava_callback - DEBUG - Processing node 69c45a2d944faaf0e7f61c9f: baseline-arm-clabbe 2026-03-27 21:57:15,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45a2d944faaf0e7f61c9f 2026-03-27 21:57:15,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:15,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a2d944faaf0e7f61c9f HTTP/1.1" 200 None 2026-03-27 21:57:15,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:15,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:57:15,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:15,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45a2d944faaf0e7f61c9f HTTP/1.1" 200 None 2026-03-27 21:57:15,363 - lava_callback - ERROR - Error processing callback for node 69c45a2d944faaf0e7f61c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:57:55,295 - lava_callback - INFO - Received callback for node 69c45a55944faaf0e7f61ca9 INFO: 172.20.0.1:34048 - "POST /node/69c45a55944faaf0e7f61ca9 HTTP/1.0" 202 Accepted 2026-03-27 21:57:55,300 - lava_callback - INFO - Starting async job submit for node 69c45a55944faaf0e7f61ca9 2026-03-27 21:57:55,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:55,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a55944faaf0e7f61ca9 HTTP/1.1" 200 None 2026-03-27 21:57:55,316 - lava_callback - DEBUG - Processing node 69c45a55944faaf0e7f61ca9: baseline-arm-clabbe 2026-03-27 21:57:55,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45a55944faaf0e7f61ca9 2026-03-27 21:57:55,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a55944faaf0e7f61ca9 HTTP/1.1" 200 None 2026-03-27 21:57:55,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:55,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f72facdb2e26c83cca20 HTTP/1.1" 200 None 2026-03-27 21:57:55,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:57:55,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45a55944faaf0e7f61ca9 HTTP/1.1" 200 None 2026-03-27 21:57:55,394 - lava_callback - ERROR - Error processing callback for node 69c45a55944faaf0e7f61ca9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK 2026-03-27 21:58:36,897 - lava_callback - INFO - Received callback for node 69c45a81944faaf0e7f61cb4 INFO: 172.20.0.1:51150 - "POST /node/69c45a81944faaf0e7f61cb4 HTTP/1.0" 202 Accepted 2026-03-27 21:58:36,902 - lava_callback - INFO - Starting async job submit for node 69c45a81944faaf0e7f61cb4 2026-03-27 21:58:36,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:58:36,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a81944faaf0e7f61cb4 HTTP/1.1" 200 None 2026-03-27 21:58:36,922 - lava_callback - DEBUG - Processing node 69c45a81944faaf0e7f61cb4: baseline-arm64-baylibre 2026-03-27 21:58:36,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45a81944faaf0e7f61cb4 2026-03-27 21:58:36,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:58:36,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45a81944faaf0e7f61cb4 HTTP/1.1" 200 None 2026-03-27 21:58:36,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:58:36,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 21:58:36,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 21:58:36,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45a81944faaf0e7f61cb4 HTTP/1.1" 200 None 2026-03-27 21:58:36,977 - lava_callback - ERROR - Error processing callback for node 69c45a81944faaf0e7f61cb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:04:17,281 - lava_callback - INFO - Received callback for node 69c45bcb944faaf0e7f61ce6 INFO: 172.20.0.1:59614 - "POST /node/69c45bcb944faaf0e7f61ce6 HTTP/1.0" 202 Accepted 2026-03-27 22:04:17,287 - lava_callback - INFO - Starting async job submit for node 69c45bcb944faaf0e7f61ce6 2026-03-27 22:04:17,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:04:17,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45bcb944faaf0e7f61ce6 HTTP/1.1" 200 None 2026-03-27 22:04:17,302 - lava_callback - DEBUG - Processing node 69c45bcb944faaf0e7f61ce6: baseline-arm64-baylibre 2026-03-27 22:04:17,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45bcb944faaf0e7f61ce6 2026-03-27 22:04:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:04:17,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45bcb944faaf0e7f61ce6 HTTP/1.1" 200 None 2026-03-27 22:04:17,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:04:17,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:04:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:04:17,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45bcb944faaf0e7f61ce6 HTTP/1.1" 200 None 2026-03-27 22:04:17,382 - lava_callback - ERROR - Error processing callback for node 69c45bcb944faaf0e7f61ce6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:06:55,704 - lava_callback - INFO - Received callback for node 69c45c76944faaf0e7f61d00 INFO: 172.20.0.1:57730 - "POST /node/69c45c76944faaf0e7f61d00 HTTP/1.0" 202 Accepted 2026-03-27 22:06:55,709 - lava_callback - INFO - Starting async job submit for node 69c45c76944faaf0e7f61d00 2026-03-27 22:06:55,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:06:55,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45c76944faaf0e7f61d00 HTTP/1.1" 200 None 2026-03-27 22:06:55,751 - lava_callback - DEBUG - Processing node 69c45c76944faaf0e7f61d00: baseline-arm64-clabbe 2026-03-27 22:06:55,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45c76944faaf0e7f61d00 2026-03-27 22:06:55,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:06:55,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45c76944faaf0e7f61d00 HTTP/1.1" 200 None 2026-03-27 22:06:55,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:06:55,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:06:55,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:06:55,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45c76944faaf0e7f61d00 HTTP/1.1" 200 None 2026-03-27 22:06:55,993 - lava_callback - ERROR - Error processing callback for node 69c45c76944faaf0e7f61d00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:08:17,436 - lava_callback - INFO - Received callback for node 69c45cc0944faaf0e7f61d0a INFO: 172.20.0.1:35028 - "POST /node/69c45cc0944faaf0e7f61d0a HTTP/1.0" 202 Accepted 2026-03-27 22:08:17,442 - lava_callback - INFO - Starting async job submit for node 69c45cc0944faaf0e7f61d0a 2026-03-27 22:08:17,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:08:17,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45cc0944faaf0e7f61d0a HTTP/1.1" 200 None 2026-03-27 22:08:17,458 - lava_callback - DEBUG - Processing node 69c45cc0944faaf0e7f61d0a: baseline-arm64-baylibre 2026-03-27 22:08:17,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45cc0944faaf0e7f61d0a 2026-03-27 22:08:17,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:08:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45cc0944faaf0e7f61d0a HTTP/1.1" 200 None 2026-03-27 22:08:17,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:08:17,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:08:17,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:08:17,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45cc0944faaf0e7f61d0a HTTP/1.1" 200 None 2026-03-27 22:08:17,542 - lava_callback - ERROR - Error processing callback for node 69c45cc0944faaf0e7f61d0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45078 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:09:55,863 - lava_callback - INFO - Received callback for node 69c45d1f944faaf0e7f61d20 INFO: 172.20.0.1:35178 - "POST /node/69c45d1f944faaf0e7f61d20 HTTP/1.0" 202 Accepted 2026-03-27 22:09:55,869 - lava_callback - INFO - Starting async job submit for node 69c45d1f944faaf0e7f61d20 2026-03-27 22:09:55,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:09:55,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45d1f944faaf0e7f61d20 HTTP/1.1" 200 None 2026-03-27 22:09:55,885 - lava_callback - DEBUG - Processing node 69c45d1f944faaf0e7f61d20: baseline-arm64-clabbe 2026-03-27 22:09:55,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45d1f944faaf0e7f61d20 2026-03-27 22:09:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:09:55,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45d1f944faaf0e7f61d20 HTTP/1.1" 200 None 2026-03-27 22:09:55,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:09:55,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:09:55,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:09:55,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45d1f944faaf0e7f61d20 HTTP/1.1" 200 None 2026-03-27 22:09:55,964 - lava_callback - ERROR - Error processing callback for node 69c45d1f944faaf0e7f61d20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:12:35,987 - lava_callback - INFO - Received callback for node 69c45dc1944faaf0e7f61d35 INFO: 172.20.0.1:46072 - "POST /node/69c45dc1944faaf0e7f61d35 HTTP/1.0" 202 Accepted 2026-03-27 22:12:35,992 - lava_callback - INFO - Starting async job submit for node 69c45dc1944faaf0e7f61d35 2026-03-27 22:12:35,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:12:36,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45dc1944faaf0e7f61d35 HTTP/1.1" 200 None 2026-03-27 22:12:36,009 - lava_callback - DEBUG - Processing node 69c45dc1944faaf0e7f61d35: baseline-arm64-clabbe 2026-03-27 22:12:36,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45dc1944faaf0e7f61d35 2026-03-27 22:12:36,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:12:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45dc1944faaf0e7f61d35 HTTP/1.1" 200 None 2026-03-27 22:12:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:12:36,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:12:36,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:12:36,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45dc1944faaf0e7f61d35 HTTP/1.1" 200 None 2026-03-27 22:12:36,070 - lava_callback - ERROR - Error processing callback for node 69c45dc1944faaf0e7f61d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58576 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:13:55,958 - lava_callback - INFO - Received callback for node 69c45e14944faaf0e7f61d48 INFO: 172.20.0.1:35830 - "POST /node/69c45e14944faaf0e7f61d48 HTTP/1.0" 202 Accepted 2026-03-27 22:13:55,963 - lava_callback - INFO - Starting async job submit for node 69c45e14944faaf0e7f61d48 2026-03-27 22:13:55,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:13:55,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45e14944faaf0e7f61d48 HTTP/1.1" 200 None 2026-03-27 22:13:55,980 - lava_callback - DEBUG - Processing node 69c45e14944faaf0e7f61d48: baseline-arm64-clabbe 2026-03-27 22:13:55,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45e14944faaf0e7f61d48 2026-03-27 22:13:55,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:13:55,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45e14944faaf0e7f61d48 HTTP/1.1" 200 None 2026-03-27 22:13:56,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:13:56,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:13:56,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:13:56,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45e14944faaf0e7f61d48 HTTP/1.1" 200 None 2026-03-27 22:13:56,043 - lava_callback - ERROR - Error processing callback for node 69c45e14944faaf0e7f61d48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58232 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:14:57,774 - lava_callback - INFO - Received callback for node 69c45e5e944faaf0e7f61d4e INFO: 172.20.0.1:58240 - "POST /node/69c45e5e944faaf0e7f61d4e HTTP/1.0" 202 Accepted 2026-03-27 22:14:57,779 - lava_callback - INFO - Starting async job submit for node 69c45e5e944faaf0e7f61d4e 2026-03-27 22:14:57,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:14:57,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45e5e944faaf0e7f61d4e HTTP/1.1" 200 None 2026-03-27 22:14:57,796 - lava_callback - DEBUG - Processing node 69c45e5e944faaf0e7f61d4e: baseline-arm64-baylibre 2026-03-27 22:14:57,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45e5e944faaf0e7f61d4e 2026-03-27 22:14:57,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:14:57,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45e5e944faaf0e7f61d4e HTTP/1.1" 200 None 2026-03-27 22:14:57,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:14:57,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:14:57,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:14:57,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45e5e944faaf0e7f61d4e HTTP/1.1" 200 None 2026-03-27 22:14:57,888 - lava_callback - ERROR - Error processing callback for node 69c45e5e944faaf0e7f61d4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57846 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:16:36,121 - lava_callback - INFO - Received callback for node 69c45eb6944faaf0e7f61d5b INFO: 172.20.0.1:57852 - "POST /node/69c45eb6944faaf0e7f61d5b HTTP/1.0" 202 Accepted 2026-03-27 22:16:36,126 - lava_callback - INFO - Starting async job submit for node 69c45eb6944faaf0e7f61d5b 2026-03-27 22:16:36,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:16:36,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45eb6944faaf0e7f61d5b HTTP/1.1" 200 None 2026-03-27 22:16:36,169 - lava_callback - DEBUG - Processing node 69c45eb6944faaf0e7f61d5b: baseline-arm64-clabbe 2026-03-27 22:16:36,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45eb6944faaf0e7f61d5b 2026-03-27 22:16:36,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:16:36,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45eb6944faaf0e7f61d5b HTTP/1.1" 200 None 2026-03-27 22:16:36,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:16:36,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:16:36,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:16:36,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45eb6944faaf0e7f61d5b HTTP/1.1" 200 None 2026-03-27 22:16:36,239 - lava_callback - ERROR - Error processing callback for node 69c45eb6944faaf0e7f61d5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58304 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:17:57,957 - lava_callback - INFO - Received callback for node 69c45f01944faaf0e7f61d69 INFO: 172.20.0.1:58308 - "POST /node/69c45f01944faaf0e7f61d69 HTTP/1.0" 202 Accepted 2026-03-27 22:17:57,962 - lava_callback - INFO - Starting async job submit for node 69c45f01944faaf0e7f61d69 2026-03-27 22:17:57,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:17:57,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45f01944faaf0e7f61d69 HTTP/1.1" 200 None 2026-03-27 22:17:57,989 - lava_callback - DEBUG - Processing node 69c45f01944faaf0e7f61d69: baseline-arm64-baylibre 2026-03-27 22:17:57,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c45f01944faaf0e7f61d69 2026-03-27 22:17:57,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:17:58,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c45f01944faaf0e7f61d69 HTTP/1.1" 200 None 2026-03-27 22:17:58,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:17:58,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0f73bacdb2e26c83cca2f HTTP/1.1" 200 None 2026-03-27 22:17:58,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:17:58,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c45f01944faaf0e7f61d69 HTTP/1.1" 200 None 2026-03-27 22:17:58,046 - lava_callback - ERROR - Error processing callback for node 69c45f01944faaf0e7f61d69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:40:19,132 - lava_callback - INFO - Received callback for node 69c4643f944faaf0e7f61d84 INFO: 172.20.0.1:59184 - "POST /node/69c4643f944faaf0e7f61d84 HTTP/1.0" 202 Accepted 2026-03-27 22:40:19,138 - lava_callback - INFO - Starting async job submit for node 69c4643f944faaf0e7f61d84 2026-03-27 22:40:19,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:40:19,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4643f944faaf0e7f61d84 HTTP/1.1" 200 None 2026-03-27 22:40:19,173 - lava_callback - DEBUG - Processing node 69c4643f944faaf0e7f61d84: baseline-arm-baylibre 2026-03-27 22:40:19,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4643f944faaf0e7f61d84 2026-03-27 22:40:19,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:40:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4643f944faaf0e7f61d84 HTTP/1.1" 200 None 2026-03-27 22:40:19,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:40:19,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:40:19,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:40:19,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4643f944faaf0e7f61d84 HTTP/1.1" 200 None 2026-03-27 22:40:19,227 - lava_callback - ERROR - Error processing callback for node 69c4643f944faaf0e7f61d84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41556 - "GET /node/69809e7993b339382199d388%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41562 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:41:19,133 - lava_callback - INFO - Received callback for node 69c4647b944faaf0e7f61d91 INFO: 172.20.0.1:41574 - "POST /node/69c4647b944faaf0e7f61d91 HTTP/1.0" 202 Accepted 2026-03-27 22:41:19,138 - lava_callback - INFO - Starting async job submit for node 69c4647b944faaf0e7f61d91 2026-03-27 22:41:19,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:19,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4647b944faaf0e7f61d91 HTTP/1.1" 200 None 2026-03-27 22:41:19,155 - lava_callback - DEBUG - Processing node 69c4647b944faaf0e7f61d91: baseline-arm-baylibre 2026-03-27 22:41:19,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4647b944faaf0e7f61d91 2026-03-27 22:41:19,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4647b944faaf0e7f61d91 HTTP/1.1" 200 None 2026-03-27 22:41:19,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:19,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:41:19,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:19,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4647b944faaf0e7f61d91 HTTP/1.1" 200 None 2026-03-27 22:41:19,212 - lava_callback - ERROR - Error processing callback for node 69c4647b944faaf0e7f61d91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44722 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:41:59,194 - lava_callback - INFO - Received callback for node 69c464a2944faaf0e7f61d9f INFO: 172.20.0.1:44738 - "POST /node/69c464a2944faaf0e7f61d9f HTTP/1.0" 202 Accepted 2026-03-27 22:41:59,200 - lava_callback - INFO - Starting async job submit for node 69c464a2944faaf0e7f61d9f 2026-03-27 22:41:59,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:59,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464a2944faaf0e7f61d9f HTTP/1.1" 200 None 2026-03-27 22:41:59,218 - lava_callback - DEBUG - Processing node 69c464a2944faaf0e7f61d9f: baseline-arm-baylibre 2026-03-27 22:41:59,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c464a2944faaf0e7f61d9f 2026-03-27 22:41:59,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:59,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464a2944faaf0e7f61d9f HTTP/1.1" 200 None 2026-03-27 22:41:59,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:59,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:41:59,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:41:59,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c464a2944faaf0e7f61d9f HTTP/1.1" 200 None 2026-03-27 22:41:59,293 - lava_callback - ERROR - Error processing callback for node 69c464a2944faaf0e7f61d9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:42:39,203 - lava_callback - INFO - Received callback for node 69c464c9944faaf0e7f61dad INFO: 172.20.0.1:39210 - "POST /node/69c464c9944faaf0e7f61dad HTTP/1.0" 202 Accepted 2026-03-27 22:42:39,208 - lava_callback - INFO - Starting async job submit for node 69c464c9944faaf0e7f61dad 2026-03-27 22:42:39,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:39,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464c9944faaf0e7f61dad HTTP/1.1" 200 None 2026-03-27 22:42:39,224 - lava_callback - DEBUG - Processing node 69c464c9944faaf0e7f61dad: baseline-arm-baylibre 2026-03-27 22:42:39,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c464c9944faaf0e7f61dad 2026-03-27 22:42:39,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:39,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464c9944faaf0e7f61dad HTTP/1.1" 200 None 2026-03-27 22:42:39,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:39,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:42:39,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:39,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c464c9944faaf0e7f61dad HTTP/1.1" 200 None 2026-03-27 22:42:39,280 - lava_callback - ERROR - Error processing callback for node 69c464c9944faaf0e7f61dad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:42:59,196 - lava_callback - INFO - Received callback for node 69c464f0944faaf0e7f61dbd INFO: 172.20.0.1:38088 - "POST /node/69c464f0944faaf0e7f61dbd HTTP/1.0" 202 Accepted 2026-03-27 22:42:59,202 - lava_callback - INFO - Starting async job submit for node 69c464f0944faaf0e7f61dbd 2026-03-27 22:42:59,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:59,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464f0944faaf0e7f61dbd HTTP/1.1" 200 None 2026-03-27 22:42:59,219 - lava_callback - DEBUG - Processing node 69c464f0944faaf0e7f61dbd: baseline-arm-baylibre 2026-03-27 22:42:59,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c464f0944faaf0e7f61dbd 2026-03-27 22:42:59,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:59,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c464f0944faaf0e7f61dbd HTTP/1.1" 200 None 2026-03-27 22:42:59,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:59,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:42:59,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:42:59,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c464f0944faaf0e7f61dbd HTTP/1.1" 200 None 2026-03-27 22:42:59,282 - lava_callback - ERROR - Error processing callback for node 69c464f0944faaf0e7f61dbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET /node/6981b5e7f633e773758f9b2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38294 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:43:39,299 - lava_callback - INFO - Received callback for node 69c46517944faaf0e7f61dcd INFO: 172.20.0.1:38310 - "POST /node/69c46517944faaf0e7f61dcd HTTP/1.0" 202 Accepted 2026-03-27 22:43:39,305 - lava_callback - INFO - Starting async job submit for node 69c46517944faaf0e7f61dcd 2026-03-27 22:43:39,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:43:39,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46517944faaf0e7f61dcd HTTP/1.1" 200 None 2026-03-27 22:43:39,321 - lava_callback - DEBUG - Processing node 69c46517944faaf0e7f61dcd: baseline-arm-baylibre 2026-03-27 22:43:39,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46517944faaf0e7f61dcd 2026-03-27 22:43:39,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:43:39,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46517944faaf0e7f61dcd HTTP/1.1" 200 None 2026-03-27 22:43:39,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:43:39,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:43:39,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:43:39,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46517944faaf0e7f61dcd HTTP/1.1" 200 None 2026-03-27 22:43:39,386 - lava_callback - ERROR - Error processing callback for node 69c46517944faaf0e7f61dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:44:19,279 - lava_callback - INFO - Received callback for node 69c4653e944faaf0e7f61dfc INFO: 172.20.0.1:41638 - "POST /node/69c4653e944faaf0e7f61dfc HTTP/1.0" 202 Accepted 2026-03-27 22:44:19,287 - lava_callback - INFO - Starting async job submit for node 69c4653e944faaf0e7f61dfc 2026-03-27 22:44:19,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:19,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4653e944faaf0e7f61dfc HTTP/1.1" 200 None 2026-03-27 22:44:19,320 - lava_callback - DEBUG - Processing node 69c4653e944faaf0e7f61dfc: baseline-arm-baylibre 2026-03-27 22:44:19,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4653e944faaf0e7f61dfc 2026-03-27 22:44:19,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:19,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4653e944faaf0e7f61dfc HTTP/1.1" 200 None 2026-03-27 22:44:19,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:19,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:44:19,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:19,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4653e944faaf0e7f61dfc HTTP/1.1" 200 None 2026-03-27 22:44:19,421 - lava_callback - ERROR - Error processing callback for node 69c4653e944faaf0e7f61dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:44:59,354 - lava_callback - INFO - Received callback for node 69c46563944faaf0e7f61e1c INFO: 172.20.0.1:44834 - "POST /node/69c46563944faaf0e7f61e1c HTTP/1.0" 202 Accepted 2026-03-27 22:44:59,364 - lava_callback - INFO - Starting async job submit for node 69c46563944faaf0e7f61e1c 2026-03-27 22:44:59,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:59,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46563944faaf0e7f61e1c HTTP/1.1" 200 None 2026-03-27 22:44:59,388 - lava_callback - DEBUG - Processing node 69c46563944faaf0e7f61e1c: baseline-arm-baylibre 2026-03-27 22:44:59,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46563944faaf0e7f61e1c 2026-03-27 22:44:59,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:59,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46563944faaf0e7f61e1c HTTP/1.1" 200 None 2026-03-27 22:44:59,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:59,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:44:59,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:44:59,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46563944faaf0e7f61e1c HTTP/1.1" 200 None 2026-03-27 22:44:59,490 - lava_callback - ERROR - Error processing callback for node 69c46563944faaf0e7f61e1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47048 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:49:19,893 - lava_callback - INFO - Received callback for node 69c46666944faaf0e7f61ebe INFO: 172.20.0.1:56684 - "POST /node/69c46666944faaf0e7f61ebe HTTP/1.0" 202 Accepted 2026-03-27 22:49:19,899 - lava_callback - INFO - Starting async job submit for node 69c46666944faaf0e7f61ebe 2026-03-27 22:49:19,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:19,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46666944faaf0e7f61ebe HTTP/1.1" 200 None 2026-03-27 22:49:19,942 - lava_callback - DEBUG - Processing node 69c46666944faaf0e7f61ebe: baseline-arm-baylibre 2026-03-27 22:49:19,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46666944faaf0e7f61ebe 2026-03-27 22:49:19,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:19,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46666944faaf0e7f61ebe HTTP/1.1" 200 None 2026-03-27 22:49:19,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:19,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:49:19,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:19,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46666944faaf0e7f61ebe HTTP/1.1" 200 None 2026-03-27 22:49:19,993 - lava_callback - ERROR - Error processing callback for node 69c46666944faaf0e7f61ebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:49:59,635 - lava_callback - INFO - Received callback for node 69c4668b944faaf0e7f61ece INFO: 172.20.0.1:51844 - "POST /node/69c4668b944faaf0e7f61ece HTTP/1.0" 202 Accepted 2026-03-27 22:49:59,640 - lava_callback - INFO - Starting async job submit for node 69c4668b944faaf0e7f61ece 2026-03-27 22:49:59,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:59,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4668b944faaf0e7f61ece HTTP/1.1" 200 None 2026-03-27 22:49:59,663 - lava_callback - DEBUG - Processing node 69c4668b944faaf0e7f61ece: baseline-arm-baylibre 2026-03-27 22:49:59,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4668b944faaf0e7f61ece 2026-03-27 22:49:59,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:59,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4668b944faaf0e7f61ece HTTP/1.1" 200 None 2026-03-27 22:49:59,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:59,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:49:59,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:49:59,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4668b944faaf0e7f61ece HTTP/1.1" 200 None 2026-03-27 22:49:59,715 - lava_callback - ERROR - Error processing callback for node 69c4668b944faaf0e7f61ece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49820 - "GET /node/693f399924745582e399e563%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:51:57,701 - lava_callback - INFO - Received callback for node 69c466fa944faaf0e7f61efd INFO: 172.20.0.1:40224 - "POST /node/69c466fa944faaf0e7f61efd HTTP/1.0" 202 Accepted 2026-03-27 22:51:57,706 - lava_callback - INFO - Starting async job submit for node 69c466fa944faaf0e7f61efd 2026-03-27 22:51:57,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:51:57,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c466fa944faaf0e7f61efd HTTP/1.1" 200 None 2026-03-27 22:51:57,722 - lava_callback - DEBUG - Processing node 69c466fa944faaf0e7f61efd: baseline-arm-clabbe 2026-03-27 22:51:57,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c466fa944faaf0e7f61efd 2026-03-27 22:51:57,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:51:57,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c466fa944faaf0e7f61efd HTTP/1.1" 200 None 2026-03-27 22:51:57,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:51:57,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:51:57,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:51:57,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c466fa944faaf0e7f61efd HTTP/1.1" 200 None 2026-03-27 22:51:57,778 - lava_callback - ERROR - Error processing callback for node 69c466fa944faaf0e7f61efd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57660 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:52:37,575 - lava_callback - INFO - Received callback for node 69c4671f944faaf0e7f61f09 INFO: 172.20.0.1:57674 - "POST /node/69c4671f944faaf0e7f61f09 HTTP/1.0" 202 Accepted 2026-03-27 22:52:37,580 - lava_callback - INFO - Starting async job submit for node 69c4671f944faaf0e7f61f09 2026-03-27 22:52:37,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:37,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4671f944faaf0e7f61f09 HTTP/1.1" 200 None 2026-03-27 22:52:37,596 - lava_callback - DEBUG - Processing node 69c4671f944faaf0e7f61f09: baseline-arm-clabbe 2026-03-27 22:52:37,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4671f944faaf0e7f61f09 2026-03-27 22:52:37,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:37,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4671f944faaf0e7f61f09 HTTP/1.1" 200 None 2026-03-27 22:52:37,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:37,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:52:37,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:37,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4671f944faaf0e7f61f09 HTTP/1.1" 200 None 2026-03-27 22:52:37,653 - lava_callback - ERROR - Error processing callback for node 69c4671f944faaf0e7f61f09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55094 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:52:57,651 - lava_callback - INFO - Received callback for node 69c46744944faaf0e7f61f17 INFO: 172.20.0.1:55096 - "POST /node/69c46744944faaf0e7f61f17 HTTP/1.0" 202 Accepted 2026-03-27 22:52:57,658 - lava_callback - INFO - Starting async job submit for node 69c46744944faaf0e7f61f17 2026-03-27 22:52:57,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:57,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46744944faaf0e7f61f17 HTTP/1.1" 200 None 2026-03-27 22:52:57,673 - lava_callback - DEBUG - Processing node 69c46744944faaf0e7f61f17: baseline-arm-clabbe 2026-03-27 22:52:57,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46744944faaf0e7f61f17 2026-03-27 22:52:57,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:57,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46744944faaf0e7f61f17 HTTP/1.1" 200 None 2026-03-27 22:52:57,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:57,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:52:57,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:52:57,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46744944faaf0e7f61f17 HTTP/1.1" 200 None 2026-03-27 22:52:57,731 - lava_callback - ERROR - Error processing callback for node 69c46744944faaf0e7f61f17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET /node/69418bd6ecc59770562e726c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:53:37,650 - lava_callback - INFO - Received callback for node 69c46769944faaf0e7f61f25 INFO: 172.20.0.1:53936 - "POST /node/69c46769944faaf0e7f61f25 HTTP/1.0" 202 Accepted 2026-03-27 22:53:37,655 - lava_callback - INFO - Starting async job submit for node 69c46769944faaf0e7f61f25 2026-03-27 22:53:37,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:53:37,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46769944faaf0e7f61f25 HTTP/1.1" 200 None 2026-03-27 22:53:37,671 - lava_callback - DEBUG - Processing node 69c46769944faaf0e7f61f25: baseline-arm-clabbe 2026-03-27 22:53:37,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46769944faaf0e7f61f25 2026-03-27 22:53:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:53:37,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46769944faaf0e7f61f25 HTTP/1.1" 200 None 2026-03-27 22:53:37,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:53:37,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:53:37,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:53:37,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46769944faaf0e7f61f25 HTTP/1.1" 200 None 2026-03-27 22:53:37,727 - lava_callback - ERROR - Error processing callback for node 69c46769944faaf0e7f61f25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:54:17,673 - lava_callback - INFO - Received callback for node 69c4678d944faaf0e7f61f39 INFO: 172.20.0.1:52636 - "POST /node/69c4678d944faaf0e7f61f39 HTTP/1.0" 202 Accepted 2026-03-27 22:54:17,679 - lava_callback - INFO - Starting async job submit for node 69c4678d944faaf0e7f61f39 2026-03-27 22:54:17,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:54:17,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4678d944faaf0e7f61f39 HTTP/1.1" 200 None 2026-03-27 22:54:17,695 - lava_callback - DEBUG - Processing node 69c4678d944faaf0e7f61f39: baseline-arm-clabbe 2026-03-27 22:54:17,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4678d944faaf0e7f61f39 2026-03-27 22:54:17,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:54:17,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4678d944faaf0e7f61f39 HTTP/1.1" 200 None 2026-03-27 22:54:17,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:54:17,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-03-27 22:54:17,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:54:17,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4678d944faaf0e7f61f39 HTTP/1.1" 200 None 2026-03-27 22:54:17,747 - lava_callback - ERROR - Error processing callback for node 69c4678d944faaf0e7f61f39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46688 - "GET /node/698458533a8748f282084e11%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:54:59,981 - lava_callback - INFO - Received callback for node 69c467af944faaf0e7f61f41 INFO: 172.20.0.1:53268 - "POST /node/69c467af944faaf0e7f61f41 HTTP/1.0" 202 Accepted 2026-03-27 22:54:59,987 - lava_callback - INFO - Starting async job submit for node 69c467af944faaf0e7f61f41 2026-03-27 22:54:59,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:55:00,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c467af944faaf0e7f61f41 HTTP/1.1" 200 None 2026-03-27 22:55:00,003 - lava_callback - DEBUG - Processing node 69c467af944faaf0e7f61f41: baseline-arm-baylibre 2026-03-27 22:55:00,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c467af944faaf0e7f61f41 2026-03-27 22:55:00,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:55:00,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c467af944faaf0e7f61f41 HTTP/1.1" 200 None 2026-03-27 22:55:00,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:55:00,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:55:00,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:55:00,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c467af944faaf0e7f61f41 HTTP/1.1" 200 None 2026-03-27 22:55:00,087 - lava_callback - ERROR - Error processing callback for node 69c467af944faaf0e7f61f41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:58:18,087 - lava_callback - INFO - Received callback for node 69c46881944faaf0e7f61f78 INFO: 172.20.0.1:46712 - "POST /node/69c46881944faaf0e7f61f78 HTTP/1.0" 202 Accepted 2026-03-27 22:58:18,093 - lava_callback - INFO - Starting async job submit for node 69c46881944faaf0e7f61f78 2026-03-27 22:58:18,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:18,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46881944faaf0e7f61f78 HTTP/1.1" 200 None 2026-03-27 22:58:18,109 - lava_callback - DEBUG - Processing node 69c46881944faaf0e7f61f78: baseline-arm-clabbe 2026-03-27 22:58:18,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46881944faaf0e7f61f78 2026-03-27 22:58:18,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:18,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46881944faaf0e7f61f78 HTTP/1.1" 200 None 2026-03-27 22:58:18,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:18,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:58:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46881944faaf0e7f61f78 HTTP/1.1" 200 None 2026-03-27 22:58:18,159 - lava_callback - ERROR - Error processing callback for node 69c46881944faaf0e7f61f78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44874 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:58:57,859 - lava_callback - INFO - Received callback for node 69c468a7944faaf0e7f61f85 INFO: 172.20.0.1:44878 - "POST /node/69c468a7944faaf0e7f61f85 HTTP/1.0" 202 Accepted 2026-03-27 22:58:57,865 - lava_callback - INFO - Starting async job submit for node 69c468a7944faaf0e7f61f85 2026-03-27 22:58:57,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:57,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c468a7944faaf0e7f61f85 HTTP/1.1" 200 None 2026-03-27 22:58:57,881 - lava_callback - DEBUG - Processing node 69c468a7944faaf0e7f61f85: baseline-arm-clabbe 2026-03-27 22:58:57,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c468a7944faaf0e7f61f85 2026-03-27 22:58:57,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:57,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c468a7944faaf0e7f61f85 HTTP/1.1" 200 None 2026-03-27 22:58:57,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:57,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:58:57,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:58:57,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c468a7944faaf0e7f61f85 HTTP/1.1" 200 None 2026-03-27 22:58:57,931 - lava_callback - ERROR - Error processing callback for node 69c468a7944faaf0e7f61f85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK 2026-03-27 22:59:37,934 - lava_callback - INFO - Received callback for node 69c468cc944faaf0e7f61f95 INFO: 172.20.0.1:48480 - "POST /node/69c468cc944faaf0e7f61f95 HTTP/1.0" 202 Accepted 2026-03-27 22:59:37,940 - lava_callback - INFO - Starting async job submit for node 69c468cc944faaf0e7f61f95 2026-03-27 22:59:37,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:59:37,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c468cc944faaf0e7f61f95 HTTP/1.1" 200 None 2026-03-27 22:59:37,986 - lava_callback - DEBUG - Processing node 69c468cc944faaf0e7f61f95: baseline-arm-clabbe 2026-03-27 22:59:37,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c468cc944faaf0e7f61f95 2026-03-27 22:59:37,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:59:38,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c468cc944faaf0e7f61f95 HTTP/1.1" 200 None 2026-03-27 22:59:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:59:38,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 22:59:38,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 22:59:38,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c468cc944faaf0e7f61f95 HTTP/1.1" 200 None 2026-03-27 22:59:38,045 - lava_callback - ERROR - Error processing callback for node 69c468cc944faaf0e7f61f95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47496 - "GET /node/698a0e4f22b4cc0f227ad842%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41038 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:07:18,222 - lava_callback - INFO - Received callback for node 69c46a92944faaf0e7f61fe6 INFO: 172.20.0.1:41048 - "POST /node/69c46a92944faaf0e7f61fe6 HTTP/1.0" 202 Accepted 2026-03-27 23:07:18,228 - lava_callback - INFO - Starting async job submit for node 69c46a92944faaf0e7f61fe6 2026-03-27 23:07:18,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:18,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46a92944faaf0e7f61fe6 HTTP/1.1" 200 None 2026-03-27 23:07:18,244 - lava_callback - DEBUG - Processing node 69c46a92944faaf0e7f61fe6: baseline-arm-clabbe 2026-03-27 23:07:18,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46a92944faaf0e7f61fe6 2026-03-27 23:07:18,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:18,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46a92944faaf0e7f61fe6 HTTP/1.1" 200 None 2026-03-27 23:07:18,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:18,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:07:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:18,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46a92944faaf0e7f61fe6 HTTP/1.1" 200 None 2026-03-27 23:07:18,304 - lava_callback - ERROR - Error processing callback for node 69c46a92944faaf0e7f61fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33786 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:07:38,208 - lava_callback - INFO - Received callback for node 69c46ab7944faaf0e7f62000 INFO: 172.20.0.1:33790 - "POST /node/69c46ab7944faaf0e7f62000 HTTP/1.0" 202 Accepted 2026-03-27 23:07:38,213 - lava_callback - INFO - Starting async job submit for node 69c46ab7944faaf0e7f62000 2026-03-27 23:07:38,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:38,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ab7944faaf0e7f62000 HTTP/1.1" 200 None 2026-03-27 23:07:38,229 - lava_callback - DEBUG - Processing node 69c46ab7944faaf0e7f62000: baseline-arm-clabbe 2026-03-27 23:07:38,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46ab7944faaf0e7f62000 2026-03-27 23:07:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:38,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ab7944faaf0e7f62000 HTTP/1.1" 200 None 2026-03-27 23:07:38,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:38,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:07:38,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:07:38,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46ab7944faaf0e7f62000 HTTP/1.1" 200 None 2026-03-27 23:07:38,289 - lava_callback - ERROR - Error processing callback for node 69c46ab7944faaf0e7f62000: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:11:20,938 - lava_callback - INFO - Received callback for node 69c46b87944faaf0e7f6201f INFO: 172.20.0.1:56932 - "POST /node/69c46b87944faaf0e7f6201f HTTP/1.0" 202 Accepted 2026-03-27 23:11:20,944 - lava_callback - INFO - Starting async job submit for node 69c46b87944faaf0e7f6201f 2026-03-27 23:11:20,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:11:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46b87944faaf0e7f6201f HTTP/1.1" 200 None 2026-03-27 23:11:20,959 - lava_callback - DEBUG - Processing node 69c46b87944faaf0e7f6201f: baseline-arm64-baylibre 2026-03-27 23:11:20,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46b87944faaf0e7f6201f 2026-03-27 23:11:20,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:11:20,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46b87944faaf0e7f6201f HTTP/1.1" 200 None 2026-03-27 23:11:20,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:11:20,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:11:20,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:11:21,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46b87944faaf0e7f6201f HTTP/1.1" 200 None 2026-03-27 23:11:21,031 - lava_callback - ERROR - Error processing callback for node 69c46b87944faaf0e7f6201f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48602 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:12:40,894 - lava_callback - INFO - Received callback for node 69c46bdd944faaf0e7f62025 INFO: 172.20.0.1:36080 - "POST /node/69c46bdd944faaf0e7f62025 HTTP/1.0" 202 Accepted 2026-03-27 23:12:40,900 - lava_callback - INFO - Starting async job submit for node 69c46bdd944faaf0e7f62025 2026-03-27 23:12:40,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:12:40,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46bdd944faaf0e7f62025 HTTP/1.1" 200 None 2026-03-27 23:12:40,925 - lava_callback - DEBUG - Processing node 69c46bdd944faaf0e7f62025: baseline-arm64-baylibre 2026-03-27 23:12:40,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46bdd944faaf0e7f62025 2026-03-27 23:12:40,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:12:40,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46bdd944faaf0e7f62025 HTTP/1.1" 200 None 2026-03-27 23:12:40,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:12:40,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:12:40,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:12:40,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46bdd944faaf0e7f62025 HTTP/1.1" 200 None 2026-03-27 23:12:40,977 - lava_callback - ERROR - Error processing callback for node 69c46bdd944faaf0e7f62025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:14:01,004 - lava_callback - INFO - Received callback for node 69c46c32944faaf0e7f62030 INFO: 172.20.0.1:34314 - "POST /node/69c46c32944faaf0e7f62030 HTTP/1.0" 202 Accepted 2026-03-27 23:14:01,010 - lava_callback - INFO - Starting async job submit for node 69c46c32944faaf0e7f62030 2026-03-27 23:14:01,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:14:01,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46c32944faaf0e7f62030 HTTP/1.1" 200 None 2026-03-27 23:14:01,027 - lava_callback - DEBUG - Processing node 69c46c32944faaf0e7f62030: baseline-arm64-baylibre 2026-03-27 23:14:01,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46c32944faaf0e7f62030 2026-03-27 23:14:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:14:01,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46c32944faaf0e7f62030 HTTP/1.1" 200 None 2026-03-27 23:14:01,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:14:01,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:14:01,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:14:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46c32944faaf0e7f62030 HTTP/1.1" 200 None 2026-03-27 23:14:01,099 - lava_callback - ERROR - Error processing callback for node 69c46c32944faaf0e7f62030: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42144 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:15:41,047 - lava_callback - INFO - Received callback for node 69c46c87944faaf0e7f6203b INFO: 172.20.0.1:60580 - "POST /node/69c46c87944faaf0e7f6203b HTTP/1.0" 202 Accepted 2026-03-27 23:15:41,052 - lava_callback - INFO - Starting async job submit for node 69c46c87944faaf0e7f6203b 2026-03-27 23:15:41,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:15:41,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46c87944faaf0e7f6203b HTTP/1.1" 200 None 2026-03-27 23:15:41,068 - lava_callback - DEBUG - Processing node 69c46c87944faaf0e7f6203b: baseline-arm64-baylibre 2026-03-27 23:15:41,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46c87944faaf0e7f6203b 2026-03-27 23:15:41,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:15:41,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46c87944faaf0e7f6203b HTTP/1.1" 200 None 2026-03-27 23:15:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:15:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:15:41,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:15:41,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46c87944faaf0e7f6203b HTTP/1.1" 200 None 2026-03-27 23:15:41,121 - lava_callback - ERROR - Error processing callback for node 69c46c87944faaf0e7f6203b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37308 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:17:58,652 - lava_callback - INFO - Received callback for node 69c46d21944faaf0e7f62057 INFO: 172.20.0.1:37324 - "POST /node/69c46d21944faaf0e7f62057 HTTP/1.0" 202 Accepted 2026-03-27 23:17:58,658 - lava_callback - INFO - Starting async job submit for node 69c46d21944faaf0e7f62057 2026-03-27 23:17:58,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:17:58,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46d21944faaf0e7f62057 HTTP/1.1" 200 None 2026-03-27 23:17:58,674 - lava_callback - DEBUG - Processing node 69c46d21944faaf0e7f62057: baseline-arm-clabbe 2026-03-27 23:17:58,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46d21944faaf0e7f62057 2026-03-27 23:17:58,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:17:58,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46d21944faaf0e7f62057 HTTP/1.1" 200 None 2026-03-27 23:17:58,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:17:58,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:17:58,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:17:58,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46d21944faaf0e7f62057 HTTP/1.1" 200 None 2026-03-27 23:17:58,731 - lava_callback - ERROR - Error processing callback for node 69c46d21944faaf0e7f62057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46914 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:21:38,830 - lava_callback - INFO - Received callback for node 69c46df8944faaf0e7f6208a INFO: 172.20.0.1:46924 - "POST /node/69c46df8944faaf0e7f6208a HTTP/1.0" 202 Accepted 2026-03-27 23:21:38,836 - lava_callback - INFO - Starting async job submit for node 69c46df8944faaf0e7f6208a 2026-03-27 23:21:38,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:21:38,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46df8944faaf0e7f6208a HTTP/1.1" 200 None 2026-03-27 23:21:38,852 - lava_callback - DEBUG - Processing node 69c46df8944faaf0e7f6208a: baseline-arm64-clabbe 2026-03-27 23:21:38,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46df8944faaf0e7f6208a 2026-03-27 23:21:38,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:21:38,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46df8944faaf0e7f6208a HTTP/1.1" 200 None 2026-03-27 23:21:38,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:21:38,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:21:38,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:21:38,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46df8944faaf0e7f6208a HTTP/1.1" 200 None 2026-03-27 23:21:38,907 - lava_callback - ERROR - Error processing callback for node 69c46df8944faaf0e7f6208a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:22:58,905 - lava_callback - INFO - Received callback for node 69c46e4a944faaf0e7f6209d INFO: 172.20.0.1:57696 - "POST /node/69c46e4a944faaf0e7f6209d HTTP/1.0" 202 Accepted 2026-03-27 23:22:58,911 - lava_callback - INFO - Starting async job submit for node 69c46e4a944faaf0e7f6209d 2026-03-27 23:22:58,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:22:58,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46e4a944faaf0e7f6209d HTTP/1.1" 200 None 2026-03-27 23:22:58,927 - lava_callback - DEBUG - Processing node 69c46e4a944faaf0e7f6209d: baseline-arm64-clabbe 2026-03-27 23:22:58,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46e4a944faaf0e7f6209d 2026-03-27 23:22:58,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:22:58,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46e4a944faaf0e7f6209d HTTP/1.1" 200 None 2026-03-27 23:22:58,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:22:58,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:22:58,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:22:58,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46e4a944faaf0e7f6209d HTTP/1.1" 200 None 2026-03-27 23:22:58,995 - lava_callback - ERROR - Error processing callback for node 69c46e4a944faaf0e7f6209d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59450 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:24:18,940 - lava_callback - INFO - Received callback for node 69c46e9e944faaf0e7f620af INFO: 172.20.0.1:59462 - "POST /node/69c46e9e944faaf0e7f620af HTTP/1.0" 202 Accepted 2026-03-27 23:24:18,946 - lava_callback - INFO - Starting async job submit for node 69c46e9e944faaf0e7f620af 2026-03-27 23:24:18,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:24:18,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46e9e944faaf0e7f620af HTTP/1.1" 200 None 2026-03-27 23:24:18,966 - lava_callback - DEBUG - Processing node 69c46e9e944faaf0e7f620af: baseline-arm64-clabbe 2026-03-27 23:24:18,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46e9e944faaf0e7f620af 2026-03-27 23:24:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:24:18,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46e9e944faaf0e7f620af HTTP/1.1" 200 None 2026-03-27 23:24:18,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:24:18,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:24:18,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:24:19,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46e9e944faaf0e7f620af HTTP/1.1" 200 None 2026-03-27 23:24:19,018 - lava_callback - ERROR - Error processing callback for node 69c46e9e944faaf0e7f620af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:25:38,992 - lava_callback - INFO - Received callback for node 69c46ef0944faaf0e7f620c1 INFO: 172.20.0.1:38958 - "POST /node/69c46ef0944faaf0e7f620c1 HTTP/1.0" 202 Accepted 2026-03-27 23:25:38,997 - lava_callback - INFO - Starting async job submit for node 69c46ef0944faaf0e7f620c1 2026-03-27 23:25:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:25:39,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ef0944faaf0e7f620c1 HTTP/1.1" 200 None 2026-03-27 23:25:39,012 - lava_callback - DEBUG - Processing node 69c46ef0944faaf0e7f620c1: baseline-arm64-clabbe 2026-03-27 23:25:39,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46ef0944faaf0e7f620c1 2026-03-27 23:25:39,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:25:39,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ef0944faaf0e7f620c1 HTTP/1.1" 200 None 2026-03-27 23:25:39,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:25:39,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:25:39,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:25:39,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46ef0944faaf0e7f620c1 HTTP/1.1" 200 None 2026-03-27 23:25:39,080 - lava_callback - ERROR - Error processing callback for node 69c46ef0944faaf0e7f620c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:27:19,062 - lava_callback - INFO - Received callback for node 69c46f41944faaf0e7f620ce INFO: 172.20.0.1:59998 - "POST /node/69c46f41944faaf0e7f620ce HTTP/1.0" 202 Accepted 2026-03-27 23:27:19,067 - lava_callback - INFO - Starting async job submit for node 69c46f41944faaf0e7f620ce 2026-03-27 23:27:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:27:19,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46f41944faaf0e7f620ce HTTP/1.1" 200 None 2026-03-27 23:27:19,085 - lava_callback - DEBUG - Processing node 69c46f41944faaf0e7f620ce: baseline-arm64-clabbe 2026-03-27 23:27:19,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46f41944faaf0e7f620ce 2026-03-27 23:27:19,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:27:19,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46f41944faaf0e7f620ce HTTP/1.1" 200 None 2026-03-27 23:27:19,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:27:19,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:27:19,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:27:19,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46f41944faaf0e7f620ce HTTP/1.1" 200 None 2026-03-27 23:27:19,141 - lava_callback - ERROR - Error processing callback for node 69c46f41944faaf0e7f620ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:28:39,109 - lava_callback - INFO - Received callback for node 69c46f96944faaf0e7f620e6 INFO: 172.20.0.1:44368 - "POST /node/69c46f96944faaf0e7f620e6 HTTP/1.0" 202 Accepted 2026-03-27 23:28:39,115 - lava_callback - INFO - Starting async job submit for node 69c46f96944faaf0e7f620e6 2026-03-27 23:28:39,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:28:39,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46f96944faaf0e7f620e6 HTTP/1.1" 200 None 2026-03-27 23:28:39,130 - lava_callback - DEBUG - Processing node 69c46f96944faaf0e7f620e6: baseline-arm64-clabbe 2026-03-27 23:28:39,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46f96944faaf0e7f620e6 2026-03-27 23:28:39,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:28:39,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46f96944faaf0e7f620e6 HTTP/1.1" 200 None 2026-03-27 23:28:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:28:39,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-03-27 23:28:39,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:28:39,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46f96944faaf0e7f620e6 HTTP/1.1" 200 None 2026-03-27 23:28:39,197 - lava_callback - ERROR - Error processing callback for node 69c46f96944faaf0e7f620e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54148 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:29:39,140 - lava_callback - INFO - Received callback for node 69c46fd9944faaf0e7f620f1 INFO: 172.20.0.1:54150 - "POST /node/69c46fd9944faaf0e7f620f1 HTTP/1.0" 202 Accepted 2026-03-27 23:29:39,146 - lava_callback - INFO - Starting async job submit for node 69c46fd9944faaf0e7f620f1 2026-03-27 23:29:39,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:29:39,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46fd9944faaf0e7f620f1 HTTP/1.1" 200 None 2026-03-27 23:29:39,176 - lava_callback - DEBUG - Processing node 69c46fd9944faaf0e7f620f1: baseline-arm-clabbe 2026-03-27 23:29:39,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46fd9944faaf0e7f620f1 2026-03-27 23:29:39,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:29:39,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46fd9944faaf0e7f620f1 HTTP/1.1" 200 None 2026-03-27 23:29:39,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:29:39,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:29:39,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:29:39,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46fd9944faaf0e7f620f1 HTTP/1.1" 200 None 2026-03-27 23:29:39,414 - lava_callback - ERROR - Error processing callback for node 69c46fd9944faaf0e7f620f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:30:19,149 - lava_callback - INFO - Received callback for node 69c46ffd944faaf0e7f6210b INFO: 172.20.0.1:60302 - "POST /node/69c46ffd944faaf0e7f6210b HTTP/1.0" 202 Accepted 2026-03-27 23:30:19,154 - lava_callback - INFO - Starting async job submit for node 69c46ffd944faaf0e7f6210b 2026-03-27 23:30:19,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:19,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ffd944faaf0e7f6210b HTTP/1.1" 200 None 2026-03-27 23:30:19,189 - lava_callback - DEBUG - Processing node 69c46ffd944faaf0e7f6210b: baseline-arm-clabbe 2026-03-27 23:30:19,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c46ffd944faaf0e7f6210b 2026-03-27 23:30:19,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:19,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c46ffd944faaf0e7f6210b HTTP/1.1" 200 None 2026-03-27 23:30:19,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:19,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:30:19,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:19,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c46ffd944faaf0e7f6210b HTTP/1.1" 200 None 2026-03-27 23:30:19,262 - lava_callback - ERROR - Error processing callback for node 69c46ffd944faaf0e7f6210b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:30:59,265 - lava_callback - INFO - Received callback for node 69c47022944faaf0e7f62112 INFO: 172.20.0.1:57218 - "POST /node/69c47022944faaf0e7f62112 HTTP/1.0" 202 Accepted 2026-03-27 23:30:59,270 - lava_callback - INFO - Starting async job submit for node 69c47022944faaf0e7f62112 2026-03-27 23:30:59,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:59,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47022944faaf0e7f62112 HTTP/1.1" 200 None 2026-03-27 23:30:59,286 - lava_callback - DEBUG - Processing node 69c47022944faaf0e7f62112: baseline-arm-clabbe 2026-03-27 23:30:59,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47022944faaf0e7f62112 2026-03-27 23:30:59,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:59,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47022944faaf0e7f62112 HTTP/1.1" 200 None 2026-03-27 23:30:59,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:59,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:30:59,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:30:59,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47022944faaf0e7f62112 HTTP/1.1" 200 None 2026-03-27 23:30:59,338 - lava_callback - ERROR - Error processing callback for node 69c47022944faaf0e7f62112: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39326 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:31:39,221 - lava_callback - INFO - Received callback for node 69c47047944faaf0e7f62125 INFO: 172.20.0.1:39338 - "POST /node/69c47047944faaf0e7f62125 HTTP/1.0" 202 Accepted 2026-03-27 23:31:39,226 - lava_callback - INFO - Starting async job submit for node 69c47047944faaf0e7f62125 2026-03-27 23:31:39,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:31:39,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47047944faaf0e7f62125 HTTP/1.1" 200 None 2026-03-27 23:31:39,243 - lava_callback - DEBUG - Processing node 69c47047944faaf0e7f62125: baseline-arm-clabbe 2026-03-27 23:31:39,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47047944faaf0e7f62125 2026-03-27 23:31:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:31:39,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47047944faaf0e7f62125 HTTP/1.1" 200 None 2026-03-27 23:31:39,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:31:39,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-27 23:31:39,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:31:39,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47047944faaf0e7f62125 HTTP/1.1" 200 None 2026-03-27 23:31:39,298 - lava_callback - ERROR - Error processing callback for node 69c47047944faaf0e7f62125: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:32:22,281 - lava_callback - INFO - Received callback for node 69c47071944faaf0e7f62135 INFO: 172.20.0.1:36636 - "POST /node/69c47071944faaf0e7f62135 HTTP/1.0" 202 Accepted 2026-03-27 23:32:22,286 - lava_callback - INFO - Starting async job submit for node 69c47071944faaf0e7f62135 2026-03-27 23:32:22,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:32:22,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47071944faaf0e7f62135 HTTP/1.1" 200 None 2026-03-27 23:32:22,329 - lava_callback - DEBUG - Processing node 69c47071944faaf0e7f62135: baseline-arm64-baylibre 2026-03-27 23:32:22,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47071944faaf0e7f62135 2026-03-27 23:32:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:32:22,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47071944faaf0e7f62135 HTTP/1.1" 200 None 2026-03-27 23:32:22,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:32:22,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:32:22,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:32:22,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47071944faaf0e7f62135 HTTP/1.1" 200 None 2026-03-27 23:32:22,448 - lava_callback - ERROR - Error processing callback for node 69c47071944faaf0e7f62135: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:33:42,121 - lava_callback - INFO - Received callback for node 69c470c3944faaf0e7f62141 INFO: 172.20.0.1:56600 - "POST /node/69c470c3944faaf0e7f62141 HTTP/1.0" 202 Accepted 2026-03-27 23:33:42,128 - lava_callback - INFO - Starting async job submit for node 69c470c3944faaf0e7f62141 2026-03-27 23:33:42,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:33:42,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c470c3944faaf0e7f62141 HTTP/1.1" 200 None 2026-03-27 23:33:42,144 - lava_callback - DEBUG - Processing node 69c470c3944faaf0e7f62141: baseline-arm64-baylibre 2026-03-27 23:33:42,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c470c3944faaf0e7f62141 2026-03-27 23:33:42,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:33:42,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c470c3944faaf0e7f62141 HTTP/1.1" 200 None 2026-03-27 23:33:42,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:33:42,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:33:42,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:33:42,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c470c3944faaf0e7f62141 HTTP/1.1" 200 None 2026-03-27 23:33:42,220 - lava_callback - ERROR - Error processing callback for node 69c470c3944faaf0e7f62141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46944 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:36:22,206 - lava_callback - INFO - Received callback for node 69c47168944faaf0e7f62163 INFO: 172.20.0.1:40270 - "POST /node/69c47168944faaf0e7f62163 HTTP/1.0" 202 Accepted 2026-03-27 23:36:22,212 - lava_callback - INFO - Starting async job submit for node 69c47168944faaf0e7f62163 2026-03-27 23:36:22,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:36:22,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47168944faaf0e7f62163 HTTP/1.1" 200 None 2026-03-27 23:36:22,228 - lava_callback - DEBUG - Processing node 69c47168944faaf0e7f62163: baseline-arm64-baylibre 2026-03-27 23:36:22,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47168944faaf0e7f62163 2026-03-27 23:36:22,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:36:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47168944faaf0e7f62163 HTTP/1.1" 200 None 2026-03-27 23:36:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:36:22,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:36:22,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:36:22,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47168944faaf0e7f62163 HTTP/1.1" 200 None 2026-03-27 23:36:22,288 - lava_callback - ERROR - Error processing callback for node 69c47168944faaf0e7f62163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:39:02,332 - lava_callback - INFO - Received callback for node 69c4720b944faaf0e7f62186 INFO: 172.20.0.1:52452 - "POST /node/69c4720b944faaf0e7f62186 HTTP/1.0" 202 Accepted 2026-03-27 23:39:02,338 - lava_callback - INFO - Starting async job submit for node 69c4720b944faaf0e7f62186 2026-03-27 23:39:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:39:02,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4720b944faaf0e7f62186 HTTP/1.1" 200 None 2026-03-27 23:39:02,360 - lava_callback - DEBUG - Processing node 69c4720b944faaf0e7f62186: baseline-arm64-baylibre 2026-03-27 23:39:02,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4720b944faaf0e7f62186 2026-03-27 23:39:02,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:39:02,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4720b944faaf0e7f62186 HTTP/1.1" 200 None 2026-03-27 23:39:02,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:39:02,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:39:02,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:39:02,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4720b944faaf0e7f62186 HTTP/1.1" 200 None 2026-03-27 23:39:02,429 - lava_callback - ERROR - Error processing callback for node 69c4720b944faaf0e7f62186: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:40:22,390 - lava_callback - INFO - Received callback for node 69c4725e944faaf0e7f621a1 INFO: 172.20.0.1:51194 - "POST /node/69c4725e944faaf0e7f621a1 HTTP/1.0" 202 Accepted 2026-03-27 23:40:22,396 - lava_callback - INFO - Starting async job submit for node 69c4725e944faaf0e7f621a1 2026-03-27 23:40:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:40:22,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4725e944faaf0e7f621a1 HTTP/1.1" 200 None 2026-03-27 23:40:22,415 - lava_callback - DEBUG - Processing node 69c4725e944faaf0e7f621a1: baseline-arm64-baylibre 2026-03-27 23:40:22,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4725e944faaf0e7f621a1 2026-03-27 23:40:22,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:40:22,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4725e944faaf0e7f621a1 HTTP/1.1" 200 None 2026-03-27 23:40:22,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:40:22,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:40:22,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:40:22,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4725e944faaf0e7f621a1 HTTP/1.1" 200 None 2026-03-27 23:40:22,473 - lava_callback - ERROR - Error processing callback for node 69c4725e944faaf0e7f621a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:41:42,752 - lava_callback - INFO - Received callback for node 69c472ab944faaf0e7f621b3 INFO: 172.20.0.1:51764 - "POST /node/69c472ab944faaf0e7f621b3 HTTP/1.0" 202 Accepted 2026-03-27 23:41:42,758 - lava_callback - INFO - Starting async job submit for node 69c472ab944faaf0e7f621b3 2026-03-27 23:41:42,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:41:42,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c472ab944faaf0e7f621b3 HTTP/1.1" 200 None 2026-03-27 23:41:42,773 - lava_callback - DEBUG - Processing node 69c472ab944faaf0e7f621b3: baseline-arm64-baylibre 2026-03-27 23:41:42,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c472ab944faaf0e7f621b3 2026-03-27 23:41:42,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:41:42,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c472ab944faaf0e7f621b3 HTTP/1.1" 200 None 2026-03-27 23:41:42,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:41:42,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:41:42,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:41:42,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c472ab944faaf0e7f621b3 HTTP/1.1" 200 None 2026-03-27 23:41:42,831 - lava_callback - ERROR - Error processing callback for node 69c472ab944faaf0e7f621b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55120 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:43:02,564 - lava_callback - INFO - Received callback for node 69c472f9944faaf0e7f621cb INFO: 172.20.0.1:47366 - "POST /node/69c472f9944faaf0e7f621cb HTTP/1.0" 202 Accepted 2026-03-27 23:43:02,570 - lava_callback - INFO - Starting async job submit for node 69c472f9944faaf0e7f621cb 2026-03-27 23:43:02,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:43:02,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c472f9944faaf0e7f621cb HTTP/1.1" 200 None 2026-03-27 23:43:02,610 - lava_callback - DEBUG - Processing node 69c472f9944faaf0e7f621cb: baseline-arm64-baylibre 2026-03-27 23:43:02,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c472f9944faaf0e7f621cb 2026-03-27 23:43:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:43:02,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c472f9944faaf0e7f621cb HTTP/1.1" 200 None 2026-03-27 23:43:02,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:43:02,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:43:02,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:43:02,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c472f9944faaf0e7f621cb HTTP/1.1" 200 None 2026-03-27 23:43:02,666 - lava_callback - ERROR - Error processing callback for node 69c472f9944faaf0e7f621cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39250 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:44:22,598 - lava_callback - INFO - Received callback for node 69c4734d944faaf0e7f621df INFO: 172.20.0.1:58164 - "POST /node/69c4734d944faaf0e7f621df HTTP/1.0" 202 Accepted 2026-03-27 23:44:22,604 - lava_callback - INFO - Starting async job submit for node 69c4734d944faaf0e7f621df 2026-03-27 23:44:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:44:22,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4734d944faaf0e7f621df HTTP/1.1" 200 None 2026-03-27 23:44:22,627 - lava_callback - DEBUG - Processing node 69c4734d944faaf0e7f621df: baseline-arm64-baylibre 2026-03-27 23:44:22,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4734d944faaf0e7f621df 2026-03-27 23:44:22,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:44:22,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4734d944faaf0e7f621df HTTP/1.1" 200 None 2026-03-27 23:44:22,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:44:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:44:22,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:44:22,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4734d944faaf0e7f621df HTTP/1.1" 200 None 2026-03-27 23:44:22,686 - lava_callback - ERROR - Error processing callback for node 69c4734d944faaf0e7f621df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:47:02,766 - lava_callback - INFO - Received callback for node 69c473ea944faaf0e7f62205 INFO: 172.20.0.1:54878 - "POST /node/69c473ea944faaf0e7f62205 HTTP/1.0" 202 Accepted 2026-03-27 23:47:02,772 - lava_callback - INFO - Starting async job submit for node 69c473ea944faaf0e7f62205 2026-03-27 23:47:02,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:47:02,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c473ea944faaf0e7f62205 HTTP/1.1" 200 None 2026-03-27 23:47:02,788 - lava_callback - DEBUG - Processing node 69c473ea944faaf0e7f62205: baseline-arm64-baylibre 2026-03-27 23:47:02,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c473ea944faaf0e7f62205 2026-03-27 23:47:02,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:47:02,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c473ea944faaf0e7f62205 HTTP/1.1" 200 None 2026-03-27 23:47:02,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:47:02,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:47:02,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:47:02,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c473ea944faaf0e7f62205 HTTP/1.1" 200 None 2026-03-27 23:47:02,840 - lava_callback - ERROR - Error processing callback for node 69c473ea944faaf0e7f62205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:48:40,082 - lava_callback - INFO - Received callback for node 69c47443944faaf0e7f62219 INFO: 172.20.0.1:41506 - "POST /node/69c47443944faaf0e7f62219 HTTP/1.0" 202 Accepted 2026-03-27 23:48:40,088 - lava_callback - INFO - Starting async job submit for node 69c47443944faaf0e7f62219 2026-03-27 23:48:40,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:48:40,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47443944faaf0e7f62219 HTTP/1.1" 200 None 2026-03-27 23:48:40,126 - lava_callback - DEBUG - Processing node 69c47443944faaf0e7f62219: baseline-arm64-clabbe 2026-03-27 23:48:40,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47443944faaf0e7f62219 2026-03-27 23:48:40,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:48:40,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47443944faaf0e7f62219 HTTP/1.1" 200 None 2026-03-27 23:48:40,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:48:40,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:48:40,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:48:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47443944faaf0e7f62219 HTTP/1.1" 200 None 2026-03-27 23:48:40,187 - lava_callback - ERROR - Error processing callback for node 69c47443944faaf0e7f62219: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:51:20,208 - lava_callback - INFO - Received callback for node 69c474e3944faaf0e7f62230 INFO: 172.20.0.1:50356 - "POST /node/69c474e3944faaf0e7f62230 HTTP/1.0" 202 Accepted 2026-03-27 23:51:20,213 - lava_callback - INFO - Starting async job submit for node 69c474e3944faaf0e7f62230 2026-03-27 23:51:20,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:51:20,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c474e3944faaf0e7f62230 HTTP/1.1" 200 None 2026-03-27 23:51:20,230 - lava_callback - DEBUG - Processing node 69c474e3944faaf0e7f62230: baseline-arm64-clabbe 2026-03-27 23:51:20,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c474e3944faaf0e7f62230 2026-03-27 23:51:20,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:51:20,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c474e3944faaf0e7f62230 HTTP/1.1" 200 None 2026-03-27 23:51:20,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:51:20,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:51:20,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:51:20,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c474e3944faaf0e7f62230 HTTP/1.1" 200 None 2026-03-27 23:51:20,302 - lava_callback - ERROR - Error processing callback for node 69c474e3944faaf0e7f62230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:52:40,252 - lava_callback - INFO - Received callback for node 69c47535944faaf0e7f62249 INFO: 172.20.0.1:45892 - "POST /node/69c47535944faaf0e7f62249 HTTP/1.0" 202 Accepted 2026-03-27 23:52:40,258 - lava_callback - INFO - Starting async job submit for node 69c47535944faaf0e7f62249 2026-03-27 23:52:40,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:52:40,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47535944faaf0e7f62249 HTTP/1.1" 200 None 2026-03-27 23:52:40,275 - lava_callback - DEBUG - Processing node 69c47535944faaf0e7f62249: baseline-arm64-clabbe 2026-03-27 23:52:40,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47535944faaf0e7f62249 2026-03-27 23:52:40,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:52:40,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47535944faaf0e7f62249 HTTP/1.1" 200 None 2026-03-27 23:52:40,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:52:40,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:52:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:52:40,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47535944faaf0e7f62249 HTTP/1.1" 200 None 2026-03-27 23:52:40,325 - lava_callback - ERROR - Error processing callback for node 69c47535944faaf0e7f62249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:55:20,451 - lava_callback - INFO - Received callback for node 69c475d8944faaf0e7f6226d INFO: 172.20.0.1:42182 - "POST /node/69c475d8944faaf0e7f6226d HTTP/1.0" 202 Accepted 2026-03-27 23:55:20,460 - lava_callback - INFO - Starting async job submit for node 69c475d8944faaf0e7f6226d 2026-03-27 23:55:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:55:20,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c475d8944faaf0e7f6226d HTTP/1.1" 200 None 2026-03-27 23:55:20,482 - lava_callback - DEBUG - Processing node 69c475d8944faaf0e7f6226d: baseline-arm64-clabbe 2026-03-27 23:55:20,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c475d8944faaf0e7f6226d 2026-03-27 23:55:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:55:20,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c475d8944faaf0e7f6226d HTTP/1.1" 200 None 2026-03-27 23:55:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:55:20,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:55:20,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:55:20,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c475d8944faaf0e7f6226d HTTP/1.1" 200 None 2026-03-27 23:55:20,547 - lava_callback - ERROR - Error processing callback for node 69c475d8944faaf0e7f6226d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37634 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:56:40,467 - lava_callback - INFO - Received callback for node 69c4762b944faaf0e7f6227f INFO: 172.20.0.1:51564 - "POST /node/69c4762b944faaf0e7f6227f HTTP/1.0" 202 Accepted 2026-03-27 23:56:40,472 - lava_callback - INFO - Starting async job submit for node 69c4762b944faaf0e7f6227f 2026-03-27 23:56:40,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:56:40,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4762b944faaf0e7f6227f HTTP/1.1" 200 None 2026-03-27 23:56:40,488 - lava_callback - DEBUG - Processing node 69c4762b944faaf0e7f6227f: baseline-arm64-clabbe 2026-03-27 23:56:40,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4762b944faaf0e7f6227f 2026-03-27 23:56:40,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:56:40,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4762b944faaf0e7f6227f HTTP/1.1" 200 None 2026-03-27 23:56:40,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:56:40,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:56:40,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:56:40,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4762b944faaf0e7f6227f HTTP/1.1" 200 None 2026-03-27 23:56:40,547 - lava_callback - ERROR - Error processing callback for node 69c4762b944faaf0e7f6227f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60500 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:58:00,725 - lava_callback - INFO - Received callback for node 69c4767e944faaf0e7f62292 INFO: 172.20.0.1:58934 - "POST /node/69c4767e944faaf0e7f62292 HTTP/1.0" 202 Accepted 2026-03-27 23:58:00,731 - lava_callback - INFO - Starting async job submit for node 69c4767e944faaf0e7f62292 2026-03-27 23:58:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:58:00,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4767e944faaf0e7f62292 HTTP/1.1" 200 None 2026-03-27 23:58:00,747 - lava_callback - DEBUG - Processing node 69c4767e944faaf0e7f62292: baseline-arm64-clabbe 2026-03-27 23:58:00,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4767e944faaf0e7f62292 2026-03-27 23:58:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:58:00,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4767e944faaf0e7f62292 HTTP/1.1" 200 None 2026-03-27 23:58:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:58:00,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:58:00,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:58:00,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4767e944faaf0e7f62292 HTTP/1.1" 200 None 2026-03-27 23:58:00,806 - lava_callback - ERROR - Error processing callback for node 69c4767e944faaf0e7f62292: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK 2026-03-27 23:59:24,020 - lava_callback - INFO - Received callback for node 69c476d0944faaf0e7f622aa INFO: 172.20.0.1:52032 - "POST /node/69c476d0944faaf0e7f622aa HTTP/1.0" 202 Accepted 2026-03-27 23:59:24,025 - lava_callback - INFO - Starting async job submit for node 69c476d0944faaf0e7f622aa 2026-03-27 23:59:24,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:59:24,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c476d0944faaf0e7f622aa HTTP/1.1" 200 None 2026-03-27 23:59:24,041 - lava_callback - DEBUG - Processing node 69c476d0944faaf0e7f622aa: baseline-arm64-clabbe 2026-03-27 23:59:24,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c476d0944faaf0e7f622aa 2026-03-27 23:59:24,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:59:24,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c476d0944faaf0e7f622aa HTTP/1.1" 200 None 2026-03-27 23:59:24,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:59:24,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-27 23:59:24,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-27 23:59:24,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c476d0944faaf0e7f622aa HTTP/1.1" 200 None 2026-03-27 23:59:24,096 - lava_callback - ERROR - Error processing callback for node 69c476d0944faaf0e7f622aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:01:00,651 - lava_callback - INFO - Received callback for node 69c47727944faaf0e7f622be INFO: 172.20.0.1:44794 - "POST /node/69c47727944faaf0e7f622be HTTP/1.0" 202 Accepted 2026-03-28 00:01:00,659 - lava_callback - INFO - Starting async job submit for node 69c47727944faaf0e7f622be 2026-03-28 00:01:00,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:01:00,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47727944faaf0e7f622be HTTP/1.1" 200 None 2026-03-28 00:01:00,680 - lava_callback - DEBUG - Processing node 69c47727944faaf0e7f622be: baseline-arm64-clabbe 2026-03-28 00:01:00,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47727944faaf0e7f622be 2026-03-28 00:01:00,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:01:00,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47727944faaf0e7f622be HTTP/1.1" 200 None 2026-03-28 00:01:00,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:01:00,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-28 00:01:00,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:01:00,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47727944faaf0e7f622be HTTP/1.1" 200 None 2026-03-28 00:01:00,773 - lava_callback - ERROR - Error processing callback for node 69c47727944faaf0e7f622be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:02:03,603 - lava_callback - INFO - Received callback for node 69c47773944faaf0e7f622c6 INFO: 172.20.0.1:49242 - "POST /node/69c47773944faaf0e7f622c6 HTTP/1.0" 202 Accepted 2026-03-28 00:02:03,609 - lava_callback - INFO - Starting async job submit for node 69c47773944faaf0e7f622c6 2026-03-28 00:02:03,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:02:03,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47773944faaf0e7f622c6 HTTP/1.1" 200 None 2026-03-28 00:02:03,626 - lava_callback - DEBUG - Processing node 69c47773944faaf0e7f622c6: baseline-arm64-baylibre 2026-03-28 00:02:03,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47773944faaf0e7f622c6 2026-03-28 00:02:03,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:02:03,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47773944faaf0e7f622c6 HTTP/1.1" 200 None 2026-03-28 00:02:03,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:02:03,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-28 00:02:03,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:02:03,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47773944faaf0e7f622c6 HTTP/1.1" 200 None 2026-03-28 00:02:03,838 - lava_callback - ERROR - Error processing callback for node 69c47773944faaf0e7f622c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54604 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:05:00,829 - lava_callback - INFO - Received callback for node 69c4781b944faaf0e7f622e2 INFO: 172.20.0.1:60556 - "POST /node/69c4781b944faaf0e7f622e2 HTTP/1.0" 202 Accepted 2026-03-28 00:05:00,834 - lava_callback - INFO - Starting async job submit for node 69c4781b944faaf0e7f622e2 2026-03-28 00:05:00,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:05:00,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4781b944faaf0e7f622e2 HTTP/1.1" 200 None 2026-03-28 00:05:00,851 - lava_callback - DEBUG - Processing node 69c4781b944faaf0e7f622e2: baseline-arm64-clabbe 2026-03-28 00:05:00,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c4781b944faaf0e7f622e2 2026-03-28 00:05:00,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:05:00,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4781b944faaf0e7f622e2 HTTP/1.1" 200 None 2026-03-28 00:05:00,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:05:00,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-28 00:05:00,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:05:00,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c4781b944faaf0e7f622e2 HTTP/1.1" 200 None 2026-03-28 00:05:00,925 - lava_callback - ERROR - Error processing callback for node 69c4781b944faaf0e7f622e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46834 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:07:41,061 - lava_callback - INFO - Received callback for node 69c478c0944faaf0e7f622f8 INFO: 172.20.0.1:34764 - "POST /node/69c478c0944faaf0e7f622f8 HTTP/1.0" 202 Accepted 2026-03-28 00:07:41,067 - lava_callback - INFO - Starting async job submit for node 69c478c0944faaf0e7f622f8 2026-03-28 00:07:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:07:41,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c478c0944faaf0e7f622f8 HTTP/1.1" 200 None 2026-03-28 00:07:41,084 - lava_callback - DEBUG - Processing node 69c478c0944faaf0e7f622f8: baseline-arm64-clabbe 2026-03-28 00:07:41,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c478c0944faaf0e7f622f8 2026-03-28 00:07:41,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:07:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c478c0944faaf0e7f622f8 HTTP/1.1" 200 None 2026-03-28 00:07:41,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:07:41,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-28 00:07:41,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:07:41,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c478c0944faaf0e7f622f8 HTTP/1.1" 200 None 2026-03-28 00:07:41,142 - lava_callback - ERROR - Error processing callback for node 69c478c0944faaf0e7f622f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:10:21,106 - lava_callback - INFO - Received callback for node 69c47963944faaf0e7f62327 INFO: 172.20.0.1:50992 - "POST /node/69c47963944faaf0e7f62327 HTTP/1.0" 202 Accepted 2026-03-28 00:10:21,112 - lava_callback - INFO - Starting async job submit for node 69c47963944faaf0e7f62327 2026-03-28 00:10:21,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:10:21,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47963944faaf0e7f62327 HTTP/1.1" 200 None 2026-03-28 00:10:21,137 - lava_callback - DEBUG - Processing node 69c47963944faaf0e7f62327: baseline-arm64-clabbe 2026-03-28 00:10:21,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c47963944faaf0e7f62327 2026-03-28 00:10:21,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:10:21,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47963944faaf0e7f62327 HTTP/1.1" 200 None 2026-03-28 00:10:21,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:10:21,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-28 00:10:21,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:10:21,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c47963944faaf0e7f62327 HTTP/1.1" 200 None 2026-03-28 00:10:21,255 - lava_callback - ERROR - Error processing callback for node 69c47963944faaf0e7f62327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:11:24,342 - lava_callback - INFO - Received callback for node 69c479a1944faaf0e7f62332 INFO: 172.20.0.1:43870 - "POST /node/69c479a1944faaf0e7f62332 HTTP/1.0" 202 Accepted 2026-03-28 00:11:24,347 - lava_callback - INFO - Starting async job submit for node 69c479a1944faaf0e7f62332 2026-03-28 00:11:24,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:11:24,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479a1944faaf0e7f62332 HTTP/1.1" 200 None 2026-03-28 00:11:24,389 - lava_callback - DEBUG - Processing node 69c479a1944faaf0e7f62332: baseline-arm-baylibre 2026-03-28 00:11:24,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c479a1944faaf0e7f62332 2026-03-28 00:11:24,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:11:24,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479a1944faaf0e7f62332 HTTP/1.1" 200 None 2026-03-28 00:11:24,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:11:24,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-28 00:11:24,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:11:24,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c479a1944faaf0e7f62332 HTTP/1.1" 200 None 2026-03-28 00:11:24,457 - lava_callback - ERROR - Error processing callback for node 69c479a1944faaf0e7f62332: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47842 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:12:04,052 - lava_callback - INFO - Received callback for node 69c479c6944faaf0e7f6233f INFO: 172.20.0.1:49568 - "POST /node/69c479c6944faaf0e7f6233f HTTP/1.0" 202 Accepted 2026-03-28 00:12:04,057 - lava_callback - INFO - Starting async job submit for node 69c479c6944faaf0e7f6233f 2026-03-28 00:12:04,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:04,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479c6944faaf0e7f6233f HTTP/1.1" 200 None 2026-03-28 00:12:04,074 - lava_callback - DEBUG - Processing node 69c479c6944faaf0e7f6233f: baseline-arm-baylibre 2026-03-28 00:12:04,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c479c6944faaf0e7f6233f 2026-03-28 00:12:04,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:04,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479c6944faaf0e7f6233f HTTP/1.1" 200 None 2026-03-28 00:12:04,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:04,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-28 00:12:04,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:04,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c479c6944faaf0e7f6233f HTTP/1.1" 200 None 2026-03-28 00:12:04,141 - lava_callback - ERROR - Error processing callback for node 69c479c6944faaf0e7f6233f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK 2026-03-28 00:12:44,156 - lava_callback - INFO - Received callback for node 69c479eb944faaf0e7f6234a INFO: 172.20.0.1:47820 - "POST /node/69c479eb944faaf0e7f6234a HTTP/1.0" 202 Accepted 2026-03-28 00:12:44,162 - lava_callback - INFO - Starting async job submit for node 69c479eb944faaf0e7f6234a 2026-03-28 00:12:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:44,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479eb944faaf0e7f6234a HTTP/1.1" 200 None 2026-03-28 00:12:44,179 - lava_callback - DEBUG - Processing node 69c479eb944faaf0e7f6234a: baseline-arm-baylibre 2026-03-28 00:12:44,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c479eb944faaf0e7f6234a 2026-03-28 00:12:44,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:44,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c479eb944faaf0e7f6234a HTTP/1.1" 200 None 2026-03-28 00:12:44,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:44,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-28 00:12:44,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 00:12:44,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c479eb944faaf0e7f6234a HTTP/1.1" 200 None 2026-03-28 00:12:44,257 - lava_callback - ERROR - Error processing callback for node 69c479eb944faaf0e7f6234a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]