INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET /node/693b7a2041fb4c9509762818%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /node/694bc95cc19e09af58d46e7e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET /node/6986fa856e077e4126a7d320%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59304 - "GET /node/693af6cbfee8383e92b6bd3a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET /node/6992e7e131166481c8dd8321%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET /node/69876d7ae31b58f834f19d13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55472 - "GET /node/6940acf11e3c24e95681a9b7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET /node/6986fe0a6e077e4126a7d970%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET /node/699195ff10b45da7d7d1195e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET /node/6990b662c45febfe445235fa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET /node/6988c13f9fc35f969e1ede6f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:35:47,970 - lava_callback - INFO - Received callback for node 69d450ec8fbbb5910331f9e1 2026-04-07 00:35:47,977 - lava_callback - INFO - Starting async job submit for node 69d450ec8fbbb5910331f9e1 INFO: 172.21.0.1:45138 - "POST /node/69d450ec8fbbb5910331f9e1 HTTP/1.0" 202 Accepted 2026-04-07 00:35:48,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:35:48,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d450ec8fbbb5910331f9e1 HTTP/1.1" 200 None 2026-04-07 00:35:48,023 - lava_callback - DEBUG - Processing node 69d450ec8fbbb5910331f9e1: baseline-arm 2026-04-07 00:35:48,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:35:48,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:35:48,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d450ec8fbbb5910331f9e1/log.txt.gz 2026-04-07 00:35:48,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:35:48,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:35:48,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d450ec8fbbb5910331f9e1/lava-logs.yaml 2026-04-07 00:35:48,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:35:48,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:35:48,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d450ec8fbbb5910331f9e1/lava_callback.json.gz 2026-04-07 00:35:48,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:35:48,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d450ec8fbbb5910331f9e1 HTTP/1.1" 200 None 2026-04-07 00:35:48,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:35:49,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d608fbbb5910331f99d HTTP/1.1" 200 None 2026-04-07 00:35:49,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:35:49,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d450ec8fbbb5910331f9e1 HTTP/1.1" 200 None 2026-04-07 00:35:49,054 - lava_callback - INFO - Completed processing callback for node 69d450ec8fbbb5910331f9e1 INFO: 172.21.0.1:45142 - "GET /node/6985bd9571989fb141497970%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 00:36:16,360 - lava_callback - INFO - Received callback for node 69d451678fbbb5910331f9f8 INFO: 172.21.0.1:50182 - "POST /node/69d451678fbbb5910331f9f8 HTTP/1.0" 202 Accepted 2026-04-07 00:36:16,366 - lava_callback - INFO - Starting async job submit for node 69d451678fbbb5910331f9f8 2026-04-07 00:36:16,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:16,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451678fbbb5910331f9f8 HTTP/1.1" 200 None 2026-04-07 00:36:16,386 - lava_callback - DEBUG - Processing node 69d451678fbbb5910331f9f8: baseline-arm 2026-04-07 00:36:16,392 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:36:16,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:16,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:16,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451678fbbb5910331f9f8/lava-logs.yaml 2026-04-07 00:36:16,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:36:16,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:16,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451678fbbb5910331f9f8/lava_callback.json.gz 2026-04-07 00:36:16,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:16,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451678fbbb5910331f9f8 HTTP/1.1" 200 None 2026-04-07 00:36:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:16,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:36:16,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:16,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451678fbbb5910331f9f8 HTTP/1.1" 200 None 2026-04-07 00:36:16,864 - lava_callback - INFO - Completed processing callback for node 69d451678fbbb5910331f9f8 2026-04-07 00:36:19,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:36:33,412 - lava_callback - INFO - Received callback for node 69d451678fbbb5910331f9fb INFO: 172.21.0.1:51868 - "POST /node/69d451678fbbb5910331f9fb HTTP/1.0" 202 Accepted 2026-04-07 00:36:33,462 - lava_callback - INFO - Starting async job submit for node 69d451678fbbb5910331f9fb 2026-04-07 00:36:33,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:33,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451678fbbb5910331f9fb HTTP/1.1" 200 None 2026-04-07 00:36:33,498 - lava_callback - DEBUG - Processing node 69d451678fbbb5910331f9fb: baseline-arm 2026-04-07 00:36:33,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:33,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:33,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d451678fbbb5910331f9fb/log.txt.gz 2026-04-07 00:36:33,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:34,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:34,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451678fbbb5910331f9fb/lava-logs.yaml 2026-04-07 00:36:34,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:34,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:34,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451678fbbb5910331f9fb/lava_callback.json.gz 2026-04-07 00:36:34,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:34,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451678fbbb5910331f9fb HTTP/1.1" 200 None 2026-04-07 00:36:34,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:34,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:36:34,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:34,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451678fbbb5910331f9fb HTTP/1.1" 200 None 2026-04-07 00:36:34,370 - lava_callback - INFO - Completed processing callback for node 69d451678fbbb5910331f9fb INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:36:46,897 - lava_callback - INFO - Received callback for node 69d1ae95aa48d6fae7bb089e INFO: 172.21.0.1:36196 - "POST /node/69d1ae95aa48d6fae7bb089e HTTP/1.0" 202 Accepted 2026-04-07 00:36:46,905 - lava_callback - INFO - Starting async job submit for node 69d1ae95aa48d6fae7bb089e 2026-04-07 00:36:46,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:46,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ae95aa48d6fae7bb089e HTTP/1.1" 200 None 2026-04-07 00:36:46,943 - lava_callback - DEBUG - Processing node 69d1ae95aa48d6fae7bb089e: baseline-arm-baylibre 2026-04-07 00:36:46,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ae95aa48d6fae7bb089e 2026-04-07 00:36:46,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:46,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ae95aa48d6fae7bb089e HTTP/1.1" 200 None 2026-04-07 00:36:46,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:46,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:36:46,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:47,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ae95aa48d6fae7bb089e HTTP/1.1" 200 None 2026-04-07 00:36:47,026 - lava_callback - ERROR - Error processing callback for node 69d1ae95aa48d6fae7bb089e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:36:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:49,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:36:50,674 - lava_callback - INFO - Received callback for node 69d4516a8fbbb5910331fa0b INFO: 172.21.0.1:59562 - "POST /node/69d4516a8fbbb5910331fa0b HTTP/1.0" 202 Accepted 2026-04-07 00:36:50,731 - lava_callback - INFO - Starting async job submit for node 69d4516a8fbbb5910331fa0b 2026-04-07 00:36:50,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:50,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4516a8fbbb5910331fa0b HTTP/1.1" 200 None 2026-04-07 00:36:50,777 - lava_callback - DEBUG - Processing node 69d4516a8fbbb5910331fa0b: baseline-arm 2026-04-07 00:36:50,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:51,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:51,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d4516a8fbbb5910331fa0b/log.txt.gz 2026-04-07 00:36:51,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:51,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:51,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d4516a8fbbb5910331fa0b/lava-logs.yaml 2026-04-07 00:36:51,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:51,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:51,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d4516a8fbbb5910331fa0b/lava_callback.json.gz 2026-04-07 00:36:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:51,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4516a8fbbb5910331fa0b HTTP/1.1" 200 None 2026-04-07 00:36:51,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:51,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:36:51,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:51,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4516a8fbbb5910331fa0b HTTP/1.1" 200 None 2026-04-07 00:36:51,551 - lava_callback - INFO - Completed processing callback for node 69d4516a8fbbb5910331fa0b INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:36:58,739 - lava_callback - INFO - Received callback for node 69d451698fbbb5910331fa08 INFO: 172.21.0.1:59570 - "POST /node/69d451698fbbb5910331fa08 HTTP/1.0" 202 Accepted 2026-04-07 00:36:58,746 - lava_callback - INFO - Starting async job submit for node 69d451698fbbb5910331fa08 2026-04-07 00:36:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:58,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451698fbbb5910331fa08 HTTP/1.1" 200 None 2026-04-07 00:36:58,792 - lava_callback - DEBUG - Processing node 69d451698fbbb5910331fa08: baseline-arm 2026-04-07 00:36:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:59,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:59,173 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d451698fbbb5910331fa08/log.txt.gz 2026-04-07 00:36:59,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:59,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:59,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451698fbbb5910331fa08/lava-logs.yaml 2026-04-07 00:36:59,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:36:59,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:36:59,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451698fbbb5910331fa08/lava_callback.json.gz 2026-04-07 00:36:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451698fbbb5910331fa08 HTTP/1.1" 200 None 2026-04-07 00:36:59,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:59,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:36:59,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:36:59,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451698fbbb5910331fa08 HTTP/1.1" 200 None 2026-04-07 00:36:59,796 - lava_callback - INFO - Completed processing callback for node 69d451698fbbb5910331fa08 INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:37:14,631 - lava_callback - INFO - Received callback for node 69d451668fbbb5910331f9f5 INFO: 172.21.0.1:47834 - "POST /node/69d451668fbbb5910331f9f5 HTTP/1.0" 202 Accepted 2026-04-07 00:37:14,637 - lava_callback - INFO - Starting async job submit for node 69d451668fbbb5910331f9f5 2026-04-07 00:37:14,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:14,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451668fbbb5910331f9f5 HTTP/1.1" 200 None 2026-04-07 00:37:14,676 - lava_callback - DEBUG - Processing node 69d451668fbbb5910331f9f5: baseline-arm 2026-04-07 00:37:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:14,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:15,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d451668fbbb5910331f9f5/log.txt.gz 2026-04-07 00:37:15,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47846 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 00:37:15,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:15,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451668fbbb5910331f9f5/lava-logs.yaml 2026-04-07 00:37:15,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:15,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:15,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451668fbbb5910331f9f5/lava_callback.json.gz 2026-04-07 00:37:15,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:15,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451668fbbb5910331f9f5 HTTP/1.1" 200 None 2026-04-07 00:37:15,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:15,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:15,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:15,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451668fbbb5910331f9f5 HTTP/1.1" 200 None 2026-04-07 00:37:15,586 - lava_callback - INFO - Completed processing callback for node 69d451668fbbb5910331f9f5 2026-04-07 00:37:16,530 - lava_callback - INFO - Received callback for node 69d4518d8fbbb5910331faa9 INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "POST /node/69d4518d8fbbb5910331faa9 HTTP/1.0" 202 Accepted 2026-04-07 00:37:16,577 - lava_callback - INFO - Starting async job submit for node 69d4518d8fbbb5910331faa9 2026-04-07 00:37:16,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:16,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518d8fbbb5910331faa9 HTTP/1.1" 200 None 2026-04-07 00:37:16,621 - lava_callback - DEBUG - Processing node 69d4518d8fbbb5910331faa9: baseline-arm-pengutronix 2026-04-07 00:37:16,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:16,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:16,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518d8fbbb5910331faa9/log.txt.gz 2026-04-07 00:37:16,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:17,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:17,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518d8fbbb5910331faa9/lava-logs.yaml 2026-04-07 00:37:17,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:17,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:17,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518d8fbbb5910331faa9/lava_callback.json.gz 2026-04-07 00:37:17,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:17,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518d8fbbb5910331faa9 HTTP/1.1" 200 None 2026-04-07 00:37:17,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:17,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:17,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:17,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4518d8fbbb5910331faa9 HTTP/1.1" 200 None 2026-04-07 00:37:17,269 - lava_callback - INFO - Completed processing callback for node 69d4518d8fbbb5910331faa9 2026-04-07 00:37:19,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:19,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:37:22,117 - lava_callback - INFO - Received callback for node 69d4518a8fbbb5910331faa3 INFO: 172.21.0.1:34072 - "POST /node/69d4518a8fbbb5910331faa3 HTTP/1.0" 202 Accepted 2026-04-07 00:37:22,123 - lava_callback - INFO - Starting async job submit for node 69d4518a8fbbb5910331faa3 2026-04-07 00:37:22,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518a8fbbb5910331faa3 HTTP/1.1" 200 None 2026-04-07 00:37:22,167 - lava_callback - DEBUG - Processing node 69d4518a8fbbb5910331faa3: baseline-arm-pengutronix 2026-04-07 00:37:22,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:22,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:22,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518a8fbbb5910331faa3/log.txt.gz 2026-04-07 00:37:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:22,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:22,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518a8fbbb5910331faa3/lava-logs.yaml 2026-04-07 00:37:22,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:22,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:22,950 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518a8fbbb5910331faa3/lava_callback.json.gz 2026-04-07 00:37:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:22,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518a8fbbb5910331faa3 HTTP/1.1" 200 None 2026-04-07 00:37:22,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:23,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:23,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4518a8fbbb5910331faa3 HTTP/1.1" 200 None 2026-04-07 00:37:23,028 - lava_callback - INFO - Completed processing callback for node 69d4518a8fbbb5910331faa3 INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:37:26,709 - lava_callback - INFO - Received callback for node 69d1aebaaa48d6fae7bb08b3 INFO: 172.21.0.1:34094 - "POST /node/69d1aebaaa48d6fae7bb08b3 HTTP/1.0" 202 Accepted 2026-04-07 00:37:26,715 - lava_callback - INFO - Starting async job submit for node 69d1aebaaa48d6fae7bb08b3 2026-04-07 00:37:26,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:26,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aebaaa48d6fae7bb08b3 HTTP/1.1" 200 None 2026-04-07 00:37:26,730 - lava_callback - DEBUG - Processing node 69d1aebaaa48d6fae7bb08b3: baseline-arm-baylibre 2026-04-07 00:37:26,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1aebaaa48d6fae7bb08b3 2026-04-07 00:37:26,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aebaaa48d6fae7bb08b3 HTTP/1.1" 200 None 2026-04-07 00:37:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:26,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:37:26,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1aebaaa48d6fae7bb08b3 HTTP/1.1" 200 None 2026-04-07 00:37:26,821 - lava_callback - ERROR - Error processing callback for node 69d1aebaaa48d6fae7bb08b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:37:28,310 - lava_callback - INFO - Received callback for node 69d451798fbbb5910331fa32 INFO: 172.21.0.1:34110 - "POST /node/69d451798fbbb5910331fa32 HTTP/1.0" 202 Accepted 2026-04-07 00:37:28,317 - lava_callback - INFO - Starting async job submit for node 69d451798fbbb5910331fa32 2026-04-07 00:37:28,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:28,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451798fbbb5910331fa32 HTTP/1.1" 200 None 2026-04-07 00:37:28,355 - lava_callback - DEBUG - Processing node 69d451798fbbb5910331fa32: baseline-arm-broonie 2026-04-07 00:37:28,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:28,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:28,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451798fbbb5910331fa32/log.txt.gz 2026-04-07 00:37:28,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:29,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:29,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451798fbbb5910331fa32/lava-logs.yaml 2026-04-07 00:37:29,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:29,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:29,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451798fbbb5910331fa32/lava_callback.json.gz 2026-04-07 00:37:29,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:29,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451798fbbb5910331fa32 HTTP/1.1" 200 None 2026-04-07 00:37:29,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:29,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:29,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:29,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451798fbbb5910331fa32 HTTP/1.1" 200 None 2026-04-07 00:37:29,323 - lava_callback - INFO - Completed processing callback for node 69d451798fbbb5910331fa32 2026-04-07 00:37:34,786 - lava_callback - INFO - Received callback for node 69d4518b8fbbb5910331faa6 INFO: 172.21.0.1:46128 - "POST /node/69d4518b8fbbb5910331faa6 HTTP/1.0" 202 Accepted 2026-04-07 00:37:34,791 - lava_callback - INFO - Starting async job submit for node 69d4518b8fbbb5910331faa6 2026-04-07 00:37:34,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:34,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518b8fbbb5910331faa6 HTTP/1.1" 200 None 2026-04-07 00:37:34,831 - lava_callback - DEBUG - Processing node 69d4518b8fbbb5910331faa6: baseline-arm-pengutronix 2026-04-07 00:37:35,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:35,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:35,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518b8fbbb5910331faa6/log.txt.gz 2026-04-07 00:37:35,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:35,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:35,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518b8fbbb5910331faa6/lava-logs.yaml 2026-04-07 00:37:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:35,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:35,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d4518b8fbbb5910331faa6/lava_callback.json.gz 2026-04-07 00:37:35,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:35,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4518b8fbbb5910331faa6 HTTP/1.1" 200 None 2026-04-07 00:37:35,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:35,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:35,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:35,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4518b8fbbb5910331faa6 HTTP/1.1" 200 None 2026-04-07 00:37:35,695 - lava_callback - INFO - Completed processing callback for node 69d4518b8fbbb5910331faa6 2026-04-07 00:37:36,310 - lava_callback - INFO - Received callback for node 69d4517b8fbbb5910331fa35 INFO: 172.21.0.1:46130 - "POST /node/69d4517b8fbbb5910331fa35 HTTP/1.0" 202 Accepted 2026-04-07 00:37:36,320 - lava_callback - INFO - Starting async job submit for node 69d4517b8fbbb5910331fa35 2026-04-07 00:37:36,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:36,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4517b8fbbb5910331fa35 HTTP/1.1" 200 None 2026-04-07 00:37:36,368 - lava_callback - DEBUG - Processing node 69d4517b8fbbb5910331fa35: baseline-arm-broonie INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:37:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:36,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:36,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4517b8fbbb5910331fa35/log.txt.gz 2026-04-07 00:37:37,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:37,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:37,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4517b8fbbb5910331fa35/lava-logs.yaml 2026-04-07 00:37:37,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:37,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:37,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d4517b8fbbb5910331fa35/lava_callback.json.gz 2026-04-07 00:37:37,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:37,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4517b8fbbb5910331fa35 HTTP/1.1" 200 None 2026-04-07 00:37:37,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:37,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:37,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:37,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4517b8fbbb5910331fa35 HTTP/1.1" 200 None 2026-04-07 00:37:37,818 - lava_callback - INFO - Completed processing callback for node 69d4517b8fbbb5910331fa35 INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:37:48,230 - lava_callback - INFO - Received callback for node 69d451788fbbb5910331fa2f INFO: 172.21.0.1:52832 - "POST /node/69d451788fbbb5910331fa2f HTTP/1.0" 202 Accepted 2026-04-07 00:37:48,236 - lava_callback - INFO - Starting async job submit for node 69d451788fbbb5910331fa2f 2026-04-07 00:37:48,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:48,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451788fbbb5910331fa2f HTTP/1.1" 200 None 2026-04-07 00:37:48,284 - lava_callback - DEBUG - Processing node 69d451788fbbb5910331fa2f: baseline-arm-broonie 2026-04-07 00:37:48,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:48,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:48,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451788fbbb5910331fa2f/log.txt.gz 2026-04-07 00:37:48,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:48,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:48,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451788fbbb5910331fa2f/lava-logs.yaml 2026-04-07 00:37:48,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:49,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:49,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451788fbbb5910331fa2f/lava_callback.json.gz 2026-04-07 00:37:49,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:49,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:49,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451788fbbb5910331fa2f HTTP/1.1" 200 None 2026-04-07 00:37:49,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:49,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:37:49,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:49,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:49,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451788fbbb5910331fa2f HTTP/1.1" 200 None 2026-04-07 00:37:49,174 - lava_callback - INFO - Completed processing callback for node 69d451788fbbb5910331fa2f 2026-04-07 00:37:50,643 - lava_callback - INFO - Received callback for node 69d451878fbbb5910331fa98 INFO: 172.21.0.1:60918 - "POST /node/69d451878fbbb5910331fa98 HTTP/1.0" 202 Accepted 2026-04-07 00:37:50,649 - lava_callback - INFO - Starting async job submit for node 69d451878fbbb5910331fa98 2026-04-07 00:37:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:50,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451878fbbb5910331fa98 HTTP/1.1" 200 None 2026-04-07 00:37:50,687 - lava_callback - DEBUG - Processing node 69d451878fbbb5910331fa98: baseline-arm-kontron 2026-04-07 00:37:50,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:50,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:50,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451878fbbb5910331fa98/log.txt.gz 2026-04-07 00:37:51,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:51,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:51,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451878fbbb5910331fa98/lava-logs.yaml 2026-04-07 00:37:51,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:51,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:51,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451878fbbb5910331fa98/lava_callback.json.gz 2026-04-07 00:37:51,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:51,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451878fbbb5910331fa98 HTTP/1.1" 200 None 2026-04-07 00:37:51,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:51,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:51,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:51,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451878fbbb5910331fa98 HTTP/1.1" 200 None 2026-04-07 00:37:51,580 - lava_callback - INFO - Completed processing callback for node 69d451878fbbb5910331fa98 2026-04-07 00:37:56,468 - lava_callback - INFO - Received callback for node 69d451768fbbb5910331fa28 INFO: 172.21.0.1:60924 - "POST /node/69d451768fbbb5910331fa28 HTTP/1.0" 202 Accepted 2026-04-07 00:37:56,474 - lava_callback - INFO - Starting async job submit for node 69d451768fbbb5910331fa28 2026-04-07 00:37:56,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:56,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451768fbbb5910331fa28 HTTP/1.1" 200 None 2026-04-07 00:37:56,513 - lava_callback - DEBUG - Processing node 69d451768fbbb5910331fa28: baseline-arm-broonie INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:37:56,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:56,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:56,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451768fbbb5910331fa28/log.txt.gz 2026-04-07 00:37:56,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:57,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:57,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451768fbbb5910331fa28/lava-logs.yaml 2026-04-07 00:37:57,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:37:57,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:37:57,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d451768fbbb5910331fa28/lava_callback.json.gz 2026-04-07 00:37:57,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:57,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451768fbbb5910331fa28 HTTP/1.1" 200 None 2026-04-07 00:37:57,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:57,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:37:57,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:37:57,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451768fbbb5910331fa28 HTTP/1.1" 200 None 2026-04-07 00:37:57,440 - lava_callback - INFO - Completed processing callback for node 69d451768fbbb5910331fa28 INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET /node/69876c13e31b58f834f198e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:38:10,778 - lava_callback - INFO - Received callback for node 69d451868fbbb5910331fa95 INFO: 172.21.0.1:44404 - "POST /node/69d451868fbbb5910331fa95 HTTP/1.0" 202 Accepted 2026-04-07 00:38:10,784 - lava_callback - INFO - Starting async job submit for node 69d451868fbbb5910331fa95 INFO: 172.21.0.1:44412 - "GET /node/69426d401b61f1c6005f62b5%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-07 00:38:10,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:10,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451868fbbb5910331fa95 HTTP/1.1" 200 None 2026-04-07 00:38:10,822 - lava_callback - DEBUG - Processing node 69d451868fbbb5910331fa95: baseline-arm-kontron 2026-04-07 00:38:11,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:11,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:11,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451868fbbb5910331fa95/log.txt.gz 2026-04-07 00:38:11,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:11,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:11,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451868fbbb5910331fa95/lava-logs.yaml 2026-04-07 00:38:11,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:11,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:11,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d451868fbbb5910331fa95/lava_callback.json.gz 2026-04-07 00:38:11,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:11,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451868fbbb5910331fa95 HTTP/1.1" 200 None 2026-04-07 00:38:11,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:11,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:38:11,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:11,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451868fbbb5910331fa95 HTTP/1.1" 200 None 2026-04-07 00:38:11,647 - lava_callback - INFO - Completed processing callback for node 69d451868fbbb5910331fa95 INFO: 172.21.0.1:44422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:38:19,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:19,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:38:26,091 - lava_callback - INFO - Received callback for node 69d1aef0aa48d6fae7bb08cd INFO: 172.21.0.1:38854 - "POST /node/69d1aef0aa48d6fae7bb08cd HTTP/1.0" 202 Accepted 2026-04-07 00:38:26,096 - lava_callback - INFO - Starting async job submit for node 69d1aef0aa48d6fae7bb08cd 2026-04-07 00:38:26,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:26,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aef0aa48d6fae7bb08cd HTTP/1.1" 200 None 2026-04-07 00:38:26,112 - lava_callback - DEBUG - Processing node 69d1aef0aa48d6fae7bb08cd: baseline-arm-clabbe 2026-04-07 00:38:26,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1aef0aa48d6fae7bb08cd 2026-04-07 00:38:26,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:26,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aef0aa48d6fae7bb08cd HTTP/1.1" 200 None 2026-04-07 00:38:26,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:26,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:38:26,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1aef0aa48d6fae7bb08cd HTTP/1.1" 200 None 2026-04-07 00:38:26,169 - lava_callback - ERROR - Error processing callback for node 69d1aef0aa48d6fae7bb08cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:38:28,218 - lava_callback - INFO - Received callback for node 69d451f38fbbb5910331fbd7 INFO: 172.21.0.1:38858 - "POST /node/69d451f38fbbb5910331fbd7 HTTP/1.0" 202 Accepted 2026-04-07 00:38:28,228 - lava_callback - INFO - Starting async job submit for node 69d451f38fbbb5910331fbd7 2026-04-07 00:38:28,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:28,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451f38fbbb5910331fbd7 HTTP/1.1" 200 None 2026-04-07 00:38:28,250 - lava_callback - DEBUG - Processing node 69d451f38fbbb5910331fbd7: baseline-arm 2026-04-07 00:38:28,256 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:38:28,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:28,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:28,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451f38fbbb5910331fbd7/lava-logs.yaml 2026-04-07 00:38:28,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:28,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:28,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451f38fbbb5910331fbd7/lava_callback.json.gz 2026-04-07 00:38:28,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:28,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451f38fbbb5910331fbd7 HTTP/1.1" 200 None 2026-04-07 00:38:28,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:28,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:38:28,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:28,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451f38fbbb5910331fbd7 HTTP/1.1" 200 None 2026-04-07 00:38:28,592 - lava_callback - INFO - Completed processing callback for node 69d451f38fbbb5910331fbd7 2026-04-07 00:38:31,870 - lava_callback - INFO - Received callback for node 69d451a08fbbb5910331faf9 INFO: 172.21.0.1:49328 - "POST /node/69d451a08fbbb5910331faf9 HTTP/1.0" 202 Accepted 2026-04-07 00:38:31,876 - lava_callback - INFO - Starting async job submit for node 69d451a08fbbb5910331faf9 2026-04-07 00:38:31,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:31,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a08fbbb5910331faf9 HTTP/1.1" 200 None 2026-04-07 00:38:31,919 - lava_callback - DEBUG - Processing node 69d451a08fbbb5910331faf9: ltp-dio 2026-04-07 00:38:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:32,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:32,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d451a08fbbb5910331faf9/log.txt.gz 2026-04-07 00:38:32,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:32,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:32,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d451a08fbbb5910331faf9/lava-logs.yaml 2026-04-07 00:38:32,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:38:33,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:38:33,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d451a08fbbb5910331faf9/lava_callback.json.gz 2026-04-07 00:38:33,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:33,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a08fbbb5910331faf9 HTTP/1.1" 200 None 2026-04-07 00:38:33,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:33,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:38:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:33,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451a08fbbb5910331faf9 HTTP/1.1" 200 None 2026-04-07 00:38:33,184 - lava_callback - INFO - Completed processing callback for node 69d451a08fbbb5910331faf9 INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:38:49,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:38:49,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:39:06,017 - lava_callback - INFO - Received callback for node 69d1af14aa48d6fae7bb08da INFO: 172.21.0.1:47028 - "POST /node/69d1af14aa48d6fae7bb08da HTTP/1.0" 202 Accepted 2026-04-07 00:39:06,023 - lava_callback - INFO - Starting async job submit for node 69d1af14aa48d6fae7bb08da 2026-04-07 00:39:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:06,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af14aa48d6fae7bb08da HTTP/1.1" 200 None 2026-04-07 00:39:06,039 - lava_callback - DEBUG - Processing node 69d1af14aa48d6fae7bb08da: baseline-arm-clabbe 2026-04-07 00:39:06,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af14aa48d6fae7bb08da 2026-04-07 00:39:06,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:06,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af14aa48d6fae7bb08da HTTP/1.1" 200 None 2026-04-07 00:39:06,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:06,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:39:06,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:06,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af14aa48d6fae7bb08da HTTP/1.1" 200 None 2026-04-07 00:39:06,097 - lava_callback - ERROR - Error processing callback for node 69d1af14aa48d6fae7bb08da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:39:07,772 - lava_callback - INFO - Received callback for node 69d452158fbbb5910331fc1d INFO: 172.21.0.1:47050 - "POST /node/69d452158fbbb5910331fc1d HTTP/1.0" 202 Accepted 2026-04-07 00:39:07,779 - lava_callback - INFO - Starting async job submit for node 69d452158fbbb5910331fc1d 2026-04-07 00:39:07,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:07,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452158fbbb5910331fc1d HTTP/1.1" 200 None 2026-04-07 00:39:07,811 - lava_callback - DEBUG - Processing node 69d452158fbbb5910331fc1d: baseline-x86 2026-04-07 00:39:08,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:08,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:08,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d452158fbbb5910331fc1d/log.txt.gz 2026-04-07 00:39:08,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:08,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:08,454 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d452158fbbb5910331fc1d/lava-logs.yaml 2026-04-07 00:39:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:08,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:08,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d452158fbbb5910331fc1d/lava_callback.json.gz 2026-04-07 00:39:08,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:08,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452158fbbb5910331fc1d HTTP/1.1" 200 None 2026-04-07 00:39:08,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:08,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 00:39:08,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:08,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452158fbbb5910331fc1d HTTP/1.1" 200 None 2026-04-07 00:39:08,695 - lava_callback - INFO - Completed processing callback for node 69d452158fbbb5910331fc1d INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:39:19,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:19,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:39:22,106 - lava_callback - INFO - Received callback for node 69d452138fbbb5910331fc14 INFO: 172.21.0.1:53532 - "POST /node/69d452138fbbb5910331fc14 HTTP/1.0" 202 Accepted 2026-04-07 00:39:22,112 - lava_callback - INFO - Starting async job submit for node 69d452138fbbb5910331fc14 2026-04-07 00:39:22,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:22,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452138fbbb5910331fc14 HTTP/1.1" 200 None 2026-04-07 00:39:22,172 - lava_callback - DEBUG - Processing node 69d452138fbbb5910331fc14: baseline-x86 2026-04-07 00:39:22,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:22,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:22,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d452138fbbb5910331fc14/log.txt.gz 2026-04-07 00:39:22,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:22,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:23,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d452138fbbb5910331fc14/lava-logs.yaml 2026-04-07 00:39:23,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:39:23,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:39:23,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d452138fbbb5910331fc14/lava_callback.json.gz 2026-04-07 00:39:23,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:23,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452138fbbb5910331fc14 HTTP/1.1" 200 None 2026-04-07 00:39:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:23,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 00:39:23,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:23,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452138fbbb5910331fc14 HTTP/1.1" 200 None 2026-04-07 00:39:23,632 - lava_callback - INFO - Completed processing callback for node 69d452138fbbb5910331fc14 2026-04-07 00:39:26,098 - lava_callback - INFO - Received callback for node 69d1af33aa48d6fae7bb08f2 INFO: 172.21.0.1:53540 - "POST /node/69d1af33aa48d6fae7bb08f2 HTTP/1.0" 202 Accepted 2026-04-07 00:39:26,105 - lava_callback - INFO - Starting async job submit for node 69d1af33aa48d6fae7bb08f2 2026-04-07 00:39:26,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:26,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af33aa48d6fae7bb08f2 HTTP/1.1" 200 None 2026-04-07 00:39:26,124 - lava_callback - DEBUG - Processing node 69d1af33aa48d6fae7bb08f2: baseline-arm-clabbe 2026-04-07 00:39:26,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af33aa48d6fae7bb08f2 2026-04-07 00:39:26,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:26,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af33aa48d6fae7bb08f2 HTTP/1.1" 200 None 2026-04-07 00:39:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:26,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:39:26,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:26,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af33aa48d6fae7bb08f2 HTTP/1.1" 200 None 2026-04-07 00:39:26,203 - lava_callback - ERROR - Error processing callback for node 69d1af33aa48d6fae7bb08f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:39:49,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:39:49,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:06,933 - lava_callback - INFO - Received callback for node 69d1af52aa48d6fae7bb091d INFO: 172.21.0.1:33840 - "POST /node/69d1af52aa48d6fae7bb091d HTTP/1.0" 202 Accepted 2026-04-07 00:40:06,942 - lava_callback - INFO - Starting async job submit for node 69d1af52aa48d6fae7bb091d 2026-04-07 00:40:06,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:06,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af52aa48d6fae7bb091d HTTP/1.1" 200 None 2026-04-07 00:40:06,971 - lava_callback - DEBUG - Processing node 69d1af52aa48d6fae7bb091d: baseline-arm-baylibre 2026-04-07 00:40:06,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af52aa48d6fae7bb091d 2026-04-07 00:40:06,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:06,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af52aa48d6fae7bb091d HTTP/1.1" 200 None 2026-04-07 00:40:07,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:07,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:40:07,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:07,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af52aa48d6fae7bb091d HTTP/1.1" 200 None 2026-04-07 00:40:07,062 - lava_callback - ERROR - Error processing callback for node 69d1af52aa48d6fae7bb091d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:10,827 - lava_callback - INFO - Received callback for node 69d452148fbbb5910331fc17 INFO: 172.21.0.1:55808 - "POST /node/69d452148fbbb5910331fc17 HTTP/1.0" 202 Accepted 2026-04-07 00:40:10,833 - lava_callback - INFO - Starting async job submit for node 69d452148fbbb5910331fc17 2026-04-07 00:40:10,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:10,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452148fbbb5910331fc17 HTTP/1.1" 200 None 2026-04-07 00:40:10,892 - lava_callback - DEBUG - Processing node 69d452148fbbb5910331fc17: baseline-x86 2026-04-07 00:40:11,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:11,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:11,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc17/log.txt.gz 2026-04-07 00:40:11,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:12,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:12,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc17/lava-logs.yaml 2026-04-07 00:40:12,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:12,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:12,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc17/lava_callback.json.gz 2026-04-07 00:40:12,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:12,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452148fbbb5910331fc17 HTTP/1.1" 200 None 2026-04-07 00:40:12,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:12,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 00:40:12,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:12,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452148fbbb5910331fc17 HTTP/1.1" 200 None 2026-04-07 00:40:12,487 - lava_callback - INFO - Completed processing callback for node 69d452148fbbb5910331fc17 INFO: 172.21.0.1:55814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:19,125 - lava_callback - INFO - Received callback for node 69d452168fbbb5910331fc22 INFO: 172.21.0.1:55830 - "POST /node/69d452168fbbb5910331fc22 HTTP/1.0" 202 Accepted 2026-04-07 00:40:19,134 - lava_callback - INFO - Starting async job submit for node 69d452168fbbb5910331fc22 2026-04-07 00:40:19,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:19,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452168fbbb5910331fc22 HTTP/1.1" 200 None 2026-04-07 00:40:19,187 - lava_callback - DEBUG - Processing node 69d452168fbbb5910331fc22: baseline-x86 2026-04-07 00:40:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:40:19,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:19,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:19,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d452168fbbb5910331fc22/log.txt.gz 2026-04-07 00:40:20,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:20,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:20,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d452168fbbb5910331fc22/lava-logs.yaml 2026-04-07 00:40:20,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:20,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:20,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d452168fbbb5910331fc22/lava_callback.json.gz 2026-04-07 00:40:20,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:20,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452168fbbb5910331fc22 HTTP/1.1" 200 None 2026-04-07 00:40:20,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:20,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 00:40:20,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:20,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452168fbbb5910331fc22 HTTP/1.1" 200 None 2026-04-07 00:40:20,829 - lava_callback - INFO - Completed processing callback for node 69d452168fbbb5910331fc22 INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:46,234 - lava_callback - INFO - Received callback for node 69d1af8caa48d6fae7bb09ab INFO: 172.21.0.1:42420 - "POST /node/69d1af8caa48d6fae7bb09ab HTTP/1.0" 202 Accepted 2026-04-07 00:40:46,241 - lava_callback - INFO - Starting async job submit for node 69d1af8caa48d6fae7bb09ab 2026-04-07 00:40:46,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8caa48d6fae7bb09ab HTTP/1.1" 200 None 2026-04-07 00:40:46,257 - lava_callback - DEBUG - Processing node 69d1af8caa48d6fae7bb09ab: baseline-arm-clabbe 2026-04-07 00:40:46,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af8caa48d6fae7bb09ab 2026-04-07 00:40:46,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8caa48d6fae7bb09ab HTTP/1.1" 200 None 2026-04-07 00:40:46,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af8caa48d6fae7bb09ab HTTP/1.1" 200 None 2026-04-07 00:40:46,325 - lava_callback - ERROR - Error processing callback for node 69d1af8caa48d6fae7bb09ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:46,918 - lava_callback - INFO - Received callback for node 69d1af7daa48d6fae7bb097c INFO: 172.21.0.1:42438 - "POST /node/69d1af7daa48d6fae7bb097c HTTP/1.0" 202 Accepted 2026-04-07 00:40:46,924 - lava_callback - INFO - Starting async job submit for node 69d1af7daa48d6fae7bb097c 2026-04-07 00:40:46,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,926 - lava_callback - INFO - Received callback for node 69d1af7caa48d6fae7bb097a 2026-04-07 00:40:46,933 - lava_callback - INFO - Starting async job submit for node 69d1af7caa48d6fae7bb097a 2026-04-07 00:40:46,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42454 - "POST /node/69d1af7caa48d6fae7bb097a HTTP/1.0" 202 Accepted 2026-04-07 00:40:46,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7daa48d6fae7bb097c HTTP/1.1" 200 None 2026-04-07 00:40:46,949 - lava_callback - DEBUG - Processing node 69d1af7daa48d6fae7bb097c: baseline-arm-baylibre 2026-04-07 00:40:46,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af7daa48d6fae7bb097c 2026-04-07 00:40:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7caa48d6fae7bb097a HTTP/1.1" 200 None 2026-04-07 00:40:46,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,952 - lava_callback - DEBUG - Processing node 69d1af7caa48d6fae7bb097a: baseline-arm-clabbe 2026-04-07 00:40:46,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af7caa48d6fae7bb097a 2026-04-07 00:40:46,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7daa48d6fae7bb097c HTTP/1.1" 200 None 2026-04-07 00:40:46,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7caa48d6fae7bb097a HTTP/1.1" 200 None 2026-04-07 00:40:46,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:46,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:46,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:40:46,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:47,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af7daa48d6fae7bb097c HTTP/1.1" 200 None 2026-04-07 00:40:47,025 - lava_callback - ERROR - Error processing callback for node 69d1af7daa48d6fae7bb097c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:47,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af7caa48d6fae7bb097a HTTP/1.1" 200 None 2026-04-07 00:40:47,029 - lava_callback - ERROR - Error processing callback for node 69d1af7caa48d6fae7bb097a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:47,569 - lava_callback - INFO - Received callback for node 69d1af7faa48d6fae7bb0980 INFO: 172.21.0.1:42456 - "POST /node/69d1af7faa48d6fae7bb0980 HTTP/1.0" 202 Accepted 2026-04-07 00:40:47,575 - lava_callback - INFO - Starting async job submit for node 69d1af7faa48d6fae7bb0980 2026-04-07 00:40:47,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:47,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7faa48d6fae7bb0980 HTTP/1.1" 200 None 2026-04-07 00:40:47,593 - lava_callback - DEBUG - Processing node 69d1af7faa48d6fae7bb0980: baseline-arm-baylibre 2026-04-07 00:40:47,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af7faa48d6fae7bb0980 2026-04-07 00:40:47,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:47,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7faa48d6fae7bb0980 HTTP/1.1" 200 None 2026-04-07 00:40:47,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:47,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:47,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:47,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af7faa48d6fae7bb0980 HTTP/1.1" 200 None 2026-04-07 00:40:47,648 - lava_callback - ERROR - Error processing callback for node 69d1af7faa48d6fae7bb0980: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:48,252 - lava_callback - INFO - Received callback for node 69d1af80aa48d6fae7bb0983 INFO: 172.21.0.1:42470 - "POST /node/69d1af80aa48d6fae7bb0983 HTTP/1.0" 202 Accepted 2026-04-07 00:40:48,262 - lava_callback - INFO - Starting async job submit for node 69d1af80aa48d6fae7bb0983 2026-04-07 00:40:48,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af80aa48d6fae7bb0983 HTTP/1.1" 200 None 2026-04-07 00:40:48,279 - lava_callback - DEBUG - Processing node 69d1af80aa48d6fae7bb0983: baseline-arm-baylibre 2026-04-07 00:40:48,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af80aa48d6fae7bb0983 2026-04-07 00:40:48,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af80aa48d6fae7bb0983 HTTP/1.1" 200 None 2026-04-07 00:40:48,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:48,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af80aa48d6fae7bb0983 HTTP/1.1" 200 None 2026-04-07 00:40:48,346 - lava_callback - ERROR - Error processing callback for node 69d1af80aa48d6fae7bb0983: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:48,943 - lava_callback - INFO - Received callback for node 69d1af81aa48d6fae7bb0986 INFO: 172.21.0.1:42480 - "POST /node/69d1af81aa48d6fae7bb0986 HTTP/1.0" 202 Accepted 2026-04-07 00:40:48,948 - lava_callback - INFO - Starting async job submit for node 69d1af81aa48d6fae7bb0986 2026-04-07 00:40:48,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af81aa48d6fae7bb0986 HTTP/1.1" 200 None 2026-04-07 00:40:48,963 - lava_callback - DEBUG - Processing node 69d1af81aa48d6fae7bb0986: baseline-arm-baylibre 2026-04-07 00:40:48,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af81aa48d6fae7bb0986 2026-04-07 00:40:48,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af81aa48d6fae7bb0986 HTTP/1.1" 200 None 2026-04-07 00:40:48,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:48,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:48,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af81aa48d6fae7bb0986 HTTP/1.1" 200 None 2026-04-07 00:40:49,034 - lava_callback - ERROR - Error processing callback for node 69d1af81aa48d6fae7bb0986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:49,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:40:49,599 - lava_callback - INFO - Received callback for node 69d1af84aa48d6fae7bb0991 INFO: 172.21.0.1:42490 - "POST /node/69d1af84aa48d6fae7bb0991 HTTP/1.0" 202 Accepted 2026-04-07 00:40:49,605 - lava_callback - INFO - Starting async job submit for node 69d1af84aa48d6fae7bb0991 2026-04-07 00:40:49,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af84aa48d6fae7bb0991 HTTP/1.1" 200 None 2026-04-07 00:40:49,628 - lava_callback - DEBUG - Processing node 69d1af84aa48d6fae7bb0991: baseline-arm-baylibre 2026-04-07 00:40:49,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af84aa48d6fae7bb0991 2026-04-07 00:40:49,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af84aa48d6fae7bb0991 HTTP/1.1" 200 None 2026-04-07 00:40:49,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:49,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af84aa48d6fae7bb0991 HTTP/1.1" 200 None 2026-04-07 00:40:49,689 - lava_callback - ERROR - Error processing callback for node 69d1af84aa48d6fae7bb0991: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:40:50,278 - lava_callback - INFO - Received callback for node 69d1af85aa48d6fae7bb0994 INFO: 172.21.0.1:34656 - "POST /node/69d1af85aa48d6fae7bb0994 HTTP/1.0" 202 Accepted 2026-04-07 00:40:50,284 - lava_callback - INFO - Starting async job submit for node 69d1af85aa48d6fae7bb0994 2026-04-07 00:40:50,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:50,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af85aa48d6fae7bb0994 HTTP/1.1" 200 None 2026-04-07 00:40:50,308 - lava_callback - DEBUG - Processing node 69d1af85aa48d6fae7bb0994: baseline-arm-baylibre 2026-04-07 00:40:50,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af85aa48d6fae7bb0994 2026-04-07 00:40:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:50,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af85aa48d6fae7bb0994 HTTP/1.1" 200 None 2026-04-07 00:40:50,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:50,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:40:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:50,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af85aa48d6fae7bb0994 HTTP/1.1" 200 None 2026-04-07 00:40:50,364 - lava_callback - ERROR - Error processing callback for node 69d1af85aa48d6fae7bb0994: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:40:56,601 - lava_callback - INFO - Received callback for node 69d4519c8fbbb5910331faf1 INFO: 172.21.0.1:34678 - "POST /node/69d4519c8fbbb5910331faf1 HTTP/1.0" 202 Accepted 2026-04-07 00:40:56,611 - lava_callback - INFO - Starting async job submit for node 69d4519c8fbbb5910331faf1 2026-04-07 00:40:56,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:56,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519c8fbbb5910331faf1 HTTP/1.1" 200 None 2026-04-07 00:40:56,659 - lava_callback - DEBUG - Processing node 69d4519c8fbbb5910331faf1: ltp-controllers 2026-04-07 00:40:57,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:57,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:57,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4519c8fbbb5910331faf1/log.txt.gz 2026-04-07 00:40:57,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:57,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:57,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4519c8fbbb5910331faf1/lava-logs.yaml 2026-04-07 00:40:57,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:58,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:58,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d4519c8fbbb5910331faf1/lava_callback.json.gz 2026-04-07 00:40:58,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:58,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519c8fbbb5910331faf1 HTTP/1.1" 200 None 2026-04-07 00:40:58,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:58,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:40:58,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4519c8fbbb5910331faf1 HTTP/1.1" 200 None 2026-04-07 00:40:58,112 - lava_callback - INFO - Completed processing callback for node 69d4519c8fbbb5910331faf1 2026-04-07 00:40:58,315 - lava_callback - INFO - Received callback for node 69d451aa8fbbb5910331fb4e INFO: 172.21.0.1:34680 - "POST /node/69d451aa8fbbb5910331fb4e HTTP/1.0" 202 Accepted 2026-04-07 00:40:58,323 - lava_callback - INFO - Starting async job submit for node 69d451aa8fbbb5910331fb4e 2026-04-07 00:40:58,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:40:58,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451aa8fbbb5910331fb4e HTTP/1.1" 200 None 2026-04-07 00:40:58,365 - lava_callback - DEBUG - Processing node 69d451aa8fbbb5910331fb4e: ltp-syscalls 2026-04-07 00:40:59,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:59,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:40:59,357 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d451aa8fbbb5910331fb4e/log.txt.gz 2026-04-07 00:40:59,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:40:59,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:00,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d451aa8fbbb5910331fb4e/lava-logs.yaml 2026-04-07 00:41:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:00,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:00,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d451aa8fbbb5910331fb4e/lava_callback.json.gz 2026-04-07 00:41:00,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:00,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451aa8fbbb5910331fb4e HTTP/1.1" 200 None 2026-04-07 00:41:00,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:00,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:41:00,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:00,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451aa8fbbb5910331fb4e HTTP/1.1" 200 None 2026-04-07 00:41:00,277 - lava_callback - INFO - Completed processing callback for node 69d451aa8fbbb5910331fb4e 2026-04-07 00:41:06,135 - lava_callback - INFO - Received callback for node 69d1af8daa48d6fae7bb09b1 INFO: 172.21.0.1:53674 - "POST /node/69d1af8daa48d6fae7bb09b1 HTTP/1.0" 202 Accepted 2026-04-07 00:41:06,142 - lava_callback - INFO - Starting async job submit for node 69d1af8daa48d6fae7bb09b1 2026-04-07 00:41:06,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8daa48d6fae7bb09b1 HTTP/1.1" 200 None 2026-04-07 00:41:06,160 - lava_callback - DEBUG - Processing node 69d1af8daa48d6fae7bb09b1: baseline-arm-clabbe 2026-04-07 00:41:06,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af8daa48d6fae7bb09b1 2026-04-07 00:41:06,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8daa48d6fae7bb09b1 HTTP/1.1" 200 None 2026-04-07 00:41:06,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af8daa48d6fae7bb09b1 HTTP/1.1" 200 None 2026-04-07 00:41:06,221 - lava_callback - ERROR - Error processing callback for node 69d1af8daa48d6fae7bb09b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:41:06,831 - lava_callback - INFO - Received callback for node 69d1af8eaa48d6fae7bb09e7 INFO: 172.21.0.1:53692 - "POST /node/69d1af8eaa48d6fae7bb09e7 HTTP/1.0" 202 Accepted 2026-04-07 00:41:06,840 - lava_callback - INFO - Starting async job submit for node 69d1af8eaa48d6fae7bb09e7 2026-04-07 00:41:06,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8eaa48d6fae7bb09e7 HTTP/1.1" 200 None 2026-04-07 00:41:06,855 - lava_callback - DEBUG - Processing node 69d1af8eaa48d6fae7bb09e7: baseline-arm-clabbe 2026-04-07 00:41:06,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af8eaa48d6fae7bb09e7 2026-04-07 00:41:06,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8eaa48d6fae7bb09e7 HTTP/1.1" 200 None 2026-04-07 00:41:06,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:06,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:06,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af8eaa48d6fae7bb09e7 HTTP/1.1" 200 None 2026-04-07 00:41:06,940 - lava_callback - ERROR - Error processing callback for node 69d1af8eaa48d6fae7bb09e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:41:07,514 - lava_callback - INFO - Received callback for node 69d1af8faa48d6fae7bb09ea INFO: 172.21.0.1:53700 - "POST /node/69d1af8faa48d6fae7bb09ea HTTP/1.0" 202 Accepted 2026-04-07 00:41:07,523 - lava_callback - INFO - Starting async job submit for node 69d1af8faa48d6fae7bb09ea 2026-04-07 00:41:07,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:07,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8faa48d6fae7bb09ea HTTP/1.1" 200 None 2026-04-07 00:41:07,543 - lava_callback - DEBUG - Processing node 69d1af8faa48d6fae7bb09ea: baseline-arm-clabbe 2026-04-07 00:41:07,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af8faa48d6fae7bb09ea 2026-04-07 00:41:07,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8faa48d6fae7bb09ea HTTP/1.1" 200 None 2026-04-07 00:41:07,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:07,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:07,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:07,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af8faa48d6fae7bb09ea HTTP/1.1" 200 None 2026-04-07 00:41:07,616 - lava_callback - ERROR - Error processing callback for node 69d1af8faa48d6fae7bb09ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:41:08,173 - lava_callback - INFO - Received callback for node 69d1af90aa48d6fae7bb09ef INFO: 172.21.0.1:53702 - "POST /node/69d1af90aa48d6fae7bb09ef HTTP/1.0" 202 Accepted 2026-04-07 00:41:08,179 - lava_callback - INFO - Starting async job submit for node 69d1af90aa48d6fae7bb09ef 2026-04-07 00:41:08,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af90aa48d6fae7bb09ef HTTP/1.1" 200 None 2026-04-07 00:41:08,201 - lava_callback - DEBUG - Processing node 69d1af90aa48d6fae7bb09ef: baseline-arm-clabbe 2026-04-07 00:41:08,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af90aa48d6fae7bb09ef 2026-04-07 00:41:08,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af90aa48d6fae7bb09ef HTTP/1.1" 200 None 2026-04-07 00:41:08,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:08,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af90aa48d6fae7bb09ef HTTP/1.1" 200 None 2026-04-07 00:41:08,263 - lava_callback - ERROR - Error processing callback for node 69d1af90aa48d6fae7bb09ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:41:08,550 - lava_callback - INFO - Received callback for node 69d451a38fbbb5910331fb0b INFO: 172.21.0.1:53714 - "POST /node/69d451a38fbbb5910331fb0b HTTP/1.0" 202 Accepted 2026-04-07 00:41:08,557 - lava_callback - INFO - Starting async job submit for node 69d451a38fbbb5910331fb0b 2026-04-07 00:41:08,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a38fbbb5910331fb0b HTTP/1.1" 200 None 2026-04-07 00:41:08,598 - lava_callback - DEBUG - Processing node 69d451a38fbbb5910331fb0b: ltp-input 2026-04-07 00:41:08,865 - lava_callback - INFO - Received callback for node 69d1af91aa48d6fae7bb09f2 INFO: 172.21.0.1:53722 - "POST /node/69d1af91aa48d6fae7bb09f2 HTTP/1.0" 202 Accepted 2026-04-07 00:41:08,882 - lava_callback - INFO - Starting async job submit for node 69d1af91aa48d6fae7bb09f2 2026-04-07 00:41:08,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af91aa48d6fae7bb09f2 HTTP/1.1" 200 None 2026-04-07 00:41:08,979 - lava_callback - DEBUG - Processing node 69d1af91aa48d6fae7bb09f2: baseline-arm-clabbe 2026-04-07 00:41:08,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af91aa48d6fae7bb09f2 2026-04-07 00:41:08,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:08,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:08,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af91aa48d6fae7bb09f2 HTTP/1.1" 200 None 2026-04-07 00:41:09,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:09,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af91aa48d6fae7bb09f2 HTTP/1.1" 200 None 2026-04-07 00:41:09,062 - lava_callback - ERROR - Error processing callback for node 69d1af91aa48d6fae7bb09f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:41:09,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:09,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d451a38fbbb5910331fb0b/log.txt.gz 2026-04-07 00:41:09,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:09,536 - lava_callback - INFO - Received callback for node 69d1af92aa48d6fae7bb09f9 INFO: 172.21.0.1:53728 - "POST /node/69d1af92aa48d6fae7bb09f9 HTTP/1.0" 202 Accepted 2026-04-07 00:41:09,543 - lava_callback - INFO - Starting async job submit for node 69d1af92aa48d6fae7bb09f9 2026-04-07 00:41:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af92aa48d6fae7bb09f9 HTTP/1.1" 200 None 2026-04-07 00:41:09,559 - lava_callback - DEBUG - Processing node 69d1af92aa48d6fae7bb09f9: baseline-arm-clabbe 2026-04-07 00:41:09,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af92aa48d6fae7bb09f9 2026-04-07 00:41:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af92aa48d6fae7bb09f9 HTTP/1.1" 200 None 2026-04-07 00:41:09,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:09,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:09,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af92aa48d6fae7bb09f9 HTTP/1.1" 200 None 2026-04-07 00:41:09,613 - lava_callback - ERROR - Error processing callback for node 69d1af92aa48d6fae7bb09f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:41:09,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:09,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d451a38fbbb5910331fb0b/lava-logs.yaml 2026-04-07 00:41:09,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:10,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:10,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d451a38fbbb5910331fb0b/lava_callback.json.gz 2026-04-07 00:41:10,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a38fbbb5910331fb0b HTTP/1.1" 200 None 2026-04-07 00:41:10,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:41:10,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451a38fbbb5910331fb0b HTTP/1.1" 200 None 2026-04-07 00:41:10,156 - lava_callback - INFO - Completed processing callback for node 69d451a38fbbb5910331fb0b 2026-04-07 00:41:10,198 - lava_callback - INFO - Received callback for node 69d1af93aa48d6fae7bb0a03 INFO: 172.21.0.1:52924 - "POST /node/69d1af93aa48d6fae7bb0a03 HTTP/1.0" 202 Accepted 2026-04-07 00:41:10,208 - lava_callback - INFO - Starting async job submit for node 69d1af93aa48d6fae7bb0a03 2026-04-07 00:41:10,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af93aa48d6fae7bb0a03 HTTP/1.1" 200 None 2026-04-07 00:41:10,226 - lava_callback - DEBUG - Processing node 69d1af93aa48d6fae7bb0a03: baseline-arm-clabbe 2026-04-07 00:41:10,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1af93aa48d6fae7bb0a03 2026-04-07 00:41:10,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af93aa48d6fae7bb0a03 HTTP/1.1" 200 None 2026-04-07 00:41:10,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:41:10,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:10,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af93aa48d6fae7bb0a03 HTTP/1.1" 200 None 2026-04-07 00:41:10,299 - lava_callback - ERROR - Error processing callback for node 69d1af93aa48d6fae7bb0a03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:41:16,794 - lava_callback - INFO - Received callback for node 69d4519a8fbbb5910331faee INFO: 172.21.0.1:52964 - "POST /node/69d4519a8fbbb5910331faee HTTP/1.0" 202 Accepted 2026-04-07 00:41:16,801 - lava_callback - INFO - Starting async job submit for node 69d4519a8fbbb5910331faee 2026-04-07 00:41:16,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:16,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519a8fbbb5910331faee HTTP/1.1" 200 None 2026-04-07 00:41:16,852 - lava_callback - DEBUG - Processing node 69d4519a8fbbb5910331faee: ltp-containers 2026-04-07 00:41:17,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:17,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:17,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d4519a8fbbb5910331faee/log.txt.gz 2026-04-07 00:41:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:18,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:18,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d4519a8fbbb5910331faee/lava-logs.yaml 2026-04-07 00:41:18,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:18,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:18,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d4519a8fbbb5910331faee/lava_callback.json.gz 2026-04-07 00:41:18,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:18,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519a8fbbb5910331faee HTTP/1.1" 200 None 2026-04-07 00:41:18,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:18,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:41:18,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:18,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4519a8fbbb5910331faee HTTP/1.1" 200 None 2026-04-07 00:41:18,365 - lava_callback - INFO - Completed processing callback for node 69d4519a8fbbb5910331faee 2026-04-07 00:41:18,396 - lava_callback - INFO - Received callback for node 69d4519e8fbbb5910331faf4 INFO: 172.21.0.1:52974 - "POST /node/69d4519e8fbbb5910331faf4 HTTP/1.0" 202 Accepted 2026-04-07 00:41:18,412 - lava_callback - INFO - Starting async job submit for node 69d4519e8fbbb5910331faf4 2026-04-07 00:41:18,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:18,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519e8fbbb5910331faf4 HTTP/1.1" 200 None 2026-04-07 00:41:18,472 - lava_callback - DEBUG - Processing node 69d4519e8fbbb5910331faf4: ltp-cve 2026-04-07 00:41:18,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:19,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:19,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d4519e8fbbb5910331faf4/log.txt.gz 2026-04-07 00:41:19,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:19,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:19,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:41:19,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:19,523 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d4519e8fbbb5910331faf4/lava-logs.yaml 2026-04-07 00:41:19,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:19,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:19,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d4519e8fbbb5910331faf4/lava_callback.json.gz 2026-04-07 00:41:19,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:19,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4519e8fbbb5910331faf4 HTTP/1.1" 200 None 2026-04-07 00:41:19,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:19,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:41:19,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:19,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4519e8fbbb5910331faf4 HTTP/1.1" 200 None 2026-04-07 00:41:19,825 - lava_callback - INFO - Completed processing callback for node 69d4519e8fbbb5910331faf4 INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:41:49,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:49,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:41:56,565 - lava_callback - INFO - Received callback for node 69d451a58fbbb5910331fb45 INFO: 172.21.0.1:47710 - "POST /node/69d451a58fbbb5910331fb45 HTTP/1.0" 202 Accepted 2026-04-07 00:41:56,572 - lava_callback - INFO - Starting async job submit for node 69d451a58fbbb5910331fb45 2026-04-07 00:41:56,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:56,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a58fbbb5910331fb45 HTTP/1.1" 200 None 2026-04-07 00:41:56,612 - lava_callback - DEBUG - Processing node 69d451a58fbbb5910331fb45: ltp-pty 2026-04-07 00:41:56,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:57,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:57,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d451a58fbbb5910331fb45/log.txt.gz 2026-04-07 00:41:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:57,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:57,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d451a58fbbb5910331fb45/lava-logs.yaml 2026-04-07 00:41:57,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:41:57,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:41:57,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d451a58fbbb5910331fb45/lava_callback.json.gz 2026-04-07 00:41:57,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:57,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a58fbbb5910331fb45 HTTP/1.1" 200 None 2026-04-07 00:41:57,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:57,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:41:57,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:41:57,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451a58fbbb5910331fb45 HTTP/1.1" 200 None 2026-04-07 00:41:57,881 - lava_callback - INFO - Completed processing callback for node 69d451a58fbbb5910331fb45 INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:42:19,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:42:19,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:44:56,707 - lava_callback - INFO - Received callback for node 69d451a88fbbb5910331fb4b INFO: 172.21.0.1:44894 - "POST /node/69d451a88fbbb5910331fb4b HTTP/1.0" 202 Accepted 2026-04-07 00:44:56,714 - lava_callback - INFO - Starting async job submit for node 69d451a88fbbb5910331fb4b 2026-04-07 00:44:56,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:44:56,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a88fbbb5910331fb4b HTTP/1.1" 200 None 2026-04-07 00:44:56,772 - lava_callback - DEBUG - Processing node 69d451a88fbbb5910331fb4b: ltp-smoke 2026-04-07 00:44:57,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:44:57,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:44:57,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d451a88fbbb5910331fb4b/log.txt.gz 2026-04-07 00:44:57,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:44:57,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:44:57,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d451a88fbbb5910331fb4b/lava-logs.yaml 2026-04-07 00:44:57,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:44:58,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:44:58,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d451a88fbbb5910331fb4b/lava_callback.json.gz 2026-04-07 00:44:58,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:44:58,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a88fbbb5910331fb4b HTTP/1.1" 200 None 2026-04-07 00:44:58,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:44:58,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:44:58,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:44:58,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451a88fbbb5910331fb4b HTTP/1.1" 200 None 2026-04-07 00:44:58,150 - lava_callback - INFO - Completed processing callback for node 69d451a88fbbb5910331fb4b INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:45:19,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:45:19,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51010 - "GET /node/6953739a31522df6df79de0a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:45:56,756 - lava_callback - INFO - Received callback for node 69d451ad8fbbb5910331fb58 INFO: 172.21.0.1:45222 - "POST /node/69d451ad8fbbb5910331fb58 HTTP/1.0" 202 Accepted 2026-04-07 00:45:56,762 - lava_callback - INFO - Starting async job submit for node 69d451ad8fbbb5910331fb58 2026-04-07 00:45:56,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:45:56,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451ad8fbbb5910331fb58 HTTP/1.1" 200 None 2026-04-07 00:45:56,803 - lava_callback - DEBUG - Processing node 69d451ad8fbbb5910331fb58: ltp-timers 2026-04-07 00:45:57,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:45:57,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:45:57,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d451ad8fbbb5910331fb58/log.txt.gz 2026-04-07 00:45:57,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:45:57,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:45:57,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d451ad8fbbb5910331fb58/lava-logs.yaml 2026-04-07 00:45:57,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:45:58,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:45:58,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d451ad8fbbb5910331fb58/lava_callback.json.gz 2026-04-07 00:45:58,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:45:58,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451ad8fbbb5910331fb58 HTTP/1.1" 200 None 2026-04-07 00:45:58,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:45:58,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:45:58,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:45:58,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451ad8fbbb5910331fb58 HTTP/1.1" 200 None 2026-04-07 00:45:58,136 - lava_callback - INFO - Completed processing callback for node 69d451ad8fbbb5910331fb58 INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:46:14,641 - lava_callback - INFO - Received callback for node 69d453ca8fbbb5910331fe46 INFO: 172.21.0.1:37658 - "POST /node/69d453ca8fbbb5910331fe46 HTTP/1.0" 202 Accepted 2026-04-07 00:46:14,647 - lava_callback - INFO - Starting async job submit for node 69d453ca8fbbb5910331fe46 2026-04-07 00:46:14,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:14,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d453ca8fbbb5910331fe46 HTTP/1.1" 200 None 2026-04-07 00:46:14,665 - lava_callback - DEBUG - Processing node 69d453ca8fbbb5910331fe46: baseline-arm 2026-04-07 00:46:14,670 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:46:14,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:46:14,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:46:14,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d453ca8fbbb5910331fe46/lava-logs.yaml 2026-04-07 00:46:14,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:46:15,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:46:15,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d453ca8fbbb5910331fe46/lava_callback.json.gz 2026-04-07 00:46:15,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:15,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d453ca8fbbb5910331fe46 HTTP/1.1" 200 None 2026-04-07 00:46:15,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:15,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:46:15,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:15,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d453ca8fbbb5910331fe46 HTTP/1.1" 200 None 2026-04-07 00:46:15,127 - lava_callback - INFO - Completed processing callback for node 69d453ca8fbbb5910331fe46 INFO: 172.21.0.1:37664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:46:19,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:19,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:46:26,454 - lava_callback - INFO - Received callback for node 69d1b0ceaa48d6fae7bb0c35 INFO: 172.21.0.1:47580 - "POST /node/69d1b0ceaa48d6fae7bb0c35 HTTP/1.0" 202 Accepted 2026-04-07 00:46:26,463 - lava_callback - INFO - Starting async job submit for node 69d1b0ceaa48d6fae7bb0c35 2026-04-07 00:46:26,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:26,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b0ceaa48d6fae7bb0c35 HTTP/1.1" 200 None 2026-04-07 00:46:26,484 - lava_callback - DEBUG - Processing node 69d1b0ceaa48d6fae7bb0c35: baseline-arm-clabbe 2026-04-07 00:46:26,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b0ceaa48d6fae7bb0c35 2026-04-07 00:46:26,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:26,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b0ceaa48d6fae7bb0c35 HTTP/1.1" 200 None 2026-04-07 00:46:26,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:46:26,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:46:26,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:46:26,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b0ceaa48d6fae7bb0c35 HTTP/1.1" 200 None 2026-04-07 00:46:26,571 - lava_callback - ERROR - Error processing callback for node 69d1b0ceaa48d6fae7bb0c35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:48:28,707 - lava_callback - INFO - Received callback for node 69d451a78fbbb5910331fb48 INFO: 172.21.0.1:50788 - "POST /node/69d451a78fbbb5910331fb48 HTTP/1.0" 202 Accepted 2026-04-07 00:48:28,714 - lava_callback - INFO - Starting async job submit for node 69d451a78fbbb5910331fb48 2026-04-07 00:48:28,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:28,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a78fbbb5910331fb48 HTTP/1.1" 200 None 2026-04-07 00:48:28,769 - lava_callback - DEBUG - Processing node 69d451a78fbbb5910331fb48: ltp-sched 2026-04-07 00:48:29,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:29,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:29,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d451a78fbbb5910331fb48/log.txt.gz 2026-04-07 00:48:30,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:30,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:30,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d451a78fbbb5910331fb48/lava-logs.yaml 2026-04-07 00:48:30,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:30,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:30,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d451a78fbbb5910331fb48/lava_callback.json.gz 2026-04-07 00:48:31,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:31,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451a78fbbb5910331fb48 HTTP/1.1" 200 None 2026-04-07 00:48:31,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:31,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:48:31,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:31,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451a78fbbb5910331fb48 HTTP/1.1" 200 None 2026-04-07 00:48:31,142 - lava_callback - INFO - Completed processing callback for node 69d451a78fbbb5910331fb48 INFO: 172.21.0.1:56574 - "GET /node/698a7e36d9a1cfa777a2262f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:48:49,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:49,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:48:56,827 - lava_callback - INFO - Received callback for node 69d452b08fbbb5910331fd43 INFO: 172.21.0.1:54930 - "POST /node/69d452b08fbbb5910331fd43 HTTP/1.0" 202 Accepted 2026-04-07 00:48:56,838 - lava_callback - INFO - Starting async job submit for node 69d452b08fbbb5910331fd43 2026-04-07 00:48:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:56,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452b08fbbb5910331fd43 HTTP/1.1" 200 None 2026-04-07 00:48:56,887 - lava_callback - DEBUG - Processing node 69d452b08fbbb5910331fd43: ltp-cap_bounds 2026-04-07 00:48:57,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:57,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:57,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d452b08fbbb5910331fd43/log.txt.gz 2026-04-07 00:48:57,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:58,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:58,104 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d452b08fbbb5910331fd43/lava-logs.yaml 2026-04-07 00:48:58,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:48:58,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:48:58,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d452b08fbbb5910331fd43/lava_callback.json.gz 2026-04-07 00:48:58,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452b08fbbb5910331fd43 HTTP/1.1" 200 None 2026-04-07 00:48:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:58,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:48:58,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:48:58,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452b08fbbb5910331fd43 HTTP/1.1" 200 None 2026-04-07 00:48:58,656 - lava_callback - INFO - Completed processing callback for node 69d452b08fbbb5910331fd43 INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42380 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:13,170 - lava_callback - INFO - Received callback for node 69d454828fbbb5910331ff3e INFO: 172.21.0.1:42392 - "POST /node/69d454828fbbb5910331ff3e HTTP/1.0" 202 Accepted 2026-04-07 00:49:13,176 - lava_callback - INFO - Starting async job submit for node 69d454828fbbb5910331ff3e 2026-04-07 00:49:13,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454828fbbb5910331ff3e HTTP/1.1" 200 None 2026-04-07 00:49:13,202 - lava_callback - DEBUG - Processing node 69d454828fbbb5910331ff3e: baseline-nfs-arm64 2026-04-07 00:49:13,203 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:49:13,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:13,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:13,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454828fbbb5910331ff3e/lava-logs.yaml 2026-04-07 00:49:13,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:13,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:13,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454828fbbb5910331ff3e/lava_callback.json.gz 2026-04-07 00:49:13,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:13,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454828fbbb5910331ff3e HTTP/1.1" 200 None 2026-04-07 00:49:13,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:13,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:13,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:13,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454828fbbb5910331ff3e HTTP/1.1" 200 None 2026-04-07 00:49:13,612 - lava_callback - INFO - Completed processing callback for node 69d454828fbbb5910331ff3e INFO: 172.21.0.1:42396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:16,856 - lava_callback - INFO - Received callback for node 69d451af8fbbb5910331fb5b INFO: 172.21.0.1:42414 - "POST /node/69d451af8fbbb5910331fb5b HTTP/1.0" 202 Accepted 2026-04-07 00:49:16,862 - lava_callback - INFO - Starting async job submit for node 69d451af8fbbb5910331fb5b 2026-04-07 00:49:16,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:16,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451af8fbbb5910331fb5b HTTP/1.1" 200 None 2026-04-07 00:49:16,970 - lava_callback - DEBUG - Processing node 69d451af8fbbb5910331fb5b: ltp-watchqueue 2026-04-07 00:49:17,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:17,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:17,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d451af8fbbb5910331fb5b/log.txt.gz 2026-04-07 00:49:18,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:18,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:18,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d451af8fbbb5910331fb5b/lava-logs.yaml 2026-04-07 00:49:18,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:18,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:18,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d451af8fbbb5910331fb5b/lava_callback.json.gz 2026-04-07 00:49:18,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:18,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451af8fbbb5910331fb5b HTTP/1.1" 200 None 2026-04-07 00:49:18,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:18,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:49:18,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:18,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451af8fbbb5910331fb5b HTTP/1.1" 200 None 2026-04-07 00:49:18,841 - lava_callback - INFO - Completed processing callback for node 69d451af8fbbb5910331fb5b 2026-04-07 00:49:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:19,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:30,695 - lava_callback - INFO - Received callback for node 69d454708fbbb5910331ff04 INFO: 172.21.0.1:55046 - "POST /node/69d454708fbbb5910331ff04 HTTP/1.0" 202 Accepted 2026-04-07 00:49:30,704 - lava_callback - INFO - Starting async job submit for node 69d454708fbbb5910331ff04 2026-04-07 00:49:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:30,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454708fbbb5910331ff04 HTTP/1.1" 200 None 2026-04-07 00:49:30,744 - lava_callback - DEBUG - Processing node 69d454708fbbb5910331ff04: baseline-arm64 2026-04-07 00:49:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:31,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:31,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454708fbbb5910331ff04/log.txt.gz 2026-04-07 00:49:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:31,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:31,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454708fbbb5910331ff04/lava-logs.yaml 2026-04-07 00:49:31,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:31,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:31,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454708fbbb5910331ff04/lava_callback.json.gz 2026-04-07 00:49:31,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:31,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454708fbbb5910331ff04 HTTP/1.1" 200 None 2026-04-07 00:49:31,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:31,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:31,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:31,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454708fbbb5910331ff04 HTTP/1.1" 200 None 2026-04-07 00:49:31,720 - lava_callback - INFO - Completed processing callback for node 69d454708fbbb5910331ff04 2026-04-07 00:49:33,509 - lava_callback - INFO - Received callback for node 69d454648fbbb5910331feb1 INFO: 172.21.0.1:55050 - "POST /node/69d454648fbbb5910331feb1 HTTP/1.0" 202 Accepted 2026-04-07 00:49:33,521 - lava_callback - INFO - Starting async job submit for node 69d454648fbbb5910331feb1 2026-04-07 00:49:33,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:33,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454648fbbb5910331feb1 HTTP/1.1" 200 None 2026-04-07 00:49:33,606 - lava_callback - DEBUG - Processing node 69d454648fbbb5910331feb1: baseline-arm64 2026-04-07 00:49:33,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:34,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:34,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb1/log.txt.gz 2026-04-07 00:49:34,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:34,210 - lava_callback - INFO - Received callback for node 69d4546c8fbbb5910331fec9 INFO: 172.21.0.1:55052 - "POST /node/69d4546c8fbbb5910331fec9 HTTP/1.0" 202 Accepted 2026-04-07 00:49:34,218 - lava_callback - INFO - Starting async job submit for node 69d4546c8fbbb5910331fec9 2026-04-07 00:49:34,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:34,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546c8fbbb5910331fec9 HTTP/1.1" 200 None 2026-04-07 00:49:34,256 - lava_callback - DEBUG - Processing node 69d4546c8fbbb5910331fec9: baseline-arm64 2026-04-07 00:49:34,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:34,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb1/lava-logs.yaml 2026-04-07 00:49:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:34,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:34,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb1/lava_callback.json.gz 2026-04-07 00:49:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:34,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:34,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454648fbbb5910331feb1 HTTP/1.1" 200 None 2026-04-07 00:49:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:34,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:34,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:34,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454648fbbb5910331feb1 HTTP/1.1" 200 None 2026-04-07 00:49:34,924 - lava_callback - INFO - Completed processing callback for node 69d454648fbbb5910331feb1 2026-04-07 00:49:35,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:35,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546c8fbbb5910331fec9/log.txt.gz 2026-04-07 00:49:35,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:35,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:35,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546c8fbbb5910331fec9/lava-logs.yaml 2026-04-07 00:49:35,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:35,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:35,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546c8fbbb5910331fec9/lava_callback.json.gz 2026-04-07 00:49:35,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:35,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546c8fbbb5910331fec9 HTTP/1.1" 200 None 2026-04-07 00:49:35,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:35,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:35,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:35,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4546c8fbbb5910331fec9 HTTP/1.1" 200 None 2026-04-07 00:49:35,785 - lava_callback - INFO - Completed processing callback for node 69d4546c8fbbb5910331fec9 INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:46,492 - lava_callback - INFO - Received callback for node 69d1b1a2aa48d6fae7bb0cf2 INFO: 172.21.0.1:41708 - "POST /node/69d1b1a2aa48d6fae7bb0cf2 HTTP/1.0" 202 Accepted 2026-04-07 00:49:46,498 - lava_callback - INFO - Starting async job submit for node 69d1b1a2aa48d6fae7bb0cf2 2026-04-07 00:49:46,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:46,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b1a2aa48d6fae7bb0cf2 HTTP/1.1" 200 None 2026-04-07 00:49:46,517 - lava_callback - DEBUG - Processing node 69d1b1a2aa48d6fae7bb0cf2: baseline-arm-clabbe 2026-04-07 00:49:46,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b1a2aa48d6fae7bb0cf2 2026-04-07 00:49:46,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:46,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b1a2aa48d6fae7bb0cf2 HTTP/1.1" 200 None 2026-04-07 00:49:46,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:46,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 00:49:46,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:46,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b1a2aa48d6fae7bb0cf2 HTTP/1.1" 200 None 2026-04-07 00:49:46,584 - lava_callback - ERROR - Error processing callback for node 69d1b1a2aa48d6fae7bb0cf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:49:49,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:49,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:49:49,580 - lava_callback - INFO - Received callback for node 69d454678fbbb5910331febd INFO: 172.21.0.1:41718 - "POST /node/69d454678fbbb5910331febd HTTP/1.0" 202 Accepted 2026-04-07 00:49:49,594 - lava_callback - INFO - Starting async job submit for node 69d454678fbbb5910331febd 2026-04-07 00:49:49,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:49,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454678fbbb5910331febd HTTP/1.1" 200 None 2026-04-07 00:49:49,657 - lava_callback - DEBUG - Processing node 69d454678fbbb5910331febd: baseline-arm64 2026-04-07 00:49:49,790 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:49:49,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:50,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:50,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454678fbbb5910331febd/lava-logs.yaml 2026-04-07 00:49:50,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:50,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:50,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454678fbbb5910331febd/lava_callback.json.gz 2026-04-07 00:49:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:50,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454678fbbb5910331febd HTTP/1.1" 200 None 2026-04-07 00:49:50,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:50,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:50,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454678fbbb5910331febd HTTP/1.1" 200 None 2026-04-07 00:49:50,424 - lava_callback - INFO - Completed processing callback for node 69d454678fbbb5910331febd 2026-04-07 00:49:51,391 - lava_callback - INFO - Received callback for node 69d454718fbbb5910331ff0a INFO: 172.21.0.1:34086 - "POST /node/69d454718fbbb5910331ff0a HTTP/1.0" 202 Accepted 2026-04-07 00:49:51,401 - lava_callback - INFO - Starting async job submit for node 69d454718fbbb5910331ff0a 2026-04-07 00:49:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:51,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454718fbbb5910331ff0a HTTP/1.1" 200 None 2026-04-07 00:49:51,463 - lava_callback - DEBUG - Processing node 69d454718fbbb5910331ff0a: baseline-arm64 2026-04-07 00:49:51,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:51,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:51,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454718fbbb5910331ff0a/log.txt.gz 2026-04-07 00:49:52,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:52,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:52,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454718fbbb5910331ff0a/lava-logs.yaml 2026-04-07 00:49:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:52,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:52,421 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454718fbbb5910331ff0a/lava_callback.json.gz 2026-04-07 00:49:52,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454718fbbb5910331ff0a HTTP/1.1" 200 None 2026-04-07 00:49:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:52,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:52,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:52,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454718fbbb5910331ff0a HTTP/1.1" 200 None 2026-04-07 00:49:52,508 - lava_callback - INFO - Completed processing callback for node 69d454718fbbb5910331ff0a 2026-04-07 00:49:55,785 - lava_callback - INFO - Received callback for node 69d454658fbbb5910331feb7 INFO: 172.21.0.1:34090 - "POST /node/69d454658fbbb5910331feb7 HTTP/1.0" 202 Accepted 2026-04-07 00:49:55,795 - lava_callback - INFO - Starting async job submit for node 69d454658fbbb5910331feb7 2026-04-07 00:49:55,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:55,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454658fbbb5910331feb7 HTTP/1.1" 200 None 2026-04-07 00:49:55,841 - lava_callback - DEBUG - Processing node 69d454658fbbb5910331feb7: baseline-arm64 2026-04-07 00:49:56,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:56,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:56,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454658fbbb5910331feb7/log.txt.gz INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:49:56,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:56,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:56,862 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454658fbbb5910331feb7/lava-logs.yaml 2026-04-07 00:49:56,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:57,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:57,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454658fbbb5910331feb7/lava_callback.json.gz 2026-04-07 00:49:57,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:57,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454658fbbb5910331feb7 HTTP/1.1" 200 None 2026-04-07 00:49:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:57,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:49:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:57,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454658fbbb5910331feb7 HTTP/1.1" 200 None 2026-04-07 00:49:57,111 - lava_callback - INFO - Completed processing callback for node 69d454658fbbb5910331feb7 2026-04-07 00:49:59,127 - lava_callback - INFO - Received callback for node 69d4546b8fbbb5910331fec6 INFO: 172.21.0.1:34106 - "POST /node/69d4546b8fbbb5910331fec6 HTTP/1.0" 202 Accepted 2026-04-07 00:49:59,134 - lava_callback - INFO - Starting async job submit for node 69d4546b8fbbb5910331fec6 2026-04-07 00:49:59,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:49:59,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546b8fbbb5910331fec6 HTTP/1.1" 200 None 2026-04-07 00:49:59,191 - lava_callback - DEBUG - Processing node 69d4546b8fbbb5910331fec6: baseline-arm64 2026-04-07 00:49:59,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:49:59,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:49:59,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546b8fbbb5910331fec6/log.txt.gz 2026-04-07 00:49:59,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:00,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:00,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546b8fbbb5910331fec6/lava-logs.yaml 2026-04-07 00:50:00,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:00,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:00,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546b8fbbb5910331fec6/lava_callback.json.gz 2026-04-07 00:50:00,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:00,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546b8fbbb5910331fec6 HTTP/1.1" 200 None 2026-04-07 00:50:00,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:00,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:00,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:00,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4546b8fbbb5910331fec6 HTTP/1.1" 200 None 2026-04-07 00:50:00,408 - lava_callback - INFO - Completed processing callback for node 69d4546b8fbbb5910331fec6 2026-04-07 00:50:03,668 - lava_callback - INFO - Received callback for node 69d454668fbbb5910331feba INFO: 172.21.0.1:59276 - "POST /node/69d454668fbbb5910331feba HTTP/1.0" 202 Accepted 2026-04-07 00:50:03,674 - lava_callback - INFO - Starting async job submit for node 69d454668fbbb5910331feba 2026-04-07 00:50:03,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:03,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454668fbbb5910331feba HTTP/1.1" 200 None 2026-04-07 00:50:03,722 - lava_callback - DEBUG - Processing node 69d454668fbbb5910331feba: baseline-arm64 2026-04-07 00:50:04,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:04,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:04,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454668fbbb5910331feba/log.txt.gz 2026-04-07 00:50:04,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:04,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:04,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454668fbbb5910331feba/lava-logs.yaml 2026-04-07 00:50:04,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:04,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:04,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454668fbbb5910331feba/lava_callback.json.gz 2026-04-07 00:50:04,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454668fbbb5910331feba HTTP/1.1" 200 None 2026-04-07 00:50:04,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:05,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:05,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:05,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454668fbbb5910331feba HTTP/1.1" 200 None 2026-04-07 00:50:05,042 - lava_callback - INFO - Completed processing callback for node 69d454668fbbb5910331feba 2026-04-07 00:50:06,318 - lava_callback - INFO - Received callback for node 69d4546e8fbbb5910331fecc INFO: 172.21.0.1:59284 - "POST /node/69d4546e8fbbb5910331fecc HTTP/1.0" 202 Accepted 2026-04-07 00:50:06,325 - lava_callback - INFO - Starting async job submit for node 69d4546e8fbbb5910331fecc 2026-04-07 00:50:06,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:06,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546e8fbbb5910331fecc HTTP/1.1" 200 None 2026-04-07 00:50:06,363 - lava_callback - DEBUG - Processing node 69d4546e8fbbb5910331fecc: baseline-arm64 INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:50:06,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:06,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:06,897 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546e8fbbb5910331fecc/log.txt.gz 2026-04-07 00:50:07,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:07,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:07,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546e8fbbb5910331fecc/lava-logs.yaml 2026-04-07 00:50:07,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:07,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:07,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546e8fbbb5910331fecc/lava_callback.json.gz 2026-04-07 00:50:07,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:07,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546e8fbbb5910331fecc HTTP/1.1" 200 None 2026-04-07 00:50:07,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:07,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:07,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:07,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4546e8fbbb5910331fecc HTTP/1.1" 200 None 2026-04-07 00:50:07,597 - lava_callback - INFO - Completed processing callback for node 69d4546e8fbbb5910331fecc 2026-04-07 00:50:07,789 - lava_callback - INFO - Received callback for node 69d454778fbbb5910331ff1e INFO: 172.21.0.1:59300 - "POST /node/69d454778fbbb5910331ff1e HTTP/1.0" 202 Accepted 2026-04-07 00:50:07,796 - lava_callback - INFO - Starting async job submit for node 69d454778fbbb5910331ff1e 2026-04-07 00:50:07,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:07,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454778fbbb5910331ff1e HTTP/1.1" 200 None 2026-04-07 00:50:07,854 - lava_callback - DEBUG - Processing node 69d454778fbbb5910331ff1e: baseline-arm64 2026-04-07 00:50:08,159 - lava_callback - INFO - Received callback for node 69d454648fbbb5910331feb4 INFO: 172.21.0.1:59308 - "POST /node/69d454648fbbb5910331feb4 HTTP/1.0" 202 Accepted 2026-04-07 00:50:08,192 - lava_callback - INFO - Starting async job submit for node 69d454648fbbb5910331feb4 2026-04-07 00:50:08,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:08,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:08,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454648fbbb5910331feb4 HTTP/1.1" 200 None 2026-04-07 00:50:08,309 - lava_callback - DEBUG - Processing node 69d454648fbbb5910331feb4: baseline-arm64 2026-04-07 00:50:08,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:08,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454778fbbb5910331ff1e/log.txt.gz 2026-04-07 00:50:08,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:08,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:09,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:09,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb4/log.txt.gz 2026-04-07 00:50:09,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:09,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454778fbbb5910331ff1e/lava-logs.yaml 2026-04-07 00:50:09,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:09,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:09,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:09,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454778fbbb5910331ff1e/lava_callback.json.gz 2026-04-07 00:50:09,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:09,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb4/lava-logs.yaml 2026-04-07 00:50:09,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:09,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454778fbbb5910331ff1e HTTP/1.1" 200 None 2026-04-07 00:50:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:09,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454778fbbb5910331ff1e HTTP/1.1" 200 None 2026-04-07 00:50:09,524 - lava_callback - INFO - Completed processing callback for node 69d454778fbbb5910331ff1e 2026-04-07 00:50:09,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:09,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454648fbbb5910331feb4/lava_callback.json.gz 2026-04-07 00:50:09,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454648fbbb5910331feb4 HTTP/1.1" 200 None 2026-04-07 00:50:09,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:09,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:09,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454648fbbb5910331feb4 HTTP/1.1" 200 None 2026-04-07 00:50:09,783 - lava_callback - INFO - Completed processing callback for node 69d454648fbbb5910331feb4 INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:50:16,766 - lava_callback - INFO - Received callback for node 69d4547f8fbbb5910331ff38 INFO: 172.21.0.1:35808 - "POST /node/69d4547f8fbbb5910331ff38 HTTP/1.0" 202 Accepted 2026-04-07 00:50:16,775 - lava_callback - INFO - Starting async job submit for node 69d4547f8fbbb5910331ff38 2026-04-07 00:50:16,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:16,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547f8fbbb5910331ff38 HTTP/1.1" 200 None 2026-04-07 00:50:16,829 - lava_callback - DEBUG - Processing node 69d4547f8fbbb5910331ff38: baseline-nfs-arm64 2026-04-07 00:50:16,941 - lava_callback - INFO - Received callback for node 69d452fa8fbbb5910331fd7f INFO: 172.21.0.1:35810 - "POST /node/69d452fa8fbbb5910331fd7f HTTP/1.0" 202 Accepted 2026-04-07 00:50:16,964 - lava_callback - INFO - Starting async job submit for node 69d452fa8fbbb5910331fd7f 2026-04-07 00:50:17,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:17,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452fa8fbbb5910331fd7f HTTP/1.1" 200 None 2026-04-07 00:50:17,136 - lava_callback - DEBUG - Processing node 69d452fa8fbbb5910331fd7f: ltp-fs_bind 2026-04-07 00:50:17,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:17,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:18,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:18,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d452fa8fbbb5910331fd7f/log.txt.gz 2026-04-07 00:50:18,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:18,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547f8fbbb5910331ff38/log.txt.gz 2026-04-07 00:50:18,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:18,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:18,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d452fa8fbbb5910331fd7f/lava-logs.yaml 2026-04-07 00:50:18,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:18,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:18,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547f8fbbb5910331ff38/lava-logs.yaml 2026-04-07 00:50:18,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:19,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:19,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d452fa8fbbb5910331fd7f/lava_callback.json.gz 2026-04-07 00:50:19,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452fa8fbbb5910331fd7f HTTP/1.1" 200 None 2026-04-07 00:50:19,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:50:19,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:19,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547f8fbbb5910331ff38/lava_callback.json.gz 2026-04-07 00:50:19,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452fa8fbbb5910331fd7f HTTP/1.1" 200 None 2026-04-07 00:50:19,222 - lava_callback - INFO - Completed processing callback for node 69d452fa8fbbb5910331fd7f 2026-04-07 00:50:19,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547f8fbbb5910331ff38 HTTP/1.1" 200 None 2026-04-07 00:50:19,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4547f8fbbb5910331ff38 HTTP/1.1" 200 None 2026-04-07 00:50:19,328 - lava_callback - INFO - Completed processing callback for node 69d4547f8fbbb5910331ff38 2026-04-07 00:50:19,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:19,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:50:22,896 - lava_callback - INFO - Received callback for node 69d4547d8fbbb5910331ff32 INFO: 172.21.0.1:42888 - "POST /node/69d4547d8fbbb5910331ff32 HTTP/1.0" 202 Accepted 2026-04-07 00:50:22,903 - lava_callback - INFO - Starting async job submit for node 69d4547d8fbbb5910331ff32 2026-04-07 00:50:22,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:22,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547d8fbbb5910331ff32 HTTP/1.1" 200 None 2026-04-07 00:50:22,956 - lava_callback - DEBUG - Processing node 69d4547d8fbbb5910331ff32: baseline-nfs-arm64 2026-04-07 00:50:23,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:23,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:23,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547d8fbbb5910331ff32/log.txt.gz 2026-04-07 00:50:23,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:23,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:23,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547d8fbbb5910331ff32/lava-logs.yaml 2026-04-07 00:50:23,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:24,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:24,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547d8fbbb5910331ff32/lava_callback.json.gz 2026-04-07 00:50:24,091 - lava_callback - INFO - Received callback for node 69d454688fbbb5910331fec0 INFO: 172.21.0.1:42896 - "POST /node/69d454688fbbb5910331fec0 HTTP/1.0" 202 Accepted 2026-04-07 00:50:24,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,100 - lava_callback - INFO - Starting async job submit for node 69d454688fbbb5910331fec0 2026-04-07 00:50:24,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547d8fbbb5910331ff32 HTTP/1.1" 200 None 2026-04-07 00:50:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454688fbbb5910331fec0 HTTP/1.1" 200 None 2026-04-07 00:50:24,151 - lava_callback - DEBUG - Processing node 69d454688fbbb5910331fec0: baseline-arm64 2026-04-07 00:50:24,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:24,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4547d8fbbb5910331ff32 HTTP/1.1" 200 None 2026-04-07 00:50:24,370 - lava_callback - INFO - Completed processing callback for node 69d4547d8fbbb5910331ff32 2026-04-07 00:50:24,417 - lava_callback - WARNING - Failed to upload log 2026-04-07 00:50:24,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:24,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:24,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454688fbbb5910331fec0/lava-logs.yaml 2026-04-07 00:50:24,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:24,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:24,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454688fbbb5910331fec0/lava_callback.json.gz 2026-04-07 00:50:24,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454688fbbb5910331fec0 HTTP/1.1" 200 None 2026-04-07 00:50:24,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:24,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:24,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454688fbbb5910331fec0 HTTP/1.1" 200 None 2026-04-07 00:50:25,065 - lava_callback - INFO - Completed processing callback for node 69d454688fbbb5910331fec0 INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:50:27,998 - lava_callback - INFO - Received callback for node 69d454818fbbb5910331ff3b INFO: 172.21.0.1:42914 - "POST /node/69d454818fbbb5910331ff3b HTTP/1.0" 202 Accepted 2026-04-07 00:50:28,008 - lava_callback - INFO - Starting async job submit for node 69d454818fbbb5910331ff3b 2026-04-07 00:50:28,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:28,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454818fbbb5910331ff3b HTTP/1.1" 200 None 2026-04-07 00:50:28,048 - lava_callback - DEBUG - Processing node 69d454818fbbb5910331ff3b: baseline-nfs-arm64 2026-04-07 00:50:28,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:28,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:28,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454818fbbb5910331ff3b/log.txt.gz 2026-04-07 00:50:29,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:29,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:29,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454818fbbb5910331ff3b/lava-logs.yaml 2026-04-07 00:50:29,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:29,453 - lava_callback - INFO - Received callback for node 69d454768fbbb5910331ff1b INFO: 172.21.0.1:42916 - "POST /node/69d454768fbbb5910331ff1b HTTP/1.0" 202 Accepted 2026-04-07 00:50:29,460 - lava_callback - INFO - Starting async job submit for node 69d454768fbbb5910331ff1b 2026-04-07 00:50:29,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454768fbbb5910331ff1b HTTP/1.1" 200 None 2026-04-07 00:50:29,505 - lava_callback - DEBUG - Processing node 69d454768fbbb5910331ff1b: baseline-arm64 2026-04-07 00:50:29,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:29,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454818fbbb5910331ff3b/lava_callback.json.gz 2026-04-07 00:50:29,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454818fbbb5910331ff3b HTTP/1.1" 200 None 2026-04-07 00:50:29,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:29,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:29,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:29,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454818fbbb5910331ff3b HTTP/1.1" 200 None 2026-04-07 00:50:29,845 - lava_callback - INFO - Completed processing callback for node 69d454818fbbb5910331ff3b 2026-04-07 00:50:29,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:29,958 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454768fbbb5910331ff1b/log.txt.gz 2026-04-07 00:50:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:30,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:30,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454768fbbb5910331ff1b/lava-logs.yaml 2026-04-07 00:50:30,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:30,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:30,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454768fbbb5910331ff1b/lava_callback.json.gz 2026-04-07 00:50:30,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:30,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454768fbbb5910331ff1b HTTP/1.1" 200 None 2026-04-07 00:50:30,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:30,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:30,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454768fbbb5910331ff1b HTTP/1.1" 200 None 2026-04-07 00:50:30,589 - lava_callback - INFO - Completed processing callback for node 69d454768fbbb5910331ff1b 2026-04-07 00:50:31,573 - lava_callback - INFO - Received callback for node 69d454748fbbb5910331ff10 INFO: 172.21.0.1:46528 - "POST /node/69d454748fbbb5910331ff10 HTTP/1.0" 202 Accepted 2026-04-07 00:50:31,579 - lava_callback - INFO - Starting async job submit for node 69d454748fbbb5910331ff10 2026-04-07 00:50:31,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:31,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454748fbbb5910331ff10 HTTP/1.1" 200 None 2026-04-07 00:50:31,620 - lava_callback - DEBUG - Processing node 69d454748fbbb5910331ff10: baseline-arm64 2026-04-07 00:50:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:32,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:32,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454748fbbb5910331ff10/log.txt.gz 2026-04-07 00:50:32,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:32,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:32,477 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454748fbbb5910331ff10/lava-logs.yaml 2026-04-07 00:50:32,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:32,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:32,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454748fbbb5910331ff10/lava_callback.json.gz 2026-04-07 00:50:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:32,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454748fbbb5910331ff10 HTTP/1.1" 200 None 2026-04-07 00:50:32,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:32,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:32,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:32,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454748fbbb5910331ff10 HTTP/1.1" 200 None 2026-04-07 00:50:32,765 - lava_callback - INFO - Completed processing callback for node 69d454748fbbb5910331ff10 INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:50:41,590 - lava_callback - INFO - Received callback for node 69d454888fbbb5910331ff4d INFO: 172.21.0.1:33618 - "POST /node/69d454888fbbb5910331ff4d HTTP/1.0" 202 Accepted 2026-04-07 00:50:41,597 - lava_callback - INFO - Starting async job submit for node 69d454888fbbb5910331ff4d 2026-04-07 00:50:41,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:41,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454888fbbb5910331ff4d HTTP/1.1" 200 None 2026-04-07 00:50:41,638 - lava_callback - DEBUG - Processing node 69d454888fbbb5910331ff4d: baseline-nfs-arm64 2026-04-07 00:50:42,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:42,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:42,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454888fbbb5910331ff4d/log.txt.gz 2026-04-07 00:50:42,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:42,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:42,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454888fbbb5910331ff4d/lava-logs.yaml 2026-04-07 00:50:42,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:43,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:43,015 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454888fbbb5910331ff4d/lava_callback.json.gz 2026-04-07 00:50:43,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:43,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454888fbbb5910331ff4d HTTP/1.1" 200 None 2026-04-07 00:50:43,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:43,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:43,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454888fbbb5910331ff4d HTTP/1.1" 200 None 2026-04-07 00:50:43,097 - lava_callback - INFO - Completed processing callback for node 69d454888fbbb5910331ff4d 2026-04-07 00:50:43,659 - lava_callback - INFO - Received callback for node 69d454838fbbb5910331ff41 INFO: 172.21.0.1:33622 - "POST /node/69d454838fbbb5910331ff41 HTTP/1.0" 202 Accepted 2026-04-07 00:50:43,665 - lava_callback - INFO - Starting async job submit for node 69d454838fbbb5910331ff41 2026-04-07 00:50:43,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:43,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454838fbbb5910331ff41 HTTP/1.1" 200 None 2026-04-07 00:50:43,711 - lava_callback - DEBUG - Processing node 69d454838fbbb5910331ff41: baseline-nfs-arm64 2026-04-07 00:50:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:44,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:44,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454838fbbb5910331ff41/log.txt.gz 2026-04-07 00:50:44,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:44,576 - lava_callback - INFO - Received callback for node 69d454ae8fbbb59103320047 INFO: 172.21.0.1:33624 - "POST /node/69d454ae8fbbb59103320047 HTTP/1.0" 202 Accepted 2026-04-07 00:50:44,583 - lava_callback - INFO - Starting async job submit for node 69d454ae8fbbb59103320047 2026-04-07 00:50:44,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:44,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ae8fbbb59103320047 HTTP/1.1" 200 None 2026-04-07 00:50:44,643 - lava_callback - DEBUG - Processing node 69d454ae8fbbb59103320047: baseline-arm64-foundriesio 2026-04-07 00:50:44,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:44,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454838fbbb5910331ff41/lava-logs.yaml 2026-04-07 00:50:44,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:44,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:45,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:45,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454838fbbb5910331ff41/lava_callback.json.gz 2026-04-07 00:50:45,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:45,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454ae8fbbb59103320047/log.txt.gz 2026-04-07 00:50:45,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454838fbbb5910331ff41 HTTP/1.1" 200 None 2026-04-07 00:50:45,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:45,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:45,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454838fbbb5910331ff41 HTTP/1.1" 200 None 2026-04-07 00:50:45,266 - lava_callback - INFO - Completed processing callback for node 69d454838fbbb5910331ff41 2026-04-07 00:50:45,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:45,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454ae8fbbb59103320047/lava-logs.yaml 2026-04-07 00:50:45,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:45,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:45,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454ae8fbbb59103320047/lava_callback.json.gz 2026-04-07 00:50:45,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ae8fbbb59103320047 HTTP/1.1" 200 None 2026-04-07 00:50:45,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:45,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454ae8fbbb59103320047 HTTP/1.1" 200 None 2026-04-07 00:50:45,733 - lava_callback - INFO - Completed processing callback for node 69d454ae8fbbb59103320047 INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:50:47,803 - lava_callback - INFO - Received callback for node 69d454ac8fbbb5910332003b INFO: 172.21.0.1:33640 - "POST /node/69d454ac8fbbb5910332003b HTTP/1.0" 202 Accepted 2026-04-07 00:50:47,810 - lava_callback - INFO - Starting async job submit for node 69d454ac8fbbb5910332003b 2026-04-07 00:50:47,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:47,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ac8fbbb5910332003b HTTP/1.1" 200 None 2026-04-07 00:50:47,854 - lava_callback - DEBUG - Processing node 69d454ac8fbbb5910332003b: baseline-arm64-pengutronix 2026-04-07 00:50:48,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:48,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:48,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ac8fbbb5910332003b/log.txt.gz 2026-04-07 00:50:48,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:48,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:48,620 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ac8fbbb5910332003b/lava-logs.yaml 2026-04-07 00:50:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:48,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:48,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ac8fbbb5910332003b/lava_callback.json.gz 2026-04-07 00:50:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:48,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ac8fbbb5910332003b HTTP/1.1" 200 None 2026-04-07 00:50:48,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:48,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:48,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454ac8fbbb5910332003b HTTP/1.1" 200 None 2026-04-07 00:50:48,895 - lava_callback - INFO - Completed processing callback for node 69d454ac8fbbb5910332003b 2026-04-07 00:50:49,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:49,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:50:50,558 - lava_callback - INFO - Received callback for node 69d454878fbbb5910331ff4a INFO: 172.21.0.1:40848 - "POST /node/69d454878fbbb5910331ff4a HTTP/1.0" 202 Accepted 2026-04-07 00:50:50,570 - lava_callback - INFO - Starting async job submit for node 69d454878fbbb5910331ff4a 2026-04-07 00:50:50,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:50,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454878fbbb5910331ff4a HTTP/1.1" 200 None 2026-04-07 00:50:50,620 - lava_callback - DEBUG - Processing node 69d454878fbbb5910331ff4a: baseline-nfs-arm64 2026-04-07 00:50:50,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:51,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:51,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454878fbbb5910331ff4a/log.txt.gz 2026-04-07 00:50:51,202 - lava_callback - INFO - Received callback for node 69d454a88fbbb5910331fffe INFO: 172.21.0.1:40860 - "POST /node/69d454a88fbbb5910331fffe HTTP/1.0" 202 Accepted 2026-04-07 00:50:51,223 - lava_callback - INFO - Starting async job submit for node 69d454a88fbbb5910331fffe 2026-04-07 00:50:51,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:51,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a88fbbb5910331fffe HTTP/1.1" 200 None 2026-04-07 00:50:51,364 - lava_callback - DEBUG - Processing node 69d454a88fbbb5910331fffe: baseline-arm64-kontron 2026-04-07 00:50:51,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:51,649 - lava_callback - INFO - Received callback for node 69d454868fbbb5910331ff47 2026-04-07 00:50:51,683 - lava_callback - INFO - Starting async job submit for node 69d454868fbbb5910331ff47 INFO: 172.21.0.1:40874 - "POST /node/69d454868fbbb5910331ff47 HTTP/1.0" 202 Accepted 2026-04-07 00:50:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:51,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:51,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454868fbbb5910331ff47 HTTP/1.1" 200 None 2026-04-07 00:50:51,778 - lava_callback - DEBUG - Processing node 69d454868fbbb5910331ff47: baseline-nfs-arm64 2026-04-07 00:50:51,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:51,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454a88fbbb5910331fffe/log.txt.gz 2026-04-07 00:50:52,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:52,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454878fbbb5910331ff4a/lava-logs.yaml 2026-04-07 00:50:52,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:52,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:52,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:52,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:52,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454868fbbb5910331ff47/log.txt.gz 2026-04-07 00:50:52,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:52,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:52,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454a88fbbb5910331fffe/lava-logs.yaml 2026-04-07 00:50:52,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454878fbbb5910331ff4a/lava_callback.json.gz 2026-04-07 00:50:52,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:52,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:52,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454878fbbb5910331ff4a HTTP/1.1" 200 None 2026-04-07 00:50:52,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:52,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:52,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:52,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:52,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454878fbbb5910331ff4a HTTP/1.1" 200 None 2026-04-07 00:50:52,823 - lava_callback - INFO - Completed processing callback for node 69d454878fbbb5910331ff4a 2026-04-07 00:50:52,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:52,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454a88fbbb5910331fffe/lava_callback.json.gz 2026-04-07 00:50:53,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:53,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a88fbbb5910331fffe HTTP/1.1" 200 None 2026-04-07 00:50:53,050 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454868fbbb5910331ff47/lava-logs.yaml 2026-04-07 00:50:53,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:50:53,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:53,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454a88fbbb5910331fffe HTTP/1.1" 200 None 2026-04-07 00:50:53,157 - lava_callback - INFO - Completed processing callback for node 69d454a88fbbb5910331fffe 2026-04-07 00:50:53,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:50:53,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454868fbbb5910331ff47/lava_callback.json.gz 2026-04-07 00:50:53,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454868fbbb5910331ff47 HTTP/1.1" 200 None 2026-04-07 00:50:53,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:50:53,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:50:53,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454868fbbb5910331ff47 HTTP/1.1" 200 None 2026-04-07 00:50:53,565 - lava_callback - INFO - Completed processing callback for node 69d454868fbbb5910331ff47 INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:01,301 - lava_callback - INFO - Received callback for node 69d4546f8fbbb5910331fecf INFO: 172.21.0.1:41226 - "POST /node/69d4546f8fbbb5910331fecf HTTP/1.0" 202 Accepted 2026-04-07 00:51:01,311 - lava_callback - INFO - Starting async job submit for node 69d4546f8fbbb5910331fecf 2026-04-07 00:51:01,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:01,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546f8fbbb5910331fecf HTTP/1.1" 200 None 2026-04-07 00:51:01,378 - lava_callback - DEBUG - Processing node 69d4546f8fbbb5910331fecf: baseline-arm64 2026-04-07 00:51:01,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:02,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:02,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546f8fbbb5910331fecf/log.txt.gz 2026-04-07 00:51:02,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:02,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:02,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546f8fbbb5910331fecf/lava-logs.yaml 2026-04-07 00:51:02,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:02,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:02,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546f8fbbb5910331fecf/lava_callback.json.gz 2026-04-07 00:51:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:02,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546f8fbbb5910331fecf HTTP/1.1" 200 None 2026-04-07 00:51:02,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:02,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:02,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:02,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4546f8fbbb5910331fecf HTTP/1.1" 200 None 2026-04-07 00:51:03,004 - lava_callback - INFO - Completed processing callback for node 69d4546f8fbbb5910331fecf INFO: 172.21.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:11,475 - lava_callback - INFO - Received callback for node 69d454aa8fbbb59103320001 INFO: 172.21.0.1:57078 - "POST /node/69d454aa8fbbb59103320001 HTTP/1.0" 202 Accepted 2026-04-07 00:51:11,481 - lava_callback - INFO - Starting async job submit for node 69d454aa8fbbb59103320001 2026-04-07 00:51:11,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:11,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454aa8fbbb59103320001 HTTP/1.1" 200 None 2026-04-07 00:51:11,519 - lava_callback - DEBUG - Processing node 69d454aa8fbbb59103320001: baseline-arm64-kontron 2026-04-07 00:51:11,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:11,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:11,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454aa8fbbb59103320001/log.txt.gz 2026-04-07 00:51:12,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:12,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:12,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454aa8fbbb59103320001/lava-logs.yaml 2026-04-07 00:51:12,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:12,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:12,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d454aa8fbbb59103320001/lava_callback.json.gz 2026-04-07 00:51:12,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:12,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454aa8fbbb59103320001 HTTP/1.1" 200 None 2026-04-07 00:51:12,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:12,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:12,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454aa8fbbb59103320001 HTTP/1.1" 200 None 2026-04-07 00:51:12,559 - lava_callback - INFO - Completed processing callback for node 69d454aa8fbbb59103320001 INFO: 172.21.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:16,844 - lava_callback - INFO - Received callback for node 69d454978fbbb5910331ffbe INFO: 172.21.0.1:57094 - "POST /node/69d454978fbbb5910331ffbe HTTP/1.0" 202 Accepted 2026-04-07 00:51:16,851 - lava_callback - INFO - Starting async job submit for node 69d454978fbbb5910331ffbe 2026-04-07 00:51:16,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:16,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454978fbbb5910331ffbe HTTP/1.1" 200 None 2026-04-07 00:51:16,889 - lava_callback - DEBUG - Processing node 69d454978fbbb5910331ffbe: baseline-arm64-broonie 2026-04-07 00:51:17,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:17,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:17,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454978fbbb5910331ffbe/log.txt.gz 2026-04-07 00:51:17,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:17,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:17,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454978fbbb5910331ffbe/lava-logs.yaml 2026-04-07 00:51:17,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:18,325 - lava_callback - INFO - Received callback for node 69d454998fbbb5910331ffc1 INFO: 172.21.0.1:57100 - "POST /node/69d454998fbbb5910331ffc1 HTTP/1.0" 202 Accepted 2026-04-07 00:51:18,331 - lava_callback - INFO - Starting async job submit for node 69d454998fbbb5910331ffc1 2026-04-07 00:51:18,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:18,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454998fbbb5910331ffc1 HTTP/1.1" 200 None 2026-04-07 00:51:18,369 - lava_callback - DEBUG - Processing node 69d454998fbbb5910331ffc1: baseline-arm64-broonie 2026-04-07 00:51:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:18,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:18,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454998fbbb5910331ffc1/log.txt.gz 2026-04-07 00:51:18,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:19,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:19,132 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454998fbbb5910331ffc1/lava-logs.yaml 2026-04-07 00:51:19,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:19,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:19,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454998fbbb5910331ffc1/lava_callback.json.gz 2026-04-07 00:51:19,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:19,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454998fbbb5910331ffc1 HTTP/1.1" 200 None 2026-04-07 00:51:19,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:19,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:19,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:19,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454998fbbb5910331ffc1 HTTP/1.1" 200 None 2026-04-07 00:51:19,381 - lava_callback - INFO - Completed processing callback for node 69d454998fbbb5910331ffc1 2026-04-07 00:51:19,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:19,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:51:19,823 - lava_callback - INFO - Received callback for node 69d454a08fbbb5910331ffe3 INFO: 172.21.0.1:50868 - "POST /node/69d454a08fbbb5910331ffe3 HTTP/1.0" 202 Accepted 2026-04-07 00:51:19,831 - lava_callback - INFO - Starting async job submit for node 69d454a08fbbb5910331ffe3 2026-04-07 00:51:19,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:19,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a08fbbb5910331ffe3 HTTP/1.1" 200 None 2026-04-07 00:51:19,883 - lava_callback - DEBUG - Processing node 69d454a08fbbb5910331ffe3: baseline-arm64-broonie 2026-04-07 00:51:20,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:20,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:20,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a08fbbb5910331ffe3/log.txt.gz 2026-04-07 00:51:20,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:20,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:20,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a08fbbb5910331ffe3/lava-logs.yaml 2026-04-07 00:51:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:20,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:20,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a08fbbb5910331ffe3/lava_callback.json.gz 2026-04-07 00:51:20,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:20,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a08fbbb5910331ffe3 HTTP/1.1" 200 None 2026-04-07 00:51:20,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:20,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:20,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:20,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454a08fbbb5910331ffe3 HTTP/1.1" 200 None 2026-04-07 00:51:20,872 - lava_callback - INFO - Completed processing callback for node 69d454a08fbbb5910331ffe3 2026-04-07 00:51:21,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:21,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454978fbbb5910331ffbe/lava_callback.json.gz 2026-04-07 00:51:21,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:21,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454978fbbb5910331ffbe HTTP/1.1" 200 None 2026-04-07 00:51:21,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:21,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:21,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454978fbbb5910331ffbe HTTP/1.1" 200 None 2026-04-07 00:51:21,979 - lava_callback - INFO - Completed processing callback for node 69d454978fbbb5910331ffbe 2026-04-07 00:51:25,325 - lava_callback - INFO - Received callback for node 69d4547a8fbbb5910331ff28 INFO: 172.21.0.1:50884 - "POST /node/69d4547a8fbbb5910331ff28 HTTP/1.0" 202 Accepted 2026-04-07 00:51:25,333 - lava_callback - INFO - Starting async job submit for node 69d4547a8fbbb5910331ff28 2026-04-07 00:51:25,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:25,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547a8fbbb5910331ff28 HTTP/1.1" 200 None 2026-04-07 00:51:25,375 - lava_callback - DEBUG - Processing node 69d4547a8fbbb5910331ff28: baseline-nfs-arm64 2026-04-07 00:51:25,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:25,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:25,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547a8fbbb5910331ff28/log.txt.gz 2026-04-07 00:51:26,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:26,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:26,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547a8fbbb5910331ff28/lava-logs.yaml 2026-04-07 00:51:26,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:26,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:26,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547a8fbbb5910331ff28/lava_callback.json.gz 2026-04-07 00:51:26,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:26,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547a8fbbb5910331ff28 HTTP/1.1" 200 None 2026-04-07 00:51:26,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:26,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:26,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:26,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4547a8fbbb5910331ff28 HTTP/1.1" 200 None 2026-04-07 00:51:26,463 - lava_callback - INFO - Completed processing callback for node 69d4547a8fbbb5910331ff28 INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:29,796 - lava_callback - INFO - Received callback for node 69d4549e8fbbb5910331ffd8 INFO: 172.21.0.1:40728 - "POST /node/69d4549e8fbbb5910331ffd8 HTTP/1.0" 202 Accepted 2026-04-07 00:51:29,802 - lava_callback - INFO - Starting async job submit for node 69d4549e8fbbb5910331ffd8 2026-04-07 00:51:29,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:29,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4549e8fbbb5910331ffd8 HTTP/1.1" 200 None 2026-04-07 00:51:29,841 - lava_callback - DEBUG - Processing node 69d4549e8fbbb5910331ffd8: baseline-arm64-broonie 2026-04-07 00:51:30,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:30,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:30,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4549e8fbbb5910331ffd8/log.txt.gz 2026-04-07 00:51:30,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:30,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:30,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4549e8fbbb5910331ffd8/lava-logs.yaml 2026-04-07 00:51:30,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:30,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:30,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4549e8fbbb5910331ffd8/lava_callback.json.gz 2026-04-07 00:51:30,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:30,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4549e8fbbb5910331ffd8 HTTP/1.1" 200 None 2026-04-07 00:51:30,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:30,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:30,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:30,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4549e8fbbb5910331ffd8 HTTP/1.1" 200 None 2026-04-07 00:51:30,917 - lava_callback - INFO - Completed processing callback for node 69d4549e8fbbb5910331ffd8 2026-04-07 00:51:35,764 - lava_callback - INFO - Received callback for node 69d454ab8fbbb59103320038 INFO: 172.21.0.1:40734 - "POST /node/69d454ab8fbbb59103320038 HTTP/1.0" 202 Accepted 2026-04-07 00:51:35,770 - lava_callback - INFO - Starting async job submit for node 69d454ab8fbbb59103320038 2026-04-07 00:51:35,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:35,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ab8fbbb59103320038 HTTP/1.1" 200 None 2026-04-07 00:51:35,806 - lava_callback - DEBUG - Processing node 69d454ab8fbbb59103320038: baseline-arm64-pengutronix 2026-04-07 00:51:35,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:36,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:36,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ab8fbbb59103320038/log.txt.gz 2026-04-07 00:51:36,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:36,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:36,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ab8fbbb59103320038/lava-logs.yaml 2026-04-07 00:51:36,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:36,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:36,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d454ab8fbbb59103320038/lava_callback.json.gz 2026-04-07 00:51:36,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:36,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454ab8fbbb59103320038 HTTP/1.1" 200 None 2026-04-07 00:51:36,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:36,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:36,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:36,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454ab8fbbb59103320038 HTTP/1.1" 200 None 2026-04-07 00:51:36,731 - lava_callback - INFO - Completed processing callback for node 69d454ab8fbbb59103320038 2026-04-07 00:51:46,477 - lava_callback - INFO - Received callback for node 69d1b20faa48d6fae7bb0d5a INFO: 172.21.0.1:56638 - "POST /node/69d1b20faa48d6fae7bb0d5a HTTP/1.0" 202 Accepted 2026-04-07 00:51:46,485 - lava_callback - INFO - Starting async job submit for node 69d1b20faa48d6fae7bb0d5a 2026-04-07 00:51:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:46,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b20faa48d6fae7bb0d5a HTTP/1.1" 200 None 2026-04-07 00:51:46,502 - lava_callback - DEBUG - Processing node 69d1b20faa48d6fae7bb0d5a: baseline-arm-clabbe 2026-04-07 00:51:46,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b20faa48d6fae7bb0d5a 2026-04-07 00:51:46,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:46,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b20faa48d6fae7bb0d5a HTTP/1.1" 200 None 2026-04-07 00:51:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:46,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 00:51:46,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:51:46,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b20faa48d6fae7bb0d5a HTTP/1.1" 200 None 2026-04-07 00:51:46,554 - lava_callback - ERROR - Error processing callback for node 69d1b20faa48d6fae7bb0d5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:51:48,660 - lava_callback - INFO - Received callback for node 69d454a18fbbb5910331ffe6 INFO: 172.21.0.1:56648 - "POST /node/69d454a18fbbb5910331ffe6 HTTP/1.0" 202 Accepted 2026-04-07 00:51:48,668 - lava_callback - INFO - Starting async job submit for node 69d454a18fbbb5910331ffe6 2026-04-07 00:51:48,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:48,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a18fbbb5910331ffe6 HTTP/1.1" 200 None 2026-04-07 00:51:48,722 - lava_callback - DEBUG - Processing node 69d454a18fbbb5910331ffe6: baseline-arm64-broonie 2026-04-07 00:51:48,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:49,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:49,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a18fbbb5910331ffe6/log.txt.gz 2026-04-07 00:51:49,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:49,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:49,455 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a18fbbb5910331ffe6/lava-logs.yaml 2026-04-07 00:51:49,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:49,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:49,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d454a18fbbb5910331ffe6/lava_callback.json.gz 2026-04-07 00:51:49,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-07 00:51:49,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:49,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454a18fbbb5910331ffe6 HTTP/1.1" 200 None 2026-04-07 00:51:49,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:49,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:49,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:49,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454a18fbbb5910331ffe6 HTTP/1.1" 200 None 2026-04-07 00:51:49,689 - lava_callback - INFO - Completed processing callback for node 69d454a18fbbb5910331ffe6 2026-04-07 00:51:54,339 - lava_callback - INFO - Received callback for node 69d4546a8fbbb5910331fec3 INFO: 172.21.0.1:38542 - "POST /node/69d4546a8fbbb5910331fec3 HTTP/1.0" 202 Accepted 2026-04-07 00:51:54,349 - lava_callback - INFO - Starting async job submit for node 69d4546a8fbbb5910331fec3 2026-04-07 00:51:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:54,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546a8fbbb5910331fec3 HTTP/1.1" 200 None 2026-04-07 00:51:54,381 - lava_callback - DEBUG - Processing node 69d4546a8fbbb5910331fec3: baseline-arm64 2026-04-07 00:51:54,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:54,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:54,897 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546a8fbbb5910331fec3/log.txt.gz 2026-04-07 00:51:55,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:55,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:55,344 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546a8fbbb5910331fec3/lava-logs.yaml 2026-04-07 00:51:55,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:51:55,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:51:55,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4546a8fbbb5910331fec3/lava_callback.json.gz 2026-04-07 00:51:55,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:55,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4546a8fbbb5910331fec3 HTTP/1.1" 200 None 2026-04-07 00:51:55,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:55,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:51:55,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:51:55,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4546a8fbbb5910331fec3 HTTP/1.1" 200 None 2026-04-07 00:51:55,559 - lava_callback - INFO - Completed processing callback for node 69d4546a8fbbb5910331fec3 INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:52:19,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:19,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:52:28,867 - lava_callback - INFO - Received callback for node 69d4531c8fbbb5910331fd95 INFO: 172.21.0.1:36042 - "POST /node/69d4531c8fbbb5910331fd95 HTTP/1.0" 202 Accepted 2026-04-07 00:52:28,877 - lava_callback - INFO - Starting async job submit for node 69d4531c8fbbb5910331fd95 2026-04-07 00:52:28,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:28,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4531c8fbbb5910331fd95 HTTP/1.1" 200 None 2026-04-07 00:52:28,951 - lava_callback - DEBUG - Processing node 69d4531c8fbbb5910331fd95: ltp-fsx 2026-04-07 00:52:29,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:52:30,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:52:30,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4531c8fbbb5910331fd95/log.txt.gz 2026-04-07 00:52:30,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:52:31,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:52:31,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4531c8fbbb5910331fd95/lava-logs.yaml 2026-04-07 00:52:31,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:52:31,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:52:31,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d4531c8fbbb5910331fd95/lava_callback.json.gz 2026-04-07 00:52:31,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:31,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4531c8fbbb5910331fd95 HTTP/1.1" 200 None 2026-04-07 00:52:31,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:31,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:52:31,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:31,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4531c8fbbb5910331fd95 HTTP/1.1" 200 None 2026-04-07 00:52:31,896 - lava_callback - INFO - Completed processing callback for node 69d4531c8fbbb5910331fd95 INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:52:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:52:49,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:53:17,510 - lava_callback - INFO - Received callback for node 69d4547b8fbbb5910331ff2f INFO: 172.21.0.1:48430 - "POST /node/69d4547b8fbbb5910331ff2f HTTP/1.0" 202 Accepted 2026-04-07 00:53:17,523 - lava_callback - INFO - Starting async job submit for node 69d4547b8fbbb5910331ff2f 2026-04-07 00:53:17,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:17,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547b8fbbb5910331ff2f HTTP/1.1" 200 None 2026-04-07 00:53:17,590 - lava_callback - DEBUG - Processing node 69d4547b8fbbb5910331ff2f: baseline-nfs-arm64 2026-04-07 00:53:18,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:19,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:19,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547b8fbbb5910331ff2f/log.txt.gz 2026-04-07 00:53:19,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:20,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:20,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547b8fbbb5910331ff2f/lava-logs.yaml 2026-04-07 00:53:20,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:21,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:21,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547b8fbbb5910331ff2f/lava_callback.json.gz 2026-04-07 00:53:21,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:21,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547b8fbbb5910331ff2f HTTP/1.1" 200 None 2026-04-07 00:53:21,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:21,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:53:21,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:21,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4547b8fbbb5910331ff2f HTTP/1.1" 200 None 2026-04-07 00:53:21,665 - lava_callback - INFO - Completed processing callback for node 69d4547b8fbbb5910331ff2f INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:53:47,637 - lava_callback - INFO - Received callback for node 69d1b298aa48d6fae7bb0e46 INFO: 172.21.0.1:49370 - "POST /node/69d1b298aa48d6fae7bb0e46 HTTP/1.0" 202 Accepted 2026-04-07 00:53:47,647 - lava_callback - INFO - Starting async job submit for node 69d1b298aa48d6fae7bb0e46 2026-04-07 00:53:47,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:47,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b298aa48d6fae7bb0e46 HTTP/1.1" 200 None 2026-04-07 00:53:47,685 - lava_callback - DEBUG - Processing node 69d1b298aa48d6fae7bb0e46: baseline-arm64-baylibre 2026-04-07 00:53:47,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b298aa48d6fae7bb0e46 2026-04-07 00:53:47,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:47,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b298aa48d6fae7bb0e46 HTTP/1.1" 200 None 2026-04-07 00:53:47,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:47,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:53:47,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:47,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b298aa48d6fae7bb0e46 HTTP/1.1" 200 None 2026-04-07 00:53:47,801 - lava_callback - ERROR - Error processing callback for node 69d1b298aa48d6fae7bb0e46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:53:48,876 - lava_callback - INFO - Received callback for node 69d450ee8fbbb5910331f9e4 INFO: 172.21.0.1:49376 - "POST /node/69d450ee8fbbb5910331f9e4 HTTP/1.0" 202 Accepted 2026-04-07 00:53:48,886 - lava_callback - INFO - Starting async job submit for node 69d450ee8fbbb5910331f9e4 2026-04-07 00:53:49,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:49,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d450ee8fbbb5910331f9e4 HTTP/1.1" 200 None 2026-04-07 00:53:49,037 - lava_callback - DEBUG - Processing node 69d450ee8fbbb5910331f9e4: ltp-smoke 2026-04-07 00:53:49,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:49,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-07 00:53:49,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:50,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:50,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d450ee8fbbb5910331f9e4/log.txt.gz 2026-04-07 00:53:51,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:51,506 - lava_callback - INFO - Received callback for node 69d451688fbbb5910331fa05 INFO: 172.21.0.1:53170 - "POST /node/69d451688fbbb5910331fa05 HTTP/1.0" 202 Accepted 2026-04-07 00:53:51,517 - lava_callback - INFO - Starting async job submit for node 69d451688fbbb5910331fa05 2026-04-07 00:53:51,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:51,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451688fbbb5910331fa05 HTTP/1.1" 200 None 2026-04-07 00:53:51,651 - lava_callback - DEBUG - Processing node 69d451688fbbb5910331fa05: baseline-arm 2026-04-07 00:53:52,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:52,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d450ee8fbbb5910331f9e4/lava-logs.yaml 2026-04-07 00:53:52,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:52,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:53,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:53,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d451688fbbb5910331fa05/log.txt.gz 2026-04-07 00:53:53,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:53,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d450ee8fbbb5910331f9e4/lava_callback.json.gz 2026-04-07 00:53:53,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:54,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d450ee8fbbb5910331f9e4 HTTP/1.1" 200 None 2026-04-07 00:53:54,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:54,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d608fbbb5910331f99d HTTP/1.1" 200 None 2026-04-07 00:53:54,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:54,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d450ee8fbbb5910331f9e4 HTTP/1.1" 200 None 2026-04-07 00:53:54,601 - lava_callback - INFO - Completed processing callback for node 69d450ee8fbbb5910331f9e4 2026-04-07 00:53:54,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:53:56,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:56,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d451688fbbb5910331fa05/lava-logs.yaml 2026-04-07 00:53:56,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:53:57,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:53:57,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d451688fbbb5910331fa05/lava_callback.json.gz DEBUG: Setup failed for 69d451688fbbb5910331fa05. Transitting job node result: incomplete -> fail 2026-04-07 00:53:57,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:57,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451688fbbb5910331fa05 HTTP/1.1" 200 None 2026-04-07 00:53:57,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:57,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 00:53:57,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:53:57,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451688fbbb5910331fa05 HTTP/1.1" 200 None 2026-04-07 00:53:58,138 - lava_callback - INFO - Completed processing callback for node 69d451688fbbb5910331fa05 INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:54:07,641 - lava_callback - INFO - Received callback for node 69d1b29aaa48d6fae7bb0e49 INFO: 172.21.0.1:60504 - "POST /node/69d1b29aaa48d6fae7bb0e49 HTTP/1.0" 202 Accepted 2026-04-07 00:54:07,650 - lava_callback - INFO - Starting async job submit for node 69d1b29aaa48d6fae7bb0e49 2026-04-07 00:54:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:07,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b29aaa48d6fae7bb0e49 HTTP/1.1" 200 None 2026-04-07 00:54:07,683 - lava_callback - DEBUG - Processing node 69d1b29aaa48d6fae7bb0e49: baseline-arm64-baylibre 2026-04-07 00:54:07,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b29aaa48d6fae7bb0e49 2026-04-07 00:54:07,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:07,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b29aaa48d6fae7bb0e49 HTTP/1.1" 200 None 2026-04-07 00:54:07,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:07,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:07,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:07,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b29aaa48d6fae7bb0e49 HTTP/1.1" 200 None 2026-04-07 00:54:07,793 - lava_callback - ERROR - Error processing callback for node 69d1b29aaa48d6fae7bb0e49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:08,343 - lava_callback - INFO - Received callback for node 69d1b29daa48d6fae7bb0e4c INFO: 172.21.0.1:60506 - "POST /node/69d1b29daa48d6fae7bb0e4c HTTP/1.0" 202 Accepted 2026-04-07 00:54:08,353 - lava_callback - INFO - Starting async job submit for node 69d1b29daa48d6fae7bb0e4c 2026-04-07 00:54:08,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:08,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b29daa48d6fae7bb0e4c HTTP/1.1" 200 None 2026-04-07 00:54:08,381 - lava_callback - DEBUG - Processing node 69d1b29daa48d6fae7bb0e4c: baseline-arm64-baylibre 2026-04-07 00:54:08,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b29daa48d6fae7bb0e4c 2026-04-07 00:54:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:08,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b29daa48d6fae7bb0e4c HTTP/1.1" 200 None 2026-04-07 00:54:08,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:08,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:08,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:08,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b29daa48d6fae7bb0e4c HTTP/1.1" 200 None 2026-04-07 00:54:08,481 - lava_callback - ERROR - Error processing callback for node 69d1b29daa48d6fae7bb0e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:09,042 - lava_callback - INFO - Received callback for node 69d1b2a1aa48d6fae7bb0e61 INFO: 172.21.0.1:60510 - "POST /node/69d1b2a1aa48d6fae7bb0e61 HTTP/1.0" 202 Accepted 2026-04-07 00:54:09,051 - lava_callback - INFO - Starting async job submit for node 69d1b2a1aa48d6fae7bb0e61 2026-04-07 00:54:09,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a1aa48d6fae7bb0e61 HTTP/1.1" 200 None 2026-04-07 00:54:09,080 - lava_callback - DEBUG - Processing node 69d1b2a1aa48d6fae7bb0e61: baseline-arm64-baylibre 2026-04-07 00:54:09,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2a1aa48d6fae7bb0e61 2026-04-07 00:54:09,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a1aa48d6fae7bb0e61 HTTP/1.1" 200 None 2026-04-07 00:54:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:09,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2a1aa48d6fae7bb0e61 HTTP/1.1" 200 None 2026-04-07 00:54:09,176 - lava_callback - ERROR - Error processing callback for node 69d1b2a1aa48d6fae7bb0e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:09,704 - lava_callback - INFO - Received callback for node 69d1b2a4aa48d6fae7bb0e64 INFO: 172.21.0.1:59864 - "POST /node/69d1b2a4aa48d6fae7bb0e64 HTTP/1.0" 202 Accepted 2026-04-07 00:54:09,719 - lava_callback - INFO - Starting async job submit for node 69d1b2a4aa48d6fae7bb0e64 2026-04-07 00:54:09,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a4aa48d6fae7bb0e64 HTTP/1.1" 200 None 2026-04-07 00:54:09,747 - lava_callback - DEBUG - Processing node 69d1b2a4aa48d6fae7bb0e64: baseline-arm64-baylibre 2026-04-07 00:54:09,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2a4aa48d6fae7bb0e64 2026-04-07 00:54:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a4aa48d6fae7bb0e64 HTTP/1.1" 200 None 2026-04-07 00:54:09,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:09,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:09,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2a4aa48d6fae7bb0e64 HTTP/1.1" 200 None 2026-04-07 00:54:09,852 - lava_callback - ERROR - Error processing callback for node 69d1b2a4aa48d6fae7bb0e64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:10,369 - lava_callback - INFO - Received callback for node 69d1b2a7aa48d6fae7bb0e68 INFO: 172.21.0.1:59874 - "POST /node/69d1b2a7aa48d6fae7bb0e68 HTTP/1.0" 202 Accepted 2026-04-07 00:54:10,379 - lava_callback - INFO - Starting async job submit for node 69d1b2a7aa48d6fae7bb0e68 2026-04-07 00:54:10,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:10,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a7aa48d6fae7bb0e68 HTTP/1.1" 200 None 2026-04-07 00:54:10,407 - lava_callback - DEBUG - Processing node 69d1b2a7aa48d6fae7bb0e68: baseline-arm64-baylibre 2026-04-07 00:54:10,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2a7aa48d6fae7bb0e68 2026-04-07 00:54:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:10,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a7aa48d6fae7bb0e68 HTTP/1.1" 200 None 2026-04-07 00:54:10,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:10,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:10,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:10,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2a7aa48d6fae7bb0e68 HTTP/1.1" 200 None 2026-04-07 00:54:10,498 - lava_callback - ERROR - Error processing callback for node 69d1b2a7aa48d6fae7bb0e68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:54:19,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:19,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60886 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:54:26,651 - lava_callback - INFO - Received callback for node 69d1b2baaa48d6fae7bb0ea3 INFO: 172.21.0.1:60888 - "POST /node/69d1b2baaa48d6fae7bb0ea3 HTTP/1.0" 202 Accepted 2026-04-07 00:54:26,660 - lava_callback - INFO - Starting async job submit for node 69d1b2baaa48d6fae7bb0ea3 2026-04-07 00:54:26,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:26,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2baaa48d6fae7bb0ea3 HTTP/1.1" 200 None 2026-04-07 00:54:26,687 - lava_callback - DEBUG - Processing node 69d1b2baaa48d6fae7bb0ea3: baseline-arm64-clabbe 2026-04-07 00:54:26,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2baaa48d6fae7bb0ea3 2026-04-07 00:54:26,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:26,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2baaa48d6fae7bb0ea3 HTTP/1.1" 200 None 2026-04-07 00:54:26,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:26,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:26,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:26,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2baaa48d6fae7bb0ea3 HTTP/1.1" 200 None 2026-04-07 00:54:26,782 - lava_callback - ERROR - Error processing callback for node 69d1b2baaa48d6fae7bb0ea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:27,354 - lava_callback - INFO - Received callback for node 69d1b2bcaa48d6fae7bb0ea7 INFO: 172.21.0.1:60892 - "POST /node/69d1b2bcaa48d6fae7bb0ea7 HTTP/1.0" 202 Accepted 2026-04-07 00:54:27,363 - lava_callback - INFO - Starting async job submit for node 69d1b2bcaa48d6fae7bb0ea7 2026-04-07 00:54:27,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:27,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bcaa48d6fae7bb0ea7 HTTP/1.1" 200 None 2026-04-07 00:54:27,395 - lava_callback - DEBUG - Processing node 69d1b2bcaa48d6fae7bb0ea7: baseline-arm64-clabbe 2026-04-07 00:54:27,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2bcaa48d6fae7bb0ea7 2026-04-07 00:54:27,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:27,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bcaa48d6fae7bb0ea7 HTTP/1.1" 200 None 2026-04-07 00:54:27,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:27,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:27,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:27,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2bcaa48d6fae7bb0ea7 HTTP/1.1" 200 None 2026-04-07 00:54:27,494 - lava_callback - ERROR - Error processing callback for node 69d1b2bcaa48d6fae7bb0ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:28,045 - lava_callback - INFO - Received callback for node 69d1b2bdaa48d6fae7bb0eaa INFO: 172.21.0.1:60896 - "POST /node/69d1b2bdaa48d6fae7bb0eaa HTTP/1.0" 202 Accepted 2026-04-07 00:54:28,055 - lava_callback - INFO - Starting async job submit for node 69d1b2bdaa48d6fae7bb0eaa 2026-04-07 00:54:28,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bdaa48d6fae7bb0eaa HTTP/1.1" 200 None 2026-04-07 00:54:28,086 - lava_callback - DEBUG - Processing node 69d1b2bdaa48d6fae7bb0eaa: baseline-arm64-clabbe 2026-04-07 00:54:28,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2bdaa48d6fae7bb0eaa 2026-04-07 00:54:28,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bdaa48d6fae7bb0eaa HTTP/1.1" 200 None 2026-04-07 00:54:28,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:28,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2bdaa48d6fae7bb0eaa HTTP/1.1" 200 None 2026-04-07 00:54:28,179 - lava_callback - ERROR - Error processing callback for node 69d1b2bdaa48d6fae7bb0eaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:28,748 - lava_callback - INFO - Received callback for node 69d1b2bdaa48d6fae7bb0ead INFO: 172.21.0.1:60908 - "POST /node/69d1b2bdaa48d6fae7bb0ead HTTP/1.0" 202 Accepted 2026-04-07 00:54:28,757 - lava_callback - INFO - Starting async job submit for node 69d1b2bdaa48d6fae7bb0ead 2026-04-07 00:54:28,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bdaa48d6fae7bb0ead HTTP/1.1" 200 None 2026-04-07 00:54:28,785 - lava_callback - DEBUG - Processing node 69d1b2bdaa48d6fae7bb0ead: baseline-arm64-clabbe 2026-04-07 00:54:28,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2bdaa48d6fae7bb0ead 2026-04-07 00:54:28,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bdaa48d6fae7bb0ead HTTP/1.1" 200 None 2026-04-07 00:54:28,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:28,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:28,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2bdaa48d6fae7bb0ead HTTP/1.1" 200 None 2026-04-07 00:54:28,880 - lava_callback - ERROR - Error processing callback for node 69d1b2bdaa48d6fae7bb0ead: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:29,451 - lava_callback - INFO - Received callback for node 69d1b2c0aa48d6fae7bb0ed3 INFO: 172.21.0.1:60910 - "POST /node/69d1b2c0aa48d6fae7bb0ed3 HTTP/1.0" 202 Accepted 2026-04-07 00:54:29,460 - lava_callback - INFO - Starting async job submit for node 69d1b2c0aa48d6fae7bb0ed3 2026-04-07 00:54:29,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:29,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c0aa48d6fae7bb0ed3 HTTP/1.1" 200 None 2026-04-07 00:54:29,498 - lava_callback - DEBUG - Processing node 69d1b2c0aa48d6fae7bb0ed3: baseline-arm64-clabbe 2026-04-07 00:54:29,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2c0aa48d6fae7bb0ed3 2026-04-07 00:54:29,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:29,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c0aa48d6fae7bb0ed3 HTTP/1.1" 200 None 2026-04-07 00:54:29,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:29,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:29,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:29,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c0aa48d6fae7bb0ed3 HTTP/1.1" 200 None 2026-04-07 00:54:29,583 - lava_callback - ERROR - Error processing callback for node 69d1b2c0aa48d6fae7bb0ed3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 00:54:30,137 - lava_callback - INFO - Received callback for node 69d1b2bfaa48d6fae7bb0ed0 INFO: 172.21.0.1:58052 - "POST /node/69d1b2bfaa48d6fae7bb0ed0 HTTP/1.0" 202 Accepted 2026-04-07 00:54:30,145 - lava_callback - INFO - Starting async job submit for node 69d1b2bfaa48d6fae7bb0ed0 2026-04-07 00:54:30,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:30,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bfaa48d6fae7bb0ed0 HTTP/1.1" 200 None 2026-04-07 00:54:30,183 - lava_callback - DEBUG - Processing node 69d1b2bfaa48d6fae7bb0ed0: baseline-arm64-clabbe 2026-04-07 00:54:30,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b2bfaa48d6fae7bb0ed0 2026-04-07 00:54:30,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:30,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2bfaa48d6fae7bb0ed0 HTTP/1.1" 200 None 2026-04-07 00:54:30,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:30,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 00:54:30,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:30,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2bfaa48d6fae7bb0ed0 HTTP/1.1" 200 None 2026-04-07 00:54:30,275 - lava_callback - ERROR - Error processing callback for node 69d1b2bfaa48d6fae7bb0ed0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:54:43,668 - lava_callback - INFO - Received callback for node 69d452148fbbb5910331fc1a INFO: 172.21.0.1:54438 - "POST /node/69d452148fbbb5910331fc1a HTTP/1.0" 202 Accepted 2026-04-07 00:54:43,683 - lava_callback - INFO - Starting async job submit for node 69d452148fbbb5910331fc1a 2026-04-07 00:54:43,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452148fbbb5910331fc1a HTTP/1.1" 200 None 2026-04-07 00:54:43,803 - lava_callback - DEBUG - Processing node 69d452148fbbb5910331fc1a: baseline-x86 2026-04-07 00:54:45,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:54:45,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:54:45,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc1a/log.txt.gz 2026-04-07 00:54:46,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:54:47,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:54:47,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc1a/lava-logs.yaml 2026-04-07 00:54:47,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:54:48,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:54:48,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d452148fbbb5910331fc1a/lava_callback.json.gz DEBUG: Setup failed for 69d452148fbbb5910331fc1a. Transitting job node result: incomplete -> fail 2026-04-07 00:54:48,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:48,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d452148fbbb5910331fc1a HTTP/1.1" 200 None 2026-04-07 00:54:48,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:48,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 00:54:48,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:48,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d452148fbbb5910331fc1a HTTP/1.1" 200 None 2026-04-07 00:54:48,694 - lava_callback - INFO - Completed processing callback for node 69d452148fbbb5910331fc1a 2026-04-07 00:54:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:54:49,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:08,046 - lava_callback - INFO - Received callback for node 69d454af8fbbb5910332004c INFO: 172.21.0.1:57258 - "POST /node/69d454af8fbbb5910332004c HTTP/1.0" 202 Accepted 2026-04-07 00:56:08,066 - lava_callback - INFO - Starting async job submit for node 69d454af8fbbb5910332004c 2026-04-07 00:56:08,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:08,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454af8fbbb5910332004c HTTP/1.1" 200 None 2026-04-07 00:56:08,188 - lava_callback - DEBUG - Processing node 69d454af8fbbb5910332004c: baseline-arm64-foundriesio 2026-04-07 00:56:10,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:10,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:10,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454af8fbbb5910332004c/log.txt.gz 2026-04-07 00:56:12,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:56:13,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:13,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454af8fbbb5910332004c/lava-logs.yaml 2026-04-07 00:56:13,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:56:14,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:14,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d454af8fbbb5910332004c/lava_callback.json.gz DEBUG: Setup failed for 69d454af8fbbb5910332004c. Transitting job node result: incomplete -> fail 2026-04-07 00:56:14,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:14,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454af8fbbb5910332004c HTTP/1.1" 200 None 2026-04-07 00:56:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:14,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:56:14,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:14,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454af8fbbb5910332004c HTTP/1.1" 200 None 2026-04-07 00:56:14,756 - lava_callback - INFO - Completed processing callback for node 69d454af8fbbb5910332004c INFO: 172.21.0.1:43128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:19,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:19,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:33,910 - lava_callback - INFO - Received callback for node 69d454798fbbb5910331ff21 INFO: 172.21.0.1:42452 - "POST /node/69d454798fbbb5910331ff21 HTTP/1.0" 202 Accepted 2026-04-07 00:56:33,926 - lava_callback - INFO - Starting async job submit for node 69d454798fbbb5910331ff21 2026-04-07 00:56:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:34,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454798fbbb5910331ff21 HTTP/1.1" 200 None 2026-04-07 00:56:34,031 - lava_callback - DEBUG - Processing node 69d454798fbbb5910331ff21: baseline-arm64 2026-04-07 00:56:34,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:56:35,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:35,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454798fbbb5910331ff21/log.txt.gz 2026-04-07 00:56:35,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:56:36,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:36,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454798fbbb5910331ff21/lava-logs.yaml INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:36,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 00:56:37,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 00:56:37,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454798fbbb5910331ff21/lava_callback.json.gz DEBUG: Setup failed for 69d454798fbbb5910331ff21. Transitting job node result: incomplete -> fail 2026-04-07 00:56:37,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:37,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454798fbbb5910331ff21 HTTP/1.1" 200 None 2026-04-07 00:56:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:37,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 00:56:37,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:37,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454798fbbb5910331ff21 HTTP/1.1" 200 None 2026-04-07 00:56:37,701 - lava_callback - INFO - Completed processing callback for node 69d454798fbbb5910331ff21 INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:56:49,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:56:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:57:07,916 - lava_callback - INFO - Received callback for node 69d1b361aa48d6fae7bb1006 INFO: 172.21.0.1:48496 - "POST /node/69d1b361aa48d6fae7bb1006 HTTP/1.0" 202 Accepted 2026-04-07 00:57:07,925 - lava_callback - INFO - Starting async job submit for node 69d1b361aa48d6fae7bb1006 2026-04-07 00:57:07,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:57:07,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b361aa48d6fae7bb1006 HTTP/1.1" 200 None 2026-04-07 00:57:07,954 - lava_callback - DEBUG - Processing node 69d1b361aa48d6fae7bb1006: baseline-arm-baylibre 2026-04-07 00:57:07,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b361aa48d6fae7bb1006 2026-04-07 00:57:07,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:57:07,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b361aa48d6fae7bb1006 HTTP/1.1" 200 None 2026-04-07 00:57:07,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:57:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 00:57:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:57:08,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b361aa48d6fae7bb1006 HTTP/1.1" 200 None 2026-04-07 00:57:08,056 - lava_callback - ERROR - Error processing callback for node 69d1b361aa48d6fae7bb1006: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:59:07,994 - lava_callback - INFO - Received callback for node 69d1b3c9aa48d6fae7bb107c INFO: 172.21.0.1:55644 - "POST /node/69d1b3c9aa48d6fae7bb107c HTTP/1.0" 202 Accepted 2026-04-07 00:59:08,003 - lava_callback - INFO - Starting async job submit for node 69d1b3c9aa48d6fae7bb107c 2026-04-07 00:59:08,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:08,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b3c9aa48d6fae7bb107c HTTP/1.1" 200 None 2026-04-07 00:59:08,020 - lava_callback - DEBUG - Processing node 69d1b3c9aa48d6fae7bb107c: baseline-arm-baylibre 2026-04-07 00:59:08,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b3c9aa48d6fae7bb107c 2026-04-07 00:59:08,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:08,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b3c9aa48d6fae7bb107c HTTP/1.1" 200 None 2026-04-07 00:59:08,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:08,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 00:59:08,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:08,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b3c9aa48d6fae7bb107c HTTP/1.1" 200 None 2026-04-07 00:59:08,098 - lava_callback - ERROR - Error processing callback for node 69d1b3c9aa48d6fae7bb107c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK 2026-04-07 00:59:27,874 - lava_callback - INFO - Received callback for node 69d1b3e4aa48d6fae7bb10d5 INFO: 172.21.0.1:44430 - "POST /node/69d1b3e4aa48d6fae7bb10d5 HTTP/1.0" 202 Accepted 2026-04-07 00:59:27,880 - lava_callback - INFO - Starting async job submit for node 69d1b3e4aa48d6fae7bb10d5 2026-04-07 00:59:27,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:27,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b3e4aa48d6fae7bb10d5 HTTP/1.1" 200 None 2026-04-07 00:59:27,905 - lava_callback - DEBUG - Processing node 69d1b3e4aa48d6fae7bb10d5: baseline-arm-baylibre 2026-04-07 00:59:27,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b3e4aa48d6fae7bb10d5 2026-04-07 00:59:27,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:27,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b3e4aa48d6fae7bb10d5 HTTP/1.1" 200 None 2026-04-07 00:59:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:27,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 00:59:27,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 00:59:27,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b3e4aa48d6fae7bb10d5 HTTP/1.1" 200 None 2026-04-07 00:59:27,962 - lava_callback - ERROR - Error processing callback for node 69d1b3e4aa48d6fae7bb10d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:00:07,933 - lava_callback - INFO - Received callback for node 69d1b403aa48d6fae7bb10f1 INFO: 172.21.0.1:55776 - "POST /node/69d1b403aa48d6fae7bb10f1 HTTP/1.0" 202 Accepted 2026-04-07 01:00:07,938 - lava_callback - INFO - Starting async job submit for node 69d1b403aa48d6fae7bb10f1 2026-04-07 01:00:07,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:07,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b403aa48d6fae7bb10f1 HTTP/1.1" 200 None 2026-04-07 01:00:07,956 - lava_callback - DEBUG - Processing node 69d1b403aa48d6fae7bb10f1: baseline-arm-baylibre 2026-04-07 01:00:07,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b403aa48d6fae7bb10f1 2026-04-07 01:00:07,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:07,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b403aa48d6fae7bb10f1 HTTP/1.1" 200 None 2026-04-07 01:00:07,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:00:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:08,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b403aa48d6fae7bb10f1 HTTP/1.1" 200 None 2026-04-07 01:00:08,011 - lava_callback - ERROR - Error processing callback for node 69d1b403aa48d6fae7bb10f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:00:27,993 - lava_callback - INFO - Received callback for node 69d1b427aa48d6fae7bb1132 INFO: 172.21.0.1:45332 - "POST /node/69d1b427aa48d6fae7bb1132 HTTP/1.0" 202 Accepted 2026-04-07 01:00:27,998 - lava_callback - INFO - Starting async job submit for node 69d1b427aa48d6fae7bb1132 2026-04-07 01:00:27,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:28,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b427aa48d6fae7bb1132 HTTP/1.1" 200 None 2026-04-07 01:00:28,015 - lava_callback - DEBUG - Processing node 69d1b427aa48d6fae7bb1132: baseline-arm-baylibre 2026-04-07 01:00:28,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b427aa48d6fae7bb1132 2026-04-07 01:00:28,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:28,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b427aa48d6fae7bb1132 HTTP/1.1" 200 None 2026-04-07 01:00:28,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:28,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:00:28,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:00:28,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b427aa48d6fae7bb1132 HTTP/1.1" 200 None 2026-04-07 01:00:28,092 - lava_callback - ERROR - Error processing callback for node 69d1b427aa48d6fae7bb1132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:01:07,983 - lava_callback - INFO - Received callback for node 69d1b446aa48d6fae7bb115e INFO: 172.21.0.1:49786 - "POST /node/69d1b446aa48d6fae7bb115e HTTP/1.0" 202 Accepted 2026-04-07 01:01:07,989 - lava_callback - INFO - Starting async job submit for node 69d1b446aa48d6fae7bb115e 2026-04-07 01:01:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b446aa48d6fae7bb115e HTTP/1.1" 200 None 2026-04-07 01:01:08,008 - lava_callback - DEBUG - Processing node 69d1b446aa48d6fae7bb115e: baseline-arm-baylibre 2026-04-07 01:01:08,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b446aa48d6fae7bb115e 2026-04-07 01:01:08,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:08,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b446aa48d6fae7bb115e HTTP/1.1" 200 None 2026-04-07 01:01:08,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:08,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:01:08,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:08,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b446aa48d6fae7bb115e HTTP/1.1" 200 None 2026-04-07 01:01:08,084 - lava_callback - ERROR - Error processing callback for node 69d1b446aa48d6fae7bb115e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 01:01:15,407 - lava_callback - INFO - Received callback for node 69d457488fbbb59103320439 INFO: 172.21.0.1:49182 - "POST /node/69d457488fbbb59103320439 HTTP/1.0" 202 Accepted 2026-04-07 01:01:15,413 - lava_callback - INFO - Starting async job submit for node 69d457488fbbb59103320439 2026-04-07 01:01:15,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:15,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d457488fbbb59103320439 HTTP/1.1" 200 None 2026-04-07 01:01:15,430 - lava_callback - DEBUG - Processing node 69d457488fbbb59103320439: baseline-arm 2026-04-07 01:01:15,435 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:01:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:01:15,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:01:15,584 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d457488fbbb59103320439/lava-logs.yaml 2026-04-07 01:01:15,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:01:15,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:01:15,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d457488fbbb59103320439/lava_callback.json.gz 2026-04-07 01:01:15,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:15,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d457488fbbb59103320439 HTTP/1.1" 200 None 2026-04-07 01:01:15,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:15,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 01:01:15,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:15,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d457488fbbb59103320439 HTTP/1.1" 200 None 2026-04-07 01:01:15,773 - lava_callback - INFO - Completed processing callback for node 69d457488fbbb59103320439 INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:01:19,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:19,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:01:48,051 - lava_callback - INFO - Received callback for node 69d1b468aa48d6fae7bb1176 INFO: 172.21.0.1:52988 - "POST /node/69d1b468aa48d6fae7bb1176 HTTP/1.0" 202 Accepted 2026-04-07 01:01:48,057 - lava_callback - INFO - Starting async job submit for node 69d1b468aa48d6fae7bb1176 2026-04-07 01:01:48,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:48,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b468aa48d6fae7bb1176 HTTP/1.1" 200 None 2026-04-07 01:01:48,072 - lava_callback - DEBUG - Processing node 69d1b468aa48d6fae7bb1176: baseline-arm-baylibre 2026-04-07 01:01:48,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b468aa48d6fae7bb1176 2026-04-07 01:01:48,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:48,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b468aa48d6fae7bb1176 HTTP/1.1" 200 None 2026-04-07 01:01:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:48,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:01:48,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:01:48,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b468aa48d6fae7bb1176 HTTP/1.1" 200 None 2026-04-07 01:01:48,129 - lava_callback - ERROR - Error processing callback for node 69d1b468aa48d6fae7bb1176: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:02:08,014 - lava_callback - INFO - Received callback for node 69d1b48aaa48d6fae7bb119a INFO: 172.21.0.1:33182 - "POST /node/69d1b48aaa48d6fae7bb119a HTTP/1.0" 202 Accepted 2026-04-07 01:02:08,020 - lava_callback - INFO - Starting async job submit for node 69d1b48aaa48d6fae7bb119a 2026-04-07 01:02:08,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:08,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b48aaa48d6fae7bb119a HTTP/1.1" 200 None 2026-04-07 01:02:08,035 - lava_callback - DEBUG - Processing node 69d1b48aaa48d6fae7bb119a: baseline-arm-baylibre 2026-04-07 01:02:08,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b48aaa48d6fae7bb119a 2026-04-07 01:02:08,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:08,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b48aaa48d6fae7bb119a HTTP/1.1" 200 None 2026-04-07 01:02:08,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:08,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:02:08,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:08,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b48aaa48d6fae7bb119a HTTP/1.1" 200 None 2026-04-07 01:02:08,099 - lava_callback - ERROR - Error processing callback for node 69d1b48aaa48d6fae7bb119a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:02:48,046 - lava_callback - INFO - Received callback for node 69d1b4a5aa48d6fae7bb11dd INFO: 172.21.0.1:42718 - "POST /node/69d1b4a5aa48d6fae7bb11dd HTTP/1.0" 202 Accepted 2026-04-07 01:02:48,052 - lava_callback - INFO - Starting async job submit for node 69d1b4a5aa48d6fae7bb11dd 2026-04-07 01:02:48,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:48,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4a5aa48d6fae7bb11dd HTTP/1.1" 200 None 2026-04-07 01:02:48,077 - lava_callback - DEBUG - Processing node 69d1b4a5aa48d6fae7bb11dd: baseline-arm-baylibre 2026-04-07 01:02:48,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b4a5aa48d6fae7bb11dd 2026-04-07 01:02:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:48,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4a5aa48d6fae7bb11dd HTTP/1.1" 200 None 2026-04-07 01:02:48,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:02:48,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:02:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b4a5aa48d6fae7bb11dd HTTP/1.1" 200 None 2026-04-07 01:02:48,134 - lava_callback - ERROR - Error processing callback for node 69d1b4a5aa48d6fae7bb11dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:03:07,082 - lava_callback - INFO - Received callback for node 69d1b4c4aa48d6fae7bb120d INFO: 172.21.0.1:38670 - "POST /node/69d1b4c4aa48d6fae7bb120d HTTP/1.0" 202 Accepted 2026-04-07 01:03:07,088 - lava_callback - INFO - Starting async job submit for node 69d1b4c4aa48d6fae7bb120d 2026-04-07 01:03:07,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:07,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4c4aa48d6fae7bb120d HTTP/1.1" 200 None 2026-04-07 01:03:07,105 - lava_callback - DEBUG - Processing node 69d1b4c4aa48d6fae7bb120d: baseline-arm-clabbe 2026-04-07 01:03:07,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b4c4aa48d6fae7bb120d 2026-04-07 01:03:07,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:07,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4c4aa48d6fae7bb120d HTTP/1.1" 200 None 2026-04-07 01:03:07,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:07,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:03:07,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:07,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b4c4aa48d6fae7bb120d HTTP/1.1" 200 None 2026-04-07 01:03:07,178 - lava_callback - ERROR - Error processing callback for node 69d1b4c4aa48d6fae7bb120d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:03:17,071 - lava_callback - INFO - Received callback for node 69d451ab8fbbb5910331fb54 INFO: 172.21.0.1:39294 - "POST /node/69d451ab8fbbb5910331fb54 HTTP/1.0" 202 Accepted 2026-04-07 01:03:17,117 - lava_callback - INFO - Starting async job submit for node 69d451ab8fbbb5910331fb54 2026-04-07 01:03:17,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:17,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451ab8fbbb5910331fb54 HTTP/1.1" 200 None 2026-04-07 01:03:17,158 - lava_callback - DEBUG - Processing node 69d451ab8fbbb5910331fb54: ltp-syscalls-ipc 2026-04-07 01:03:17,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:03:17,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:03:17,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d451ab8fbbb5910331fb54/log.txt.gz 2026-04-07 01:03:17,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:03:17,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:03:17,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d451ab8fbbb5910331fb54/lava-logs.yaml 2026-04-07 01:03:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:03:17,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:03:17,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d451ab8fbbb5910331fb54/lava_callback.json.gz 2026-04-07 01:03:17,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:17,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d451ab8fbbb5910331fb54 HTTP/1.1" 200 None 2026-04-07 01:03:17,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:17,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 01:03:17,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:17,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d451ab8fbbb5910331fb54 HTTP/1.1" 200 None 2026-04-07 01:03:18,034 - lava_callback - INFO - Completed processing callback for node 69d451ab8fbbb5910331fb54 2026-04-07 01:03:19,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:19,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:03:47,047 - lava_callback - INFO - Received callback for node 69d1b4e1aa48d6fae7bb123b INFO: 172.21.0.1:42502 - "POST /node/69d1b4e1aa48d6fae7bb123b HTTP/1.0" 202 Accepted 2026-04-07 01:03:47,053 - lava_callback - INFO - Starting async job submit for node 69d1b4e1aa48d6fae7bb123b 2026-04-07 01:03:47,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:47,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4e1aa48d6fae7bb123b HTTP/1.1" 200 None 2026-04-07 01:03:47,068 - lava_callback - DEBUG - Processing node 69d1b4e1aa48d6fae7bb123b: baseline-arm-clabbe 2026-04-07 01:03:47,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b4e1aa48d6fae7bb123b 2026-04-07 01:03:47,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:47,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b4e1aa48d6fae7bb123b HTTP/1.1" 200 None 2026-04-07 01:03:47,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:47,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:03:47,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:03:47,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b4e1aa48d6fae7bb123b HTTP/1.1" 200 None 2026-04-07 01:03:47,130 - lava_callback - ERROR - Error processing callback for node 69d1b4e1aa48d6fae7bb123b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:04:07,117 - lava_callback - INFO - Received callback for node 69d1b502aa48d6fae7bb1264 INFO: 172.21.0.1:39476 - "POST /node/69d1b502aa48d6fae7bb1264 HTTP/1.0" 202 Accepted 2026-04-07 01:04:07,122 - lava_callback - INFO - Starting async job submit for node 69d1b502aa48d6fae7bb1264 2026-04-07 01:04:07,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:07,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b502aa48d6fae7bb1264 HTTP/1.1" 200 None 2026-04-07 01:04:07,139 - lava_callback - DEBUG - Processing node 69d1b502aa48d6fae7bb1264: baseline-arm-clabbe 2026-04-07 01:04:07,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b502aa48d6fae7bb1264 2026-04-07 01:04:07,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:07,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b502aa48d6fae7bb1264 HTTP/1.1" 200 None 2026-04-07 01:04:07,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:07,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:04:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:07,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b502aa48d6fae7bb1264 HTTP/1.1" 200 None 2026-04-07 01:04:07,203 - lava_callback - ERROR - Error processing callback for node 69d1b502aa48d6fae7bb1264: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:04:17,453 - lava_callback - INFO - Received callback for node 69d457248fbbb591033203fe INFO: 172.21.0.1:49898 - "POST /node/69d457248fbbb591033203fe HTTP/1.0" 202 Accepted 2026-04-07 01:04:17,460 - lava_callback - INFO - Starting async job submit for node 69d457248fbbb591033203fe 2026-04-07 01:04:17,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:17,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d457248fbbb591033203fe HTTP/1.1" 200 None 2026-04-07 01:04:17,501 - lava_callback - DEBUG - Processing node 69d457248fbbb591033203fe: ltp-ipc 2026-04-07 01:04:17,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:04:18,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:04:18,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d457248fbbb591033203fe/log.txt.gz 2026-04-07 01:04:18,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:04:18,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:04:18,470 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d457248fbbb591033203fe/lava-logs.yaml 2026-04-07 01:04:18,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:04:18,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:04:18,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d457248fbbb591033203fe/lava_callback.json.gz 2026-04-07 01:04:18,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:18,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d457248fbbb591033203fe HTTP/1.1" 200 None 2026-04-07 01:04:18,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:18,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 01:04:18,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:18,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d457248fbbb591033203fe HTTP/1.1" 200 None 2026-04-07 01:04:18,803 - lava_callback - INFO - Completed processing callback for node 69d457248fbbb591033203fe 2026-04-07 01:04:19,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:19,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:04:42,346 - lava_callback - INFO - Received callback for node 69d458188fbbb591033204bc INFO: 172.21.0.1:34200 - "POST /node/69d458188fbbb591033204bc HTTP/1.0" 202 Accepted 2026-04-07 01:04:42,352 - lava_callback - INFO - Starting async job submit for node 69d458188fbbb591033204bc 2026-04-07 01:04:42,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:42,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d458188fbbb591033204bc HTTP/1.1" 200 None 2026-04-07 01:04:42,368 - lava_callback - DEBUG - Processing node 69d458188fbbb591033204bc: baseline-nfs-arm64 2026-04-07 01:04:42,370 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:04:42,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:04:42,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:04:42,508 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d458188fbbb591033204bc/lava-logs.yaml 2026-04-07 01:04:42,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:04:42,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:04:42,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d458188fbbb591033204bc/lava_callback.json.gz 2026-04-07 01:04:42,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:42,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d458188fbbb591033204bc HTTP/1.1" 200 None 2026-04-07 01:04:42,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:42,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:04:42,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:42,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d458188fbbb591033204bc HTTP/1.1" 200 None 2026-04-07 01:04:42,686 - lava_callback - INFO - Completed processing callback for node 69d458188fbbb591033204bc INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:04:47,095 - lava_callback - INFO - Received callback for node 69d1b527aa48d6fae7bb1274 INFO: 172.21.0.1:34224 - "POST /node/69d1b527aa48d6fae7bb1274 HTTP/1.0" 202 Accepted 2026-04-07 01:04:47,102 - lava_callback - INFO - Starting async job submit for node 69d1b527aa48d6fae7bb1274 2026-04-07 01:04:47,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:47,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b527aa48d6fae7bb1274 HTTP/1.1" 200 None 2026-04-07 01:04:47,122 - lava_callback - DEBUG - Processing node 69d1b527aa48d6fae7bb1274: baseline-arm-clabbe 2026-04-07 01:04:47,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b527aa48d6fae7bb1274 2026-04-07 01:04:47,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:47,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b527aa48d6fae7bb1274 HTTP/1.1" 200 None 2026-04-07 01:04:47,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:47,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:04:47,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:47,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b527aa48d6fae7bb1274 HTTP/1.1" 200 None 2026-04-07 01:04:47,206 - lava_callback - ERROR - Error processing callback for node 69d1b527aa48d6fae7bb1274: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 01:04:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:04:49,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:05:27,147 - lava_callback - INFO - Received callback for node 69d1b549aa48d6fae7bb1281 INFO: 172.21.0.1:49164 - "POST /node/69d1b549aa48d6fae7bb1281 HTTP/1.0" 202 Accepted 2026-04-07 01:05:27,153 - lava_callback - INFO - Starting async job submit for node 69d1b549aa48d6fae7bb1281 2026-04-07 01:05:27,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:05:27,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b549aa48d6fae7bb1281 HTTP/1.1" 200 None 2026-04-07 01:05:27,170 - lava_callback - DEBUG - Processing node 69d1b549aa48d6fae7bb1281: baseline-arm-clabbe 2026-04-07 01:05:27,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b549aa48d6fae7bb1281 2026-04-07 01:05:27,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:05:27,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b549aa48d6fae7bb1281 HTTP/1.1" 200 None 2026-04-07 01:05:27,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:05:27,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:05:27,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:05:27,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b549aa48d6fae7bb1281 HTTP/1.1" 200 None 2026-04-07 01:05:27,233 - lava_callback - ERROR - Error processing callback for node 69d1b549aa48d6fae7bb1281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:06:07,110 - lava_callback - INFO - Received callback for node 69d1b56daa48d6fae7bb12aa INFO: 172.21.0.1:47096 - "POST /node/69d1b56daa48d6fae7bb12aa HTTP/1.0" 202 Accepted 2026-04-07 01:06:07,116 - lava_callback - INFO - Starting async job submit for node 69d1b56daa48d6fae7bb12aa 2026-04-07 01:06:07,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:07,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b56daa48d6fae7bb12aa HTTP/1.1" 200 None 2026-04-07 01:06:07,151 - lava_callback - DEBUG - Processing node 69d1b56daa48d6fae7bb12aa: baseline-arm-clabbe 2026-04-07 01:06:07,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b56daa48d6fae7bb12aa 2026-04-07 01:06:07,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:07,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b56daa48d6fae7bb12aa HTTP/1.1" 200 None 2026-04-07 01:06:07,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:07,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 01:06:07,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:07,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b56daa48d6fae7bb12aa HTTP/1.1" 200 None 2026-04-07 01:06:07,202 - lava_callback - ERROR - Error processing callback for node 69d1b56daa48d6fae7bb12aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:06:28,316 - lava_callback - INFO - Received callback for node 69d1b58eaa48d6fae7bb12bb INFO: 172.21.0.1:49946 - "POST /node/69d1b58eaa48d6fae7bb12bb HTTP/1.0" 202 Accepted 2026-04-07 01:06:28,322 - lava_callback - INFO - Starting async job submit for node 69d1b58eaa48d6fae7bb12bb 2026-04-07 01:06:28,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:28,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b58eaa48d6fae7bb12bb HTTP/1.1" 200 None 2026-04-07 01:06:28,348 - lava_callback - DEBUG - Processing node 69d1b58eaa48d6fae7bb12bb: baseline-arm-baylibre 2026-04-07 01:06:28,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b58eaa48d6fae7bb12bb 2026-04-07 01:06:28,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:28,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b58eaa48d6fae7bb12bb HTTP/1.1" 200 None 2026-04-07 01:06:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:28,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:06:28,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:06:28,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b58eaa48d6fae7bb12bb HTTP/1.1" 200 None 2026-04-07 01:06:28,407 - lava_callback - ERROR - Error processing callback for node 69d1b58eaa48d6fae7bb12bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:08:54,151 - lava_callback - INFO - Received callback for node 69d4547e8fbbb5910331ff35 INFO: 172.21.0.1:53596 - "POST /node/69d4547e8fbbb5910331ff35 HTTP/1.0" 202 Accepted 2026-04-07 01:08:54,164 - lava_callback - INFO - Starting async job submit for node 69d4547e8fbbb5910331ff35 2026-04-07 01:08:54,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:08:54,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547e8fbbb5910331ff35 HTTP/1.1" 200 None 2026-04-07 01:08:54,284 - lava_callback - DEBUG - Processing node 69d4547e8fbbb5910331ff35: baseline-nfs-arm64 2026-04-07 01:08:55,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:08:56,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:08:56,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547e8fbbb5910331ff35/log.txt.gz INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:08:57,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:08:57,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:08:57,607 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547e8fbbb5910331ff35/lava-logs.yaml 2026-04-07 01:08:57,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:08:57,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:08:57,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4547e8fbbb5910331ff35/lava_callback.json.gz DEBUG: Setup failed for 69d4547e8fbbb5910331ff35. Transitting job node result: incomplete -> fail 2026-04-07 01:08:57,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:08:57,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4547e8fbbb5910331ff35 HTTP/1.1" 200 None 2026-04-07 01:08:57,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:08:58,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:08:58,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:08:58,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4547e8fbbb5910331ff35 HTTP/1.1" 200 None 2026-04-07 01:08:58,204 - lava_callback - INFO - Completed processing callback for node 69d4547e8fbbb5910331ff35 INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:09:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:09:20,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:10:29,798 - lava_callback - INFO - Received callback for node 69d458df8fbbb591033205af INFO: 172.21.0.1:55026 - "POST /node/69d458df8fbbb591033205af HTTP/1.0" 202 Accepted 2026-04-07 01:10:29,809 - lava_callback - INFO - Starting async job submit for node 69d458df8fbbb591033205af 2026-04-07 01:10:29,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:10:29,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d458df8fbbb591033205af HTTP/1.1" 200 None 2026-04-07 01:10:29,881 - lava_callback - DEBUG - Processing node 69d458df8fbbb591033205af: baseline-arm64-broonie 2026-04-07 01:10:30,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:10:30,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:10:30,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d458df8fbbb591033205af/log.txt.gz 2026-04-07 01:10:30,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:10:30,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:10:30,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d458df8fbbb591033205af/lava-logs.yaml 2026-04-07 01:10:30,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:10:31,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:10:31,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d458df8fbbb591033205af/lava_callback.json.gz 2026-04-07 01:10:31,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:10:31,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d458df8fbbb591033205af HTTP/1.1" 200 None 2026-04-07 01:10:31,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:10:31,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:10:31,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:10:31,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d458df8fbbb591033205af HTTP/1.1" 200 None 2026-04-07 01:10:31,160 - lava_callback - INFO - Completed processing callback for node 69d458df8fbbb591033205af INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:10:50,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:10:50,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:11:29,360 - lava_callback - INFO - Received callback for node 69d4596a8fbbb59103320644 INFO: 172.21.0.1:57284 - "POST /node/69d4596a8fbbb59103320644 HTTP/1.0" 202 Accepted 2026-04-07 01:11:29,372 - lava_callback - INFO - Starting async job submit for node 69d4596a8fbbb59103320644 2026-04-07 01:11:29,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:11:29,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4596a8fbbb59103320644 HTTP/1.1" 200 None 2026-04-07 01:11:29,462 - lava_callback - DEBUG - Processing node 69d4596a8fbbb59103320644: baseline-arm64-broonie 2026-04-07 01:11:29,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:11:30,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:11:30,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4596a8fbbb59103320644/log.txt.gz 2026-04-07 01:11:30,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:11:30,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:11:30,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4596a8fbbb59103320644/lava-logs.yaml 2026-04-07 01:11:30,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:11:30,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:11:30,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4596a8fbbb59103320644/lava_callback.json.gz 2026-04-07 01:11:30,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:11:30,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4596a8fbbb59103320644 HTTP/1.1" 200 None 2026-04-07 01:11:30,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:11:30,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:11:30,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:11:30,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4596a8fbbb59103320644 HTTP/1.1" 200 None 2026-04-07 01:11:30,712 - lava_callback - INFO - Completed processing callback for node 69d4596a8fbbb59103320644 INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:11:50,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:11:50,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:12:49,675 - lava_callback - INFO - Received callback for node 69d459248fbbb591033205fa INFO: 172.21.0.1:36972 - "POST /node/69d459248fbbb591033205fa HTTP/1.0" 202 Accepted 2026-04-07 01:12:49,681 - lava_callback - INFO - Starting async job submit for node 69d459248fbbb591033205fa 2026-04-07 01:12:49,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:12:49,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d459248fbbb591033205fa HTTP/1.1" 200 None 2026-04-07 01:12:49,722 - lava_callback - DEBUG - Processing node 69d459248fbbb591033205fa: baseline-arm64-broonie 2026-04-07 01:12:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:12:50,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:12:50,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d459248fbbb591033205fa/log.txt.gz 2026-04-07 01:12:50,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:12:50,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:12:50,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d459248fbbb591033205fa/lava-logs.yaml 2026-04-07 01:12:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:12:50,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:12:50,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d459248fbbb591033205fa/lava_callback.json.gz 2026-04-07 01:12:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:12:50,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d459248fbbb591033205fa HTTP/1.1" 200 None 2026-04-07 01:12:50,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:12:50,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:12:50,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:12:50,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d459248fbbb591033205fa HTTP/1.1" 200 None 2026-04-07 01:12:50,689 - lava_callback - INFO - Completed processing callback for node 69d459248fbbb591033205fa INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:13:20,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:13:20,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:14:42,989 - lava_callback - INFO - Received callback for node 69d45a4e8fbbb591033206dc INFO: 172.21.0.1:55224 - "POST /node/69d45a4e8fbbb591033206dc HTTP/1.0" 202 Accepted 2026-04-07 01:14:42,996 - lava_callback - INFO - Starting async job submit for node 69d45a4e8fbbb591033206dc 2026-04-07 01:14:43,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:43,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45a4e8fbbb591033206dc HTTP/1.1" 200 None 2026-04-07 01:14:43,041 - lava_callback - DEBUG - Processing node 69d45a4e8fbbb591033206dc: baseline-arm64 2026-04-07 01:14:43,181 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:14:43,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:14:43,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:14:43,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45a4e8fbbb591033206dc/lava-logs.yaml 2026-04-07 01:14:43,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:14:43,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:14:43,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45a4e8fbbb591033206dc/lava_callback.json.gz 2026-04-07 01:14:43,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:43,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45a4e8fbbb591033206dc HTTP/1.1" 200 None 2026-04-07 01:14:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:43,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:14:43,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:43,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45a4e8fbbb591033206dc HTTP/1.1" 200 None 2026-04-07 01:14:43,717 - lava_callback - INFO - Completed processing callback for node 69d45a4e8fbbb591033206dc INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:14:48,821 - lava_callback - INFO - Received callback for node 69d1b781aa48d6fae7bb14af INFO: 172.21.0.1:55236 - "POST /node/69d1b781aa48d6fae7bb14af HTTP/1.0" 202 Accepted 2026-04-07 01:14:48,827 - lava_callback - INFO - Starting async job submit for node 69d1b781aa48d6fae7bb14af 2026-04-07 01:14:48,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:48,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b781aa48d6fae7bb14af HTTP/1.1" 200 None 2026-04-07 01:14:48,844 - lava_callback - DEBUG - Processing node 69d1b781aa48d6fae7bb14af: baseline-arm64-baylibre 2026-04-07 01:14:48,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b781aa48d6fae7bb14af 2026-04-07 01:14:48,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:48,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b781aa48d6fae7bb14af HTTP/1.1" 200 None 2026-04-07 01:14:48,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:48,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:14:48,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b781aa48d6fae7bb14af HTTP/1.1" 200 None 2026-04-07 01:14:48,898 - lava_callback - ERROR - Error processing callback for node 69d1b781aa48d6fae7bb14af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 01:14:50,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:14:50,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:16:23,836 - lava_callback - INFO - Received callback for node 69d45aad8fbbb5910332075a INFO: 172.21.0.1:40932 - "POST /node/69d45aad8fbbb5910332075a HTTP/1.0" 202 Accepted 2026-04-07 01:16:23,843 - lava_callback - INFO - Starting async job submit for node 69d45aad8fbbb5910332075a 2026-04-07 01:16:23,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:23,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45aad8fbbb5910332075a HTTP/1.1" 200 None 2026-04-07 01:16:23,890 - lava_callback - DEBUG - Processing node 69d45aad8fbbb5910332075a: baseline-arm64 2026-04-07 01:16:24,041 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:16:24,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:16:24,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:16:24,325 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45aad8fbbb5910332075a/lava-logs.yaml 2026-04-07 01:16:24,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:16:24,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:16:24,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45aad8fbbb5910332075a/lava_callback.json.gz 2026-04-07 01:16:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:24,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45aad8fbbb5910332075a HTTP/1.1" 200 None 2026-04-07 01:16:24,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:24,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:16:24,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:24,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45aad8fbbb5910332075a HTTP/1.1" 200 None 2026-04-07 01:16:24,616 - lava_callback - INFO - Completed processing callback for node 69d45aad8fbbb5910332075a INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:16:28,842 - lava_callback - INFO - Received callback for node 69d1b7e9aa48d6fae7bb1512 INFO: 172.21.0.1:40948 - "POST /node/69d1b7e9aa48d6fae7bb1512 HTTP/1.0" 202 Accepted 2026-04-07 01:16:28,847 - lava_callback - INFO - Starting async job submit for node 69d1b7e9aa48d6fae7bb1512 2026-04-07 01:16:28,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:28,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b7e9aa48d6fae7bb1512 HTTP/1.1" 200 None 2026-04-07 01:16:28,867 - lava_callback - DEBUG - Processing node 69d1b7e9aa48d6fae7bb1512: baseline-arm64-baylibre 2026-04-07 01:16:28,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b7e9aa48d6fae7bb1512 2026-04-07 01:16:28,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:28,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b7e9aa48d6fae7bb1512 HTTP/1.1" 200 None 2026-04-07 01:16:28,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:28,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:16:28,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:28,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b7e9aa48d6fae7bb1512 HTTP/1.1" 200 None 2026-04-07 01:16:28,936 - lava_callback - ERROR - Error processing callback for node 69d1b7e9aa48d6fae7bb1512: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:16:50,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:16:50,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:17:45,351 - lava_callback - INFO - Received callback for node 69d45af88fbbb59103320789 INFO: 172.21.0.1:58886 - "POST /node/69d45af88fbbb59103320789 HTTP/1.0" 202 Accepted 2026-04-07 01:17:45,358 - lava_callback - INFO - Starting async job submit for node 69d45af88fbbb59103320789 2026-04-07 01:17:45,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:17:45,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45af88fbbb59103320789 HTTP/1.1" 200 None 2026-04-07 01:17:45,397 - lava_callback - DEBUG - Processing node 69d45af88fbbb59103320789: baseline-arm64 2026-04-07 01:17:45,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:17:45,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:17:45,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45af88fbbb59103320789/log.txt.gz 2026-04-07 01:17:46,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:17:46,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:17:46,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45af88fbbb59103320789/lava-logs.yaml 2026-04-07 01:17:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:17:46,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:17:46,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45af88fbbb59103320789/lava_callback.json.gz 2026-04-07 01:17:46,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:17:46,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45af88fbbb59103320789 HTTP/1.1" 200 None 2026-04-07 01:17:46,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:17:46,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:17:46,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:17:46,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45af88fbbb59103320789 HTTP/1.1" 200 None 2026-04-07 01:17:46,789 - lava_callback - INFO - Completed processing callback for node 69d45af88fbbb59103320789 2026-04-07 01:17:50,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:17:50,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:18:27,774 - lava_callback - INFO - Received callback for node 69d1b852aa48d6fae7bb155b INFO: 172.21.0.1:44340 - "POST /node/69d1b852aa48d6fae7bb155b HTTP/1.0" 202 Accepted 2026-04-07 01:18:27,780 - lava_callback - INFO - Starting async job submit for node 69d1b852aa48d6fae7bb155b 2026-04-07 01:18:27,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b852aa48d6fae7bb155b HTTP/1.1" 200 None 2026-04-07 01:18:27,796 - lava_callback - DEBUG - Processing node 69d1b852aa48d6fae7bb155b: baseline-arm64-clabbe 2026-04-07 01:18:27,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b852aa48d6fae7bb155b 2026-04-07 01:18:27,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:27,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b852aa48d6fae7bb155b HTTP/1.1" 200 None 2026-04-07 01:18:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:27,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:18:27,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:27,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b852aa48d6fae7bb155b HTTP/1.1" 200 None 2026-04-07 01:18:27,865 - lava_callback - ERROR - Error processing callback for node 69d1b852aa48d6fae7bb155b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:18:50,993 - lava_callback - INFO - Received callback for node 69d45b538fbbb591033207ce INFO: 172.21.0.1:34620 - "POST /node/69d45b538fbbb591033207ce HTTP/1.0" 202 Accepted 2026-04-07 01:18:50,999 - lava_callback - INFO - Starting async job submit for node 69d45b538fbbb591033207ce 2026-04-07 01:18:51,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:51,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45b538fbbb591033207ce HTTP/1.1" 200 None 2026-04-07 01:18:51,034 - lava_callback - DEBUG - Processing node 69d45b538fbbb591033207ce: baseline-arm64-pengutronix 2026-04-07 01:18:51,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:18:51,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:18:51,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d45b538fbbb591033207ce/log.txt.gz 2026-04-07 01:18:51,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:18:51,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:18:51,854 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d45b538fbbb591033207ce/lava-logs.yaml 2026-04-07 01:18:51,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:18:52,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:18:52,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d45b538fbbb591033207ce/lava_callback.json.gz 2026-04-07 01:18:52,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:52,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45b538fbbb591033207ce HTTP/1.1" 200 None 2026-04-07 01:18:52,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:52,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:18:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:18:52,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45b538fbbb591033207ce HTTP/1.1" 200 None 2026-04-07 01:18:52,091 - lava_callback - INFO - Completed processing callback for node 69d45b538fbbb591033207ce INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:19:20,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:19:20,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:19:27,717 - lava_callback - INFO - Received callback for node 69d1b895aa48d6fae7bb1580 INFO: 172.21.0.1:59226 - "POST /node/69d1b895aa48d6fae7bb1580 HTTP/1.0" 202 Accepted 2026-04-07 01:19:27,722 - lava_callback - INFO - Starting async job submit for node 69d1b895aa48d6fae7bb1580 2026-04-07 01:19:27,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:19:27,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b895aa48d6fae7bb1580 HTTP/1.1" 200 None 2026-04-07 01:19:27,738 - lava_callback - DEBUG - Processing node 69d1b895aa48d6fae7bb1580: baseline-arm64-clabbe 2026-04-07 01:19:27,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b895aa48d6fae7bb1580 2026-04-07 01:19:27,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:19:27,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b895aa48d6fae7bb1580 HTTP/1.1" 200 None 2026-04-07 01:19:27,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:19:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:19:27,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:19:27,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b895aa48d6fae7bb1580 HTTP/1.1" 200 None 2026-04-07 01:19:27,789 - lava_callback - ERROR - Error processing callback for node 69d1b895aa48d6fae7bb1580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:20:47,870 - lava_callback - INFO - Received callback for node 69d1b8dbaa48d6fae7bb15af INFO: 172.21.0.1:57352 - "POST /node/69d1b8dbaa48d6fae7bb15af HTTP/1.0" 202 Accepted 2026-04-07 01:20:47,875 - lava_callback - INFO - Starting async job submit for node 69d1b8dbaa48d6fae7bb15af 2026-04-07 01:20:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:20:47,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b8dbaa48d6fae7bb15af HTTP/1.1" 200 None 2026-04-07 01:20:47,891 - lava_callback - DEBUG - Processing node 69d1b8dbaa48d6fae7bb15af: baseline-arm64-clabbe 2026-04-07 01:20:47,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b8dbaa48d6fae7bb15af 2026-04-07 01:20:47,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:20:47,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b8dbaa48d6fae7bb15af HTTP/1.1" 200 None 2026-04-07 01:20:47,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:20:47,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:20:47,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:20:47,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b8dbaa48d6fae7bb15af HTTP/1.1" 200 None 2026-04-07 01:20:47,965 - lava_callback - ERROR - Error processing callback for node 69d1b8dbaa48d6fae7bb15af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:21:47,876 - lava_callback - INFO - Received callback for node 69d1b91faa48d6fae7bb15e2 INFO: 172.21.0.1:36146 - "POST /node/69d1b91faa48d6fae7bb15e2 HTTP/1.0" 202 Accepted 2026-04-07 01:21:47,882 - lava_callback - INFO - Starting async job submit for node 69d1b91faa48d6fae7bb15e2 2026-04-07 01:21:47,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:21:47,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b91faa48d6fae7bb15e2 HTTP/1.1" 200 None 2026-04-07 01:21:47,897 - lava_callback - DEBUG - Processing node 69d1b91faa48d6fae7bb15e2: baseline-arm64-clabbe 2026-04-07 01:21:47,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b91faa48d6fae7bb15e2 2026-04-07 01:21:47,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:21:47,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b91faa48d6fae7bb15e2 HTTP/1.1" 200 None 2026-04-07 01:21:47,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:21:47,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:21:47,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:21:47,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b91faa48d6fae7bb15e2 HTTP/1.1" 200 None 2026-04-07 01:21:47,961 - lava_callback - ERROR - Error processing callback for node 69d1b91faa48d6fae7bb15e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:22:47,898 - lava_callback - INFO - Received callback for node 69d1b962aa48d6fae7bb1616 INFO: 172.21.0.1:40622 - "POST /node/69d1b962aa48d6fae7bb1616 HTTP/1.0" 202 Accepted 2026-04-07 01:22:47,903 - lava_callback - INFO - Starting async job submit for node 69d1b962aa48d6fae7bb1616 2026-04-07 01:22:47,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:22:47,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b962aa48d6fae7bb1616 HTTP/1.1" 200 None 2026-04-07 01:22:47,920 - lava_callback - DEBUG - Processing node 69d1b962aa48d6fae7bb1616: baseline-arm64-clabbe 2026-04-07 01:22:47,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b962aa48d6fae7bb1616 2026-04-07 01:22:47,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:22:47,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b962aa48d6fae7bb1616 HTTP/1.1" 200 None 2026-04-07 01:22:47,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:22:47,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:22:47,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:22:47,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b962aa48d6fae7bb1616 HTTP/1.1" 200 None 2026-04-07 01:22:47,974 - lava_callback - ERROR - Error processing callback for node 69d1b962aa48d6fae7bb1616: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:24:07,947 - lava_callback - INFO - Received callback for node 69d1b9a6aa48d6fae7bb163b INFO: 172.21.0.1:53494 - "POST /node/69d1b9a6aa48d6fae7bb163b HTTP/1.0" 202 Accepted 2026-04-07 01:24:07,957 - lava_callback - INFO - Starting async job submit for node 69d1b9a6aa48d6fae7bb163b 2026-04-07 01:24:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:24:07,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b9a6aa48d6fae7bb163b HTTP/1.1" 200 None 2026-04-07 01:24:07,981 - lava_callback - DEBUG - Processing node 69d1b9a6aa48d6fae7bb163b: baseline-arm64-clabbe 2026-04-07 01:24:07,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b9a6aa48d6fae7bb163b 2026-04-07 01:24:07,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:24:08,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b9a6aa48d6fae7bb163b HTTP/1.1" 200 None 2026-04-07 01:24:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:24:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 01:24:08,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:24:08,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b9a6aa48d6fae7bb163b HTTP/1.1" 200 None 2026-04-07 01:24:08,050 - lava_callback - ERROR - Error processing callback for node 69d1b9a6aa48d6fae7bb163b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:25:08,060 - lava_callback - INFO - Received callback for node 69d1b9e8aa48d6fae7bb1687 INFO: 172.21.0.1:41084 - "POST /node/69d1b9e8aa48d6fae7bb1687 HTTP/1.0" 202 Accepted 2026-04-07 01:25:08,066 - lava_callback - INFO - Starting async job submit for node 69d1b9e8aa48d6fae7bb1687 2026-04-07 01:25:08,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:25:08,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b9e8aa48d6fae7bb1687 HTTP/1.1" 200 None 2026-04-07 01:25:08,081 - lava_callback - DEBUG - Processing node 69d1b9e8aa48d6fae7bb1687: baseline-arm64-clabbe 2026-04-07 01:25:08,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1b9e8aa48d6fae7bb1687 2026-04-07 01:25:08,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:25:08,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b9e8aa48d6fae7bb1687 HTTP/1.1" 200 None 2026-04-07 01:25:08,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:25:08,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 01:25:08,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:25:08,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b9e8aa48d6fae7bb1687 HTTP/1.1" 200 None 2026-04-07 01:25:08,142 - lava_callback - ERROR - Error processing callback for node 69d1b9e8aa48d6fae7bb1687: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:32:49,870 - lava_callback - INFO - Received callback for node 69d1bbb1aa48d6fae7bb17be INFO: 172.21.0.1:40134 - "POST /node/69d1bbb1aa48d6fae7bb17be HTTP/1.0" 202 Accepted 2026-04-07 01:32:49,876 - lava_callback - INFO - Starting async job submit for node 69d1bbb1aa48d6fae7bb17be 2026-04-07 01:32:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:32:49,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bbb1aa48d6fae7bb17be HTTP/1.1" 200 None 2026-04-07 01:32:49,893 - lava_callback - DEBUG - Processing node 69d1bbb1aa48d6fae7bb17be: baseline-arm-baylibre 2026-04-07 01:32:49,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1bbb1aa48d6fae7bb17be 2026-04-07 01:32:49,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:32:49,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bbb1aa48d6fae7bb17be HTTP/1.1" 200 None 2026-04-07 01:32:49,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:32:49,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:32:49,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:32:49,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bbb1aa48d6fae7bb17be HTTP/1.1" 200 None 2026-04-07 01:32:49,955 - lava_callback - ERROR - Error processing callback for node 69d1bbb1aa48d6fae7bb17be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:33:28,521 - lava_callback - INFO - Received callback for node 69d1bbd2aa48d6fae7bb17e5 INFO: 172.21.0.1:36276 - "POST /node/69d1bbd2aa48d6fae7bb17e5 HTTP/1.0" 202 Accepted 2026-04-07 01:33:28,527 - lava_callback - INFO - Starting async job submit for node 69d1bbd2aa48d6fae7bb17e5 2026-04-07 01:33:28,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:33:28,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bbd2aa48d6fae7bb17e5 HTTP/1.1" 200 None 2026-04-07 01:33:28,547 - lava_callback - DEBUG - Processing node 69d1bbd2aa48d6fae7bb17e5: baseline-arm-clabbe 2026-04-07 01:33:28,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1bbd2aa48d6fae7bb17e5 2026-04-07 01:33:28,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:33:28,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bbd2aa48d6fae7bb17e5 HTTP/1.1" 200 None 2026-04-07 01:33:28,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:33:28,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:33:28,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:33:28,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bbd2aa48d6fae7bb17e5 HTTP/1.1" 200 None 2026-04-07 01:33:28,610 - lava_callback - ERROR - Error processing callback for node 69d1bbd2aa48d6fae7bb17e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:36:08,457 - lava_callback - INFO - Received callback for node 69d1bc77aa48d6fae7bb184c INFO: 172.21.0.1:48944 - "POST /node/69d1bc77aa48d6fae7bb184c HTTP/1.0" 202 Accepted 2026-04-07 01:36:08,463 - lava_callback - INFO - Starting async job submit for node 69d1bc77aa48d6fae7bb184c 2026-04-07 01:36:08,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:08,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc77aa48d6fae7bb184c HTTP/1.1" 200 None 2026-04-07 01:36:08,478 - lava_callback - DEBUG - Processing node 69d1bc77aa48d6fae7bb184c: baseline-arm-clabbe 2026-04-07 01:36:08,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1bc77aa48d6fae7bb184c 2026-04-07 01:36:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:08,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc77aa48d6fae7bb184c HTTP/1.1" 200 None 2026-04-07 01:36:08,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:36:08,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bc77aa48d6fae7bb184c HTTP/1.1" 200 None 2026-04-07 01:36:08,548 - lava_callback - ERROR - Error processing callback for node 69d1bc77aa48d6fae7bb184c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:36:49,119 - lava_callback - INFO - Received callback for node 69d45bf08fbbb5910332082c INFO: 172.21.0.1:41812 - "POST /node/69d45bf08fbbb5910332082c HTTP/1.0" 202 Accepted 2026-04-07 01:36:49,126 - lava_callback - INFO - Starting async job submit for node 69d45bf08fbbb5910332082c 2026-04-07 01:36:49,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:49,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45bf08fbbb5910332082c HTTP/1.1" 200 None 2026-04-07 01:36:49,194 - lava_callback - DEBUG - Processing node 69d45bf08fbbb5910332082c: baseline-arm 2026-04-07 01:36:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:36:49,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:36:49,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d45bf08fbbb5910332082c/log.txt.gz 2026-04-07 01:36:50,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:36:50,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:36:50,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d45bf08fbbb5910332082c/lava-logs.yaml 2026-04-07 01:36:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:36:50,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:36:50,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d45bf08fbbb5910332082c/lava_callback.json.gz DEBUG: Setup failed for 69d45bf08fbbb5910332082c. Transitting job node result: incomplete -> fail 2026-04-07 01:36:50,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:50,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45bf08fbbb5910332082c HTTP/1.1" 200 None 2026-04-07 01:36:50,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:51,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 01:36:51,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:36:51,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45bf08fbbb5910332082c HTTP/1.1" 200 None 2026-04-07 01:36:51,146 - lava_callback - INFO - Completed processing callback for node 69d45bf08fbbb5910332082c INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:37:20,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:37:20,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:38:28,554 - lava_callback - INFO - Received callback for node 69d1bcffaa48d6fae7bb18ba INFO: 172.21.0.1:60952 - "POST /node/69d1bcffaa48d6fae7bb18ba HTTP/1.0" 202 Accepted 2026-04-07 01:38:28,562 - lava_callback - INFO - Starting async job submit for node 69d1bcffaa48d6fae7bb18ba 2026-04-07 01:38:28,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:38:28,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcffaa48d6fae7bb18ba HTTP/1.1" 200 None 2026-04-07 01:38:28,583 - lava_callback - DEBUG - Processing node 69d1bcffaa48d6fae7bb18ba: baseline-arm-clabbe 2026-04-07 01:38:28,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1bcffaa48d6fae7bb18ba 2026-04-07 01:38:28,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:38:28,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcffaa48d6fae7bb18ba HTTP/1.1" 200 None 2026-04-07 01:38:28,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:38:28,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:38:28,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:38:28,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bcffaa48d6fae7bb18ba HTTP/1.1" 200 None 2026-04-07 01:38:28,670 - lava_callback - ERROR - Error processing callback for node 69d1bcffaa48d6fae7bb18ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 01:39:16,210 - lava_callback - INFO - Received callback for node 69d45f8d8fbbb59103320e1c INFO: 172.21.0.1:56520 - "POST /node/69d45f8d8fbbb59103320e1c HTTP/1.0" 202 Accepted 2026-04-07 01:39:16,218 - lava_callback - INFO - Starting async job submit for node 69d45f8d8fbbb59103320e1c 2026-04-07 01:39:16,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:39:16,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45f8d8fbbb59103320e1c HTTP/1.1" 200 None 2026-04-07 01:39:16,271 - lava_callback - DEBUG - Processing node 69d45f8d8fbbb59103320e1c: baseline-arm64-foundriesio INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:39:17,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:39:17,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:39:17,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d45f8d8fbbb59103320e1c/log.txt.gz 2026-04-07 01:39:17,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:39:17,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:39:17,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d45f8d8fbbb59103320e1c/lava-logs.yaml 2026-04-07 01:39:17,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:39:18,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:39:18,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d45f8d8fbbb59103320e1c/lava_callback.json.gz DEBUG: 69d45f8d8fbbb59103320e1c Transitting job node result: pass -> incomplete 2026-04-07 01:39:18,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:39:18,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45f8d8fbbb59103320e1c HTTP/1.1" 200 None 2026-04-07 01:39:18,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:39:18,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:39:18,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:39:18,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45f8d8fbbb59103320e1c HTTP/1.1" 200 None 2026-04-07 01:39:18,246 - lava_callback - INFO - Completed processing callback for node 69d45f8d8fbbb59103320e1c 2026-04-07 01:39:20,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:39:20,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:42:08,759 - lava_callback - INFO - Received callback for node 69d1bddfaa48d6fae7bb19c1 INFO: 172.21.0.1:34748 - "POST /node/69d1bddfaa48d6fae7bb19c1 HTTP/1.0" 202 Accepted 2026-04-07 01:42:08,765 - lava_callback - INFO - Starting async job submit for node 69d1bddfaa48d6fae7bb19c1 2026-04-07 01:42:08,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:08,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bddfaa48d6fae7bb19c1 HTTP/1.1" 200 None 2026-04-07 01:42:08,781 - lava_callback - DEBUG - Processing node 69d1bddfaa48d6fae7bb19c1: baseline-arm-clabbe 2026-04-07 01:42:08,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1bddfaa48d6fae7bb19c1 2026-04-07 01:42:08,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:08,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bddfaa48d6fae7bb19c1 HTTP/1.1" 200 None 2026-04-07 01:42:08,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:42:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:08,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bddfaa48d6fae7bb19c1 HTTP/1.1" 200 None 2026-04-07 01:42:08,850 - lava_callback - ERROR - Error processing callback for node 69d1bddfaa48d6fae7bb19c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:42:20,157 - lava_callback - INFO - Received callback for node 69d45fbe8fbbb59103320e6f INFO: 172.21.0.1:45496 - "POST /node/69d45fbe8fbbb59103320e6f HTTP/1.0" 202 Accepted 2026-04-07 01:42:20,169 - lava_callback - INFO - Starting async job submit for node 69d45fbe8fbbb59103320e6f 2026-04-07 01:42:20,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:20,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45fbe8fbbb59103320e6f HTTP/1.1" 200 None 2026-04-07 01:42:20,220 - lava_callback - DEBUG - Processing node 69d45fbe8fbbb59103320e6f: baseline-arm64 2026-04-07 01:42:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:42:20,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:42:20,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45fbe8fbbb59103320e6f/log.txt.gz 2026-04-07 01:42:21,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:42:21,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:42:21,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45fbe8fbbb59103320e6f/lava-logs.yaml 2026-04-07 01:42:21,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:42:21,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:42:21,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d45fbe8fbbb59103320e6f/lava_callback.json.gz DEBUG: Setup failed for 69d45fbe8fbbb59103320e6f. Transitting job node result: incomplete -> fail 2026-04-07 01:42:21,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:21,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45fbe8fbbb59103320e6f HTTP/1.1" 200 None 2026-04-07 01:42:21,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:21,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:42:21,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:21,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45fbe8fbbb59103320e6f HTTP/1.1" 200 None 2026-04-07 01:42:21,695 - lava_callback - INFO - Completed processing callback for node 69d45fbe8fbbb59103320e6f INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:42:50,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:42:50,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:44:48,887 - lava_callback - INFO - Received callback for node 69d1be8baa48d6fae7bb1a33 INFO: 172.21.0.1:45524 - "POST /node/69d1be8baa48d6fae7bb1a33 HTTP/1.0" 202 Accepted 2026-04-07 01:44:48,892 - lava_callback - INFO - Starting async job submit for node 69d1be8baa48d6fae7bb1a33 2026-04-07 01:44:48,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:48,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1be8baa48d6fae7bb1a33 HTTP/1.1" 200 None 2026-04-07 01:44:48,913 - lava_callback - DEBUG - Processing node 69d1be8baa48d6fae7bb1a33: baseline-arm-clabbe 2026-04-07 01:44:48,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1be8baa48d6fae7bb1a33 2026-04-07 01:44:48,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:48,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1be8baa48d6fae7bb1a33 HTTP/1.1" 200 None 2026-04-07 01:44:48,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:48,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-07 01:44:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:48,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1be8baa48d6fae7bb1a33 HTTP/1.1" 200 None 2026-04-07 01:44:48,977 - lava_callback - ERROR - Error processing callback for node 69d1be8baa48d6fae7bb1a33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 01:44:55,248 - lava_callback - INFO - Received callback for node 69d4618d8fbbb5910332100a INFO: 172.21.0.1:53184 - "POST /node/69d4618d8fbbb5910332100a HTTP/1.0" 202 Accepted 2026-04-07 01:44:55,253 - lava_callback - INFO - Starting async job submit for node 69d4618d8fbbb5910332100a 2026-04-07 01:44:55,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:55,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4618d8fbbb5910332100a HTTP/1.1" 200 None 2026-04-07 01:44:55,271 - lava_callback - DEBUG - Processing node 69d4618d8fbbb5910332100a: baseline-nfs-arm64 2026-04-07 01:44:55,272 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:44:55,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:44:55,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:44:55,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4618d8fbbb5910332100a/lava-logs.yaml 2026-04-07 01:44:55,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:44:55,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:44:55,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d4618d8fbbb5910332100a/lava_callback.json.gz 2026-04-07 01:44:55,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:55,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4618d8fbbb5910332100a HTTP/1.1" 200 None 2026-04-07 01:44:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:55,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:44:55,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:44:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4618d8fbbb5910332100a HTTP/1.1" 200 None 2026-04-07 01:44:55,620 - lava_callback - INFO - Completed processing callback for node 69d4618d8fbbb5910332100a INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:45:20,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:45:20,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:47:39,592 - lava_callback - INFO - Received callback for node 69d461448fbbb59103320fb1 INFO: 172.21.0.1:51182 - "POST /node/69d461448fbbb59103320fb1 HTTP/1.0" 202 Accepted 2026-04-07 01:47:39,599 - lava_callback - INFO - Starting async job submit for node 69d461448fbbb59103320fb1 2026-04-07 01:47:39,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:47:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d461448fbbb59103320fb1 HTTP/1.1" 200 None 2026-04-07 01:47:39,640 - lava_callback - DEBUG - Processing node 69d461448fbbb59103320fb1: ltp-syscalls-ipc 2026-04-07 01:47:40,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:47:40,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:47:40,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d461448fbbb59103320fb1/log.txt.gz 2026-04-07 01:47:40,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:47:40,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:47:40,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d461448fbbb59103320fb1/lava-logs.yaml 2026-04-07 01:47:40,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:47:40,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:47:40,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d461448fbbb59103320fb1/lava_callback.json.gz 2026-04-07 01:47:40,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:47:40,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d461448fbbb59103320fb1 HTTP/1.1" 200 None 2026-04-07 01:47:40,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:47:40,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 01:47:40,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:47:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d461448fbbb59103320fb1 HTTP/1.1" 200 None 2026-04-07 01:47:40,990 - lava_callback - INFO - Completed processing callback for node 69d461448fbbb59103320fb1 INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:47:50,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:47:50,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:50:31,730 - lava_callback - INFO - Received callback for node 69d4628a8fbbb591033210f2 INFO: 172.21.0.1:49314 - "POST /node/69d4628a8fbbb591033210f2 HTTP/1.0" 202 Accepted 2026-04-07 01:50:31,736 - lava_callback - INFO - Starting async job submit for node 69d4628a8fbbb591033210f2 2026-04-07 01:50:31,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:50:31,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4628a8fbbb591033210f2 HTTP/1.1" 200 None 2026-04-07 01:50:31,773 - lava_callback - DEBUG - Processing node 69d4628a8fbbb591033210f2: baseline-arm64-broonie 2026-04-07 01:50:31,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:50:32,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:50:32,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4628a8fbbb591033210f2/log.txt.gz 2026-04-07 01:50:32,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:50:32,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:50:32,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4628a8fbbb591033210f2/lava-logs.yaml 2026-04-07 01:50:32,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:50:32,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:50:32,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4628a8fbbb591033210f2/lava_callback.json.gz 2026-04-07 01:50:32,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:50:32,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4628a8fbbb591033210f2 HTTP/1.1" 200 None 2026-04-07 01:50:32,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:50:32,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:50:32,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:50:32,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4628a8fbbb591033210f2 HTTP/1.1" 200 None 2026-04-07 01:50:32,731 - lava_callback - INFO - Completed processing callback for node 69d4628a8fbbb591033210f2 INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:50:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:50:50,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:51:32,553 - lava_callback - INFO - Received callback for node 69d45f708fbbb59103320e11 INFO: 172.21.0.1:44456 - "POST /node/69d45f708fbbb59103320e11 HTTP/1.0" 202 Accepted 2026-04-07 01:51:32,560 - lava_callback - INFO - Starting async job submit for node 69d45f708fbbb59103320e11 2026-04-07 01:51:32,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:51:32,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45f708fbbb59103320e11 HTTP/1.1" 200 None 2026-04-07 01:51:32,619 - lava_callback - DEBUG - Processing node 69d45f708fbbb59103320e11: baseline-x86 2026-04-07 01:51:33,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:51:33,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:51:33,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d45f708fbbb59103320e11/log.txt.gz 2026-04-07 01:51:34,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:51:34,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:51:34,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d45f708fbbb59103320e11/lava-logs.yaml 2026-04-07 01:51:34,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:51:34,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:51:34,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d45f708fbbb59103320e11/lava_callback.json.gz DEBUG: Setup failed for 69d45f708fbbb59103320e11. Transitting job node result: incomplete -> fail 2026-04-07 01:51:34,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:51:34,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d45f708fbbb59103320e11 HTTP/1.1" 200 None 2026-04-07 01:51:34,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:51:34,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 01:51:34,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:51:34,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d45f708fbbb59103320e11 HTTP/1.1" 200 None 2026-04-07 01:51:34,816 - lava_callback - INFO - Completed processing callback for node 69d45f708fbbb59103320e11 INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:51:50,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:51:50,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:52:45,536 - lava_callback - INFO - Received callback for node 69d4633e8fbbb591033211de INFO: 172.21.0.1:51990 - "POST /node/69d4633e8fbbb591033211de HTTP/1.0" 202 Accepted 2026-04-07 01:52:45,544 - lava_callback - INFO - Starting async job submit for node 69d4633e8fbbb591033211de 2026-04-07 01:52:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:45,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4633e8fbbb591033211de HTTP/1.1" 200 None 2026-04-07 01:52:45,589 - lava_callback - DEBUG - Processing node 69d4633e8fbbb591033211de: baseline-arm64 2026-04-07 01:52:45,721 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:52:45,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:52:45,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:52:45,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4633e8fbbb591033211de/lava-logs.yaml 2026-04-07 01:52:45,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:52:46,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:52:46,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d4633e8fbbb591033211de/lava_callback.json.gz 2026-04-07 01:52:46,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:46,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4633e8fbbb591033211de HTTP/1.1" 200 None 2026-04-07 01:52:46,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:46,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:52:46,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:46,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4633e8fbbb591033211de HTTP/1.1" 200 None 2026-04-07 01:52:46,232 - lava_callback - INFO - Completed processing callback for node 69d4633e8fbbb591033211de INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:52:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:50,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:52:59,124 - lava_callback - INFO - Received callback for node 69d4630c8fbbb5910332119d INFO: 172.21.0.1:35832 - "POST /node/69d4630c8fbbb5910332119d HTTP/1.0" 202 Accepted 2026-04-07 01:52:59,130 - lava_callback - INFO - Starting async job submit for node 69d4630c8fbbb5910332119d 2026-04-07 01:52:59,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:52:59,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4630c8fbbb5910332119d HTTP/1.1" 200 None 2026-04-07 01:52:59,167 - lava_callback - DEBUG - Processing node 69d4630c8fbbb5910332119d: baseline-arm64-broonie 2026-04-07 01:52:59,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:53:00,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:53:00,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4630c8fbbb5910332119d/log.txt.gz 2026-04-07 01:53:00,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:53:00,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:53:00,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4630c8fbbb5910332119d/lava-logs.yaml 2026-04-07 01:53:00,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:53:00,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:53:00,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d4630c8fbbb5910332119d/lava_callback.json.gz 2026-04-07 01:53:00,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:53:00,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4630c8fbbb5910332119d HTTP/1.1" 200 None 2026-04-07 01:53:00,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:53:00,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:53:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:53:00,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4630c8fbbb5910332119d HTTP/1.1" 200 None 2026-04-07 01:53:00,689 - lava_callback - INFO - Completed processing callback for node 69d4630c8fbbb5910332119d INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:53:20,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:53:20,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:56:17,605 - lava_callback - INFO - Received callback for node 69d463cd8fbbb59103321253 INFO: 172.21.0.1:58986 - "POST /node/69d463cd8fbbb59103321253 HTTP/1.0" 202 Accepted 2026-04-07 01:56:17,616 - lava_callback - INFO - Starting async job submit for node 69d463cd8fbbb59103321253 2026-04-07 01:56:17,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:56:17,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d463cd8fbbb59103321253 HTTP/1.1" 200 None 2026-04-07 01:56:17,665 - lava_callback - DEBUG - Processing node 69d463cd8fbbb59103321253: baseline-arm64 2026-04-07 01:56:17,916 - lava_callback - WARNING - Failed to upload log 2026-04-07 01:56:18,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:56:18,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:56:18,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d463cd8fbbb59103321253/lava-logs.yaml 2026-04-07 01:56:18,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:56:18,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:56:18,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d463cd8fbbb59103321253/lava_callback.json.gz 2026-04-07 01:56:18,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:56:18,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d463cd8fbbb59103321253 HTTP/1.1" 200 None 2026-04-07 01:56:18,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:56:18,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:56:18,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:56:18,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d463cd8fbbb59103321253 HTTP/1.1" 200 None 2026-04-07 01:56:18,478 - lava_callback - INFO - Completed processing callback for node 69d463cd8fbbb59103321253 2026-04-07 01:56:20,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:56:20,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:57:58,754 - lava_callback - INFO - Received callback for node 69d464628fbbb59103321298 INFO: 172.21.0.1:59048 - "POST /node/69d464628fbbb59103321298 HTTP/1.0" 202 Accepted 2026-04-07 01:57:58,761 - lava_callback - INFO - Starting async job submit for node 69d464628fbbb59103321298 2026-04-07 01:57:58,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:57:58,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d464628fbbb59103321298 HTTP/1.1" 200 None 2026-04-07 01:57:58,797 - lava_callback - DEBUG - Processing node 69d464628fbbb59103321298: baseline-arm64 2026-04-07 01:57:59,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:57:59,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:57:59,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d464628fbbb59103321298/log.txt.gz 2026-04-07 01:57:59,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:57:59,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:57:59,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d464628fbbb59103321298/lava-logs.yaml 2026-04-07 01:57:59,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 01:58:00,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 01:58:00,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d464628fbbb59103321298/lava_callback.json.gz 2026-04-07 01:58:00,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:58:00,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d464628fbbb59103321298 HTTP/1.1" 200 None 2026-04-07 01:58:00,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:58:00,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 01:58:00,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:58:00,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d464628fbbb59103321298 HTTP/1.1" 200 None 2026-04-07 01:58:00,180 - lava_callback - INFO - Completed processing callback for node 69d464628fbbb59103321298 INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK 2026-04-07 01:58:20,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 01:58:20,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:00:31,321 - lava_callback - INFO - Received callback for node 69d1c236aa48d6fae7bb1d88 INFO: 172.21.0.1:46538 - "POST /node/69d1c236aa48d6fae7bb1d88 HTTP/1.0" 202 Accepted 2026-04-07 02:00:31,327 - lava_callback - INFO - Starting async job submit for node 69d1c236aa48d6fae7bb1d88 2026-04-07 02:00:31,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:00:31,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c236aa48d6fae7bb1d88 HTTP/1.1" 200 None 2026-04-07 02:00:31,344 - lava_callback - DEBUG - Processing node 69d1c236aa48d6fae7bb1d88: baseline-arm64-baylibre 2026-04-07 02:00:31,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c236aa48d6fae7bb1d88 2026-04-07 02:00:31,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:00:31,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c236aa48d6fae7bb1d88 HTTP/1.1" 200 None 2026-04-07 02:00:31,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:00:31,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:00:31,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:00:31,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c236aa48d6fae7bb1d88 HTTP/1.1" 200 None 2026-04-07 02:00:31,405 - lava_callback - ERROR - Error processing callback for node 69d1c236aa48d6fae7bb1d88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:01:51,325 - lava_callback - INFO - Received callback for node 69d1c27baa48d6fae7bb1dbd INFO: 172.21.0.1:52698 - "POST /node/69d1c27baa48d6fae7bb1dbd HTTP/1.0" 202 Accepted 2026-04-07 02:01:51,331 - lava_callback - INFO - Starting async job submit for node 69d1c27baa48d6fae7bb1dbd 2026-04-07 02:01:51,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:01:51,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c27baa48d6fae7bb1dbd HTTP/1.1" 200 None 2026-04-07 02:01:51,347 - lava_callback - DEBUG - Processing node 69d1c27baa48d6fae7bb1dbd: baseline-arm64-baylibre 2026-04-07 02:01:51,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c27baa48d6fae7bb1dbd 2026-04-07 02:01:51,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:01:51,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c27baa48d6fae7bb1dbd HTTP/1.1" 200 None 2026-04-07 02:01:51,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:01:51,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:01:51,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:01:51,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c27baa48d6fae7bb1dbd HTTP/1.1" 200 None 2026-04-07 02:01:51,424 - lava_callback - ERROR - Error processing callback for node 69d1c27baa48d6fae7bb1dbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:06:11,778 - lava_callback - INFO - Received callback for node 69d1c390aa48d6fae7bb1e71 INFO: 172.21.0.1:53874 - "POST /node/69d1c390aa48d6fae7bb1e71 HTTP/1.0" 202 Accepted 2026-04-07 02:06:11,784 - lava_callback - INFO - Starting async job submit for node 69d1c390aa48d6fae7bb1e71 2026-04-07 02:06:11,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:06:11,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c390aa48d6fae7bb1e71 HTTP/1.1" 200 None 2026-04-07 02:06:11,800 - lava_callback - DEBUG - Processing node 69d1c390aa48d6fae7bb1e71: baseline-arm64-baylibre 2026-04-07 02:06:11,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c390aa48d6fae7bb1e71 2026-04-07 02:06:11,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:06:11,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c390aa48d6fae7bb1e71 HTTP/1.1" 200 None 2026-04-07 02:06:11,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:06:11,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:06:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:06:11,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c390aa48d6fae7bb1e71 HTTP/1.1" 200 None 2026-04-07 02:06:11,857 - lava_callback - ERROR - Error processing callback for node 69d1c390aa48d6fae7bb1e71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:07:31,611 - lava_callback - INFO - Received callback for node 69d1c3d7aa48d6fae7bb1e90 INFO: 172.21.0.1:56720 - "POST /node/69d1c3d7aa48d6fae7bb1e90 HTTP/1.0" 202 Accepted 2026-04-07 02:07:31,617 - lava_callback - INFO - Starting async job submit for node 69d1c3d7aa48d6fae7bb1e90 2026-04-07 02:07:31,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:07:31,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c3d7aa48d6fae7bb1e90 HTTP/1.1" 200 None 2026-04-07 02:07:31,639 - lava_callback - DEBUG - Processing node 69d1c3d7aa48d6fae7bb1e90: baseline-arm64-baylibre 2026-04-07 02:07:31,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c3d7aa48d6fae7bb1e90 2026-04-07 02:07:31,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:07:31,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c3d7aa48d6fae7bb1e90 HTTP/1.1" 200 None 2026-04-07 02:07:31,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:07:31,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:07:31,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:07:31,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c3d7aa48d6fae7bb1e90 HTTP/1.1" 200 None 2026-04-07 02:07:31,742 - lava_callback - ERROR - Error processing callback for node 69d1c3d7aa48d6fae7bb1e90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:09:44,777 - lava_callback - INFO - Received callback for node 69d467458fbbb5910332153a INFO: 172.21.0.1:48930 - "POST /node/69d467458fbbb5910332153a HTTP/1.0" 202 Accepted 2026-04-07 02:09:44,783 - lava_callback - INFO - Starting async job submit for node 69d467458fbbb5910332153a 2026-04-07 02:09:44,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:44,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d467458fbbb5910332153a HTTP/1.1" 200 None 2026-04-07 02:09:44,800 - lava_callback - DEBUG - Processing node 69d467458fbbb5910332153a: baseline-nfs-arm64 2026-04-07 02:09:44,802 - lava_callback - WARNING - Failed to upload log 2026-04-07 02:09:44,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:09:44,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:09:44,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d467458fbbb5910332153a/lava-logs.yaml 2026-04-07 02:09:44,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:09:45,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:09:45,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d467458fbbb5910332153a/lava_callback.json.gz 2026-04-07 02:09:45,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:45,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d467458fbbb5910332153a HTTP/1.1" 200 None 2026-04-07 02:09:45,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:45,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:09:45,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:45,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d467458fbbb5910332153a HTTP/1.1" 200 None 2026-04-07 02:09:45,173 - lava_callback - INFO - Completed processing callback for node 69d467458fbbb5910332153a INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:09:46,537 - lava_callback - INFO - Received callback for node 69d462c58fbbb59103321133 INFO: 172.21.0.1:48958 - "POST /node/69d462c58fbbb59103321133 HTTP/1.0" 202 Accepted 2026-04-07 02:09:46,546 - lava_callback - INFO - Starting async job submit for node 69d462c58fbbb59103321133 2026-04-07 02:09:46,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:46,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d462c58fbbb59103321133 HTTP/1.1" 200 None 2026-04-07 02:09:46,608 - lava_callback - DEBUG - Processing node 69d462c58fbbb59103321133: baseline-nfs-arm64 2026-04-07 02:09:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:09:47,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:09:47,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d462c58fbbb59103321133/log.txt.gz 2026-04-07 02:09:48,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:09:48,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:09:48,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d462c58fbbb59103321133/lava-logs.yaml 2026-04-07 02:09:48,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:09:49,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:09:49,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d462c58fbbb59103321133/lava_callback.json.gz DEBUG: Setup failed for 69d462c58fbbb59103321133. Transitting job node result: incomplete -> fail 2026-04-07 02:09:49,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:49,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d462c58fbbb59103321133 HTTP/1.1" 200 None 2026-04-07 02:09:49,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:49,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:09:49,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:49,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d462c58fbbb59103321133 HTTP/1.1" 200 None 2026-04-07 02:09:49,394 - lava_callback - INFO - Completed processing callback for node 69d462c58fbbb59103321133 2026-04-07 02:09:50,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:09:50,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:10:51,736 - lava_callback - INFO - Received callback for node 69d1c4a9aa48d6fae7bb1f25 INFO: 172.21.0.1:33052 - "POST /node/69d1c4a9aa48d6fae7bb1f25 HTTP/1.0" 202 Accepted 2026-04-07 02:10:51,742 - lava_callback - INFO - Starting async job submit for node 69d1c4a9aa48d6fae7bb1f25 2026-04-07 02:10:51,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:10:51,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c4a9aa48d6fae7bb1f25 HTTP/1.1" 200 None 2026-04-07 02:10:51,758 - lava_callback - DEBUG - Processing node 69d1c4a9aa48d6fae7bb1f25: baseline-arm64-baylibre 2026-04-07 02:10:51,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c4a9aa48d6fae7bb1f25 2026-04-07 02:10:51,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:10:51,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c4a9aa48d6fae7bb1f25 HTTP/1.1" 200 None 2026-04-07 02:10:51,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:10:51,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:10:51,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:10:51,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c4a9aa48d6fae7bb1f25 HTTP/1.1" 200 None 2026-04-07 02:10:51,822 - lava_callback - ERROR - Error processing callback for node 69d1c4a9aa48d6fae7bb1f25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:12:10,140 - lava_callback - INFO - Received callback for node 69d1c4f5aa48d6fae7bb1f45 INFO: 172.21.0.1:32846 - "POST /node/69d1c4f5aa48d6fae7bb1f45 HTTP/1.0" 202 Accepted 2026-04-07 02:12:10,146 - lava_callback - INFO - Starting async job submit for node 69d1c4f5aa48d6fae7bb1f45 2026-04-07 02:12:10,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:12:10,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c4f5aa48d6fae7bb1f45 HTTP/1.1" 200 None 2026-04-07 02:12:10,162 - lava_callback - DEBUG - Processing node 69d1c4f5aa48d6fae7bb1f45: baseline-arm64-clabbe 2026-04-07 02:12:10,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c4f5aa48d6fae7bb1f45 2026-04-07 02:12:10,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:12:10,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c4f5aa48d6fae7bb1f45 HTTP/1.1" 200 None 2026-04-07 02:12:10,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:12:10,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:12:10,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:12:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c4f5aa48d6fae7bb1f45 HTTP/1.1" 200 None 2026-04-07 02:12:10,227 - lava_callback - ERROR - Error processing callback for node 69d1c4f5aa48d6fae7bb1f45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:13:06,226 - lava_callback - INFO - Received callback for node 69d468098fbbb591033215ce INFO: 172.21.0.1:35832 - "POST /node/69d468098fbbb591033215ce HTTP/1.0" 202 Accepted 2026-04-07 02:13:06,233 - lava_callback - INFO - Starting async job submit for node 69d468098fbbb591033215ce 2026-04-07 02:13:06,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:06,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468098fbbb591033215ce HTTP/1.1" 200 None 2026-04-07 02:13:06,277 - lava_callback - DEBUG - Processing node 69d468098fbbb591033215ce: baseline-arm64 2026-04-07 02:13:06,412 - lava_callback - WARNING - Failed to upload log 2026-04-07 02:13:06,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:13:06,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:13:06,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d468098fbbb591033215ce/lava-logs.yaml 2026-04-07 02:13:06,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:13:06,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:13:06,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d468098fbbb591033215ce/lava_callback.json.gz 2026-04-07 02:13:06,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468098fbbb591033215ce HTTP/1.1" 200 None 2026-04-07 02:13:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:06,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:13:06,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:06,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d468098fbbb591033215ce HTTP/1.1" 200 None 2026-04-07 02:13:07,015 - lava_callback - INFO - Completed processing callback for node 69d468098fbbb591033215ce INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:13:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:20,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:13:35,040 - lava_callback - INFO - Received callback for node 69d468048fbbb591033215cb INFO: 172.21.0.1:48582 - "POST /node/69d468048fbbb591033215cb HTTP/1.0" 202 Accepted 2026-04-07 02:13:35,046 - lava_callback - INFO - Starting async job submit for node 69d468048fbbb591033215cb 2026-04-07 02:13:35,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:35,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468048fbbb591033215cb HTTP/1.1" 200 None 2026-04-07 02:13:35,104 - lava_callback - DEBUG - Processing node 69d468048fbbb591033215cb: baseline-x86 2026-04-07 02:13:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:13:35,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:13:35,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d468048fbbb591033215cb/log.txt.gz 2026-04-07 02:13:35,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:13:35,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:13:35,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d468048fbbb591033215cb/lava-logs.yaml 2026-04-07 02:13:35,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:13:36,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:13:36,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d468048fbbb591033215cb/lava_callback.json.gz 2026-04-07 02:13:36,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:36,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468048fbbb591033215cb HTTP/1.1" 200 None 2026-04-07 02:13:36,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:36,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d808fbbb5910331f9c0 HTTP/1.1" 200 None 2026-04-07 02:13:36,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:36,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d468048fbbb591033215cb HTTP/1.1" 200 None 2026-04-07 02:13:36,289 - lava_callback - INFO - Completed processing callback for node 69d468048fbbb591033215cb INFO: 172.21.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:13:50,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:13:50,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:14:25,816 - lava_callback - INFO - Received callback for node 69d468538fbbb591033215f1 INFO: 172.21.0.1:42064 - "POST /node/69d468538fbbb591033215f1 HTTP/1.0" 202 Accepted 2026-04-07 02:14:25,822 - lava_callback - INFO - Starting async job submit for node 69d468538fbbb591033215f1 2026-04-07 02:14:25,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:25,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468538fbbb591033215f1 HTTP/1.1" 200 None 2026-04-07 02:14:25,873 - lava_callback - DEBUG - Processing node 69d468538fbbb591033215f1: baseline-arm64 2026-04-07 02:14:26,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:14:26,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:14:26,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d468538fbbb591033215f1/log.txt.gz 2026-04-07 02:14:26,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:14:26,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:14:26,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d468538fbbb591033215f1/lava-logs.yaml 2026-04-07 02:14:26,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:14:26,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:14:26,583 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d468538fbbb591033215f1/lava_callback.json.gz 2026-04-07 02:14:26,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:26,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d468538fbbb591033215f1 HTTP/1.1" 200 None 2026-04-07 02:14:26,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:26,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:14:26,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:26,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d468538fbbb591033215f1 HTTP/1.1" 200 None 2026-04-07 02:14:26,741 - lava_callback - INFO - Completed processing callback for node 69d468538fbbb591033215f1 2026-04-07 02:14:30,263 - lava_callback - INFO - Received callback for node 69d1c57eaa48d6fae7bb1fa7 INFO: 172.21.0.1:58274 - "POST /node/69d1c57eaa48d6fae7bb1fa7 HTTP/1.0" 202 Accepted 2026-04-07 02:14:30,268 - lava_callback - INFO - Starting async job submit for node 69d1c57eaa48d6fae7bb1fa7 2026-04-07 02:14:30,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:30,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c57eaa48d6fae7bb1fa7 HTTP/1.1" 200 None 2026-04-07 02:14:30,288 - lava_callback - DEBUG - Processing node 69d1c57eaa48d6fae7bb1fa7: baseline-arm64-clabbe 2026-04-07 02:14:30,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c57eaa48d6fae7bb1fa7 2026-04-07 02:14:30,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:30,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c57eaa48d6fae7bb1fa7 HTTP/1.1" 200 None 2026-04-07 02:14:30,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:30,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:14:30,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:30,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c57eaa48d6fae7bb1fa7 HTTP/1.1" 200 None 2026-04-07 02:14:30,339 - lava_callback - ERROR - Error processing callback for node 69d1c57eaa48d6fae7bb1fa7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:14:50,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:14:50,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:15:35,598 - lava_callback - INFO - Received callback for node 69d466fd8fbbb59103321500 INFO: 172.21.0.1:51016 - "POST /node/69d466fd8fbbb59103321500 HTTP/1.0" 202 Accepted 2026-04-07 02:15:35,606 - lava_callback - INFO - Starting async job submit for node 69d466fd8fbbb59103321500 2026-04-07 02:15:35,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:35,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466fd8fbbb59103321500 HTTP/1.1" 200 None 2026-04-07 02:15:35,658 - lava_callback - DEBUG - Processing node 69d466fd8fbbb59103321500: baseline-arm64 2026-04-07 02:15:36,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:15:36,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:15:36,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d466fd8fbbb59103321500/log.txt.gz 2026-04-07 02:15:36,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:15:36,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:15:36,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d466fd8fbbb59103321500/lava-logs.yaml 2026-04-07 02:15:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:15:36,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:15:36,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d466fd8fbbb59103321500/lava_callback.json.gz DEBUG: Setup failed for 69d466fd8fbbb59103321500. Transitting job node result: incomplete -> fail 2026-04-07 02:15:36,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:36,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466fd8fbbb59103321500 HTTP/1.1" 200 None 2026-04-07 02:15:36,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:36,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:15:36,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:36,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d466fd8fbbb59103321500 HTTP/1.1" 200 None 2026-04-07 02:15:37,040 - lava_callback - INFO - Completed processing callback for node 69d466fd8fbbb59103321500 INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:15:50,319 - lava_callback - INFO - Received callback for node 69d1c5c7aa48d6fae7bb1fc3 INFO: 172.21.0.1:42162 - "POST /node/69d1c5c7aa48d6fae7bb1fc3 HTTP/1.0" 202 Accepted 2026-04-07 02:15:50,324 - lava_callback - INFO - Starting async job submit for node 69d1c5c7aa48d6fae7bb1fc3 2026-04-07 02:15:50,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:50,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c5c7aa48d6fae7bb1fc3 HTTP/1.1" 200 None 2026-04-07 02:15:50,340 - lava_callback - DEBUG - Processing node 69d1c5c7aa48d6fae7bb1fc3: baseline-arm64-clabbe 2026-04-07 02:15:50,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c5c7aa48d6fae7bb1fc3 2026-04-07 02:15:50,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:50,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c5c7aa48d6fae7bb1fc3 HTTP/1.1" 200 None 2026-04-07 02:15:50,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:50,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:15:50,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:50,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c5c7aa48d6fae7bb1fc3 HTTP/1.1" 200 None 2026-04-07 02:15:50,404 - lava_callback - ERROR - Error processing callback for node 69d1c5c7aa48d6fae7bb1fc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 02:15:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:15:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:16:24,233 - lava_callback - INFO - Received callback for node 69d466cc8fbbb591033214c5 INFO: 172.21.0.1:52748 - "POST /node/69d466cc8fbbb591033214c5 HTTP/1.0" 202 Accepted 2026-04-07 02:16:24,242 - lava_callback - INFO - Starting async job submit for node 69d466cc8fbbb591033214c5 2026-04-07 02:16:24,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:24,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466cc8fbbb591033214c5 HTTP/1.1" 200 None 2026-04-07 02:16:24,316 - lava_callback - DEBUG - Processing node 69d466cc8fbbb591033214c5: baseline-arm64-foundriesio 2026-04-07 02:16:25,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:16:25,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:16:25,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d466cc8fbbb591033214c5/log.txt.gz 2026-04-07 02:16:26,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:16:26,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:16:26,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d466cc8fbbb591033214c5/lava-logs.yaml 2026-04-07 02:16:26,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:16:26,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:16:26,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d466cc8fbbb591033214c5/lava_callback.json.gz DEBUG: Setup failed for 69d466cc8fbbb591033214c5. Transitting job node result: incomplete -> fail 2026-04-07 02:16:27,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:27,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466cc8fbbb591033214c5 HTTP/1.1" 200 None 2026-04-07 02:16:27,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:27,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:16:27,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:27,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d466cc8fbbb591033214c5 HTTP/1.1" 200 None 2026-04-07 02:16:27,230 - lava_callback - INFO - Completed processing callback for node 69d466cc8fbbb591033214c5 INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:16:50,322 - lava_callback - INFO - Received callback for node 69d1c60aaa48d6fae7bb200c INFO: 172.21.0.1:39526 - "POST /node/69d1c60aaa48d6fae7bb200c HTTP/1.0" 202 Accepted 2026-04-07 02:16:50,328 - lava_callback - INFO - Starting async job submit for node 69d1c60aaa48d6fae7bb200c 2026-04-07 02:16:50,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:50,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c60aaa48d6fae7bb200c HTTP/1.1" 200 None 2026-04-07 02:16:50,350 - lava_callback - DEBUG - Processing node 69d1c60aaa48d6fae7bb200c: baseline-arm64-clabbe 2026-04-07 02:16:50,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c60aaa48d6fae7bb200c 2026-04-07 02:16:50,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:50,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c60aaa48d6fae7bb200c HTTP/1.1" 200 None 2026-04-07 02:16:50,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:16:50,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:50,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c60aaa48d6fae7bb200c HTTP/1.1" 200 None 2026-04-07 02:16:50,414 - lava_callback - ERROR - Error processing callback for node 69d1c60aaa48d6fae7bb200c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-07 02:16:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:16:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:18:10,453 - lava_callback - INFO - Received callback for node 69d1c650aa48d6fae7bb2043 INFO: 172.21.0.1:52104 - "POST /node/69d1c650aa48d6fae7bb2043 HTTP/1.0" 202 Accepted 2026-04-07 02:18:10,461 - lava_callback - INFO - Starting async job submit for node 69d1c650aa48d6fae7bb2043 2026-04-07 02:18:10,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c650aa48d6fae7bb2043 HTTP/1.1" 200 None 2026-04-07 02:18:10,481 - lava_callback - DEBUG - Processing node 69d1c650aa48d6fae7bb2043: baseline-arm64-clabbe 2026-04-07 02:18:10,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c650aa48d6fae7bb2043 2026-04-07 02:18:10,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:10,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c650aa48d6fae7bb2043 HTTP/1.1" 200 None 2026-04-07 02:18:10,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:10,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:18:10,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:10,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c650aa48d6fae7bb2043 HTTP/1.1" 200 None 2026-04-07 02:18:10,562 - lava_callback - ERROR - Error processing callback for node 69d1c650aa48d6fae7bb2043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:18:52,483 - lava_callback - INFO - Received callback for node 69d4657b8fbbb5910332138e INFO: 172.21.0.1:47756 - "POST /node/69d4657b8fbbb5910332138e HTTP/1.0" 202 Accepted 2026-04-07 02:18:52,490 - lava_callback - INFO - Starting async job submit for node 69d4657b8fbbb5910332138e 2026-04-07 02:18:52,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:52,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4657b8fbbb5910332138e HTTP/1.1" 200 None 2026-04-07 02:18:52,565 - lava_callback - DEBUG - Processing node 69d4657b8fbbb5910332138e: ltp-smoke 2026-04-07 02:18:53,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:18:53,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:18:53,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4657b8fbbb5910332138e/log.txt.gz 2026-04-07 02:18:53,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:18:53,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:18:53,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4657b8fbbb5910332138e/lava-logs.yaml 2026-04-07 02:18:53,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:18:53,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:18:53,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d4657b8fbbb5910332138e/lava_callback.json.gz 2026-04-07 02:18:54,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:54,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4657b8fbbb5910332138e HTTP/1.1" 200 None 2026-04-07 02:18:54,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:54,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d608fbbb5910331f99d HTTP/1.1" 200 None 2026-04-07 02:18:54,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:18:54,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d4657b8fbbb5910332138e HTTP/1.1" 200 None 2026-04-07 02:18:54,354 - lava_callback - INFO - Completed processing callback for node 69d4657b8fbbb5910332138e INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:19:10,456 - lava_callback - INFO - Received callback for node 69d1c699aa48d6fae7bb2058 INFO: 172.21.0.1:49224 - "POST /node/69d1c699aa48d6fae7bb2058 HTTP/1.0" 202 Accepted 2026-04-07 02:19:10,463 - lava_callback - INFO - Starting async job submit for node 69d1c699aa48d6fae7bb2058 2026-04-07 02:19:10,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:19:10,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c699aa48d6fae7bb2058 HTTP/1.1" 200 None 2026-04-07 02:19:10,479 - lava_callback - DEBUG - Processing node 69d1c699aa48d6fae7bb2058: baseline-arm64-clabbe 2026-04-07 02:19:10,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c699aa48d6fae7bb2058 2026-04-07 02:19:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:19:10,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c699aa48d6fae7bb2058 HTTP/1.1" 200 None 2026-04-07 02:19:10,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:19:10,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-07 02:19:10,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:19:10,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c699aa48d6fae7bb2058 HTTP/1.1" 200 None 2026-04-07 02:19:10,546 - lava_callback - ERROR - Error processing callback for node 69d1c699aa48d6fae7bb2058: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:19:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:19:20,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:22:32,478 - lava_callback - INFO - Received callback for node 69d1c764aa48d6fae7bb20df INFO: 172.21.0.1:40140 - "POST /node/69d1c764aa48d6fae7bb20df HTTP/1.0" 202 Accepted 2026-04-07 02:22:32,483 - lava_callback - INFO - Starting async job submit for node 69d1c764aa48d6fae7bb20df 2026-04-07 02:22:32,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:22:32,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c764aa48d6fae7bb20df HTTP/1.1" 200 None 2026-04-07 02:22:32,500 - lava_callback - DEBUG - Processing node 69d1c764aa48d6fae7bb20df: baseline-arm64-baylibre 2026-04-07 02:22:32,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c764aa48d6fae7bb20df 2026-04-07 02:22:32,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:22:32,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c764aa48d6fae7bb20df HTTP/1.1" 200 None 2026-04-07 02:22:32,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:22:32,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:22:32,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:22:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c764aa48d6fae7bb20df HTTP/1.1" 200 None 2026-04-07 02:22:32,581 - lava_callback - ERROR - Error processing callback for node 69d1c764aa48d6fae7bb20df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:23:52,465 - lava_callback - INFO - Received callback for node 69d1c7acaa48d6fae7bb2105 INFO: 172.21.0.1:52670 - "POST /node/69d1c7acaa48d6fae7bb2105 HTTP/1.0" 202 Accepted 2026-04-07 02:23:52,471 - lava_callback - INFO - Starting async job submit for node 69d1c7acaa48d6fae7bb2105 2026-04-07 02:23:52,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:23:52,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c7acaa48d6fae7bb2105 HTTP/1.1" 200 None 2026-04-07 02:23:52,488 - lava_callback - DEBUG - Processing node 69d1c7acaa48d6fae7bb2105: baseline-arm64-baylibre 2026-04-07 02:23:52,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c7acaa48d6fae7bb2105 2026-04-07 02:23:52,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:23:52,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c7acaa48d6fae7bb2105 HTTP/1.1" 200 None 2026-04-07 02:23:52,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:23:52,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:23:52,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:23:52,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c7acaa48d6fae7bb2105 HTTP/1.1" 200 None 2026-04-07 02:23:52,545 - lava_callback - ERROR - Error processing callback for node 69d1c7acaa48d6fae7bb2105: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:24:13,819 - lava_callback - INFO - Received callback for node 69d466918fbbb5910332149c INFO: 172.21.0.1:44782 - "POST /node/69d466918fbbb5910332149c HTTP/1.0" 202 Accepted 2026-04-07 02:24:13,826 - lava_callback - INFO - Starting async job submit for node 69d466918fbbb5910332149c 2026-04-07 02:24:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:13,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466918fbbb5910332149c HTTP/1.1" 200 None 2026-04-07 02:24:13,896 - lava_callback - DEBUG - Processing node 69d466918fbbb5910332149c: baseline-arm 2026-04-07 02:24:14,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:24:14,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:24:14,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d466918fbbb5910332149c/log.txt.gz 2026-04-07 02:24:14,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44784 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-07 02:24:15,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:24:15,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d466918fbbb5910332149c/lava-logs.yaml 2026-04-07 02:24:15,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:24:15,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:24:15,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d466918fbbb5910332149c/lava_callback.json.gz DEBUG: Setup failed for 69d466918fbbb5910332149c. Transitting job node result: incomplete -> fail 2026-04-07 02:24:15,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:15,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d466918fbbb5910332149c HTTP/1.1" 200 None 2026-04-07 02:24:15,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:15,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 02:24:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:15,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d466918fbbb5910332149c HTTP/1.1" 200 None 2026-04-07 02:24:15,695 - lava_callback - INFO - Completed processing callback for node 69d466918fbbb5910332149c INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:24:20,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:20,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET /node/69937957cebe99dd8e06b4e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:24:52,377 - lava_callback - INFO - Received callback for node 69d1c7edaa48d6fae7bb2145 INFO: 172.21.0.1:34224 - "POST /node/69d1c7edaa48d6fae7bb2145 HTTP/1.0" 202 Accepted 2026-04-07 02:24:52,383 - lava_callback - INFO - Starting async job submit for node 69d1c7edaa48d6fae7bb2145 2026-04-07 02:24:52,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:52,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c7edaa48d6fae7bb2145 HTTP/1.1" 200 None 2026-04-07 02:24:52,399 - lava_callback - DEBUG - Processing node 69d1c7edaa48d6fae7bb2145: baseline-arm64-baylibre 2026-04-07 02:24:52,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c7edaa48d6fae7bb2145 2026-04-07 02:24:52,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:52,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c7edaa48d6fae7bb2145 HTTP/1.1" 200 None 2026-04-07 02:24:52,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:52,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:24:52,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:24:52,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c7edaa48d6fae7bb2145 HTTP/1.1" 200 None 2026-04-07 02:24:52,464 - lava_callback - ERROR - Error processing callback for node 69d1c7edaa48d6fae7bb2145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET /node/698f5af13013abef95cf7745%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET /node/693e58c8407f32424eb634f0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50486 - "GET /node/69847c3e3a8748f2820874d0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:28:52,622 - lava_callback - INFO - Received callback for node 69d1c8d0aa48d6fae7bb2229 INFO: 172.21.0.1:34164 - "POST /node/69d1c8d0aa48d6fae7bb2229 HTTP/1.0" 202 Accepted 2026-04-07 02:28:52,627 - lava_callback - INFO - Starting async job submit for node 69d1c8d0aa48d6fae7bb2229 2026-04-07 02:28:52,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:28:52,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c8d0aa48d6fae7bb2229 HTTP/1.1" 200 None 2026-04-07 02:28:52,643 - lava_callback - DEBUG - Processing node 69d1c8d0aa48d6fae7bb2229: baseline-arm64-baylibre 2026-04-07 02:28:52,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c8d0aa48d6fae7bb2229 2026-04-07 02:28:52,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:28:52,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c8d0aa48d6fae7bb2229 HTTP/1.1" 200 None 2026-04-07 02:28:52,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:28:52,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:28:52,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:28:52,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c8d0aa48d6fae7bb2229 HTTP/1.1" 200 None 2026-04-07 02:28:52,699 - lava_callback - ERROR - Error processing callback for node 69d1c8d0aa48d6fae7bb2229: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:29:52,635 - lava_callback - INFO - Received callback for node 69d1c914aa48d6fae7bb227c INFO: 172.21.0.1:50102 - "POST /node/69d1c914aa48d6fae7bb227c HTTP/1.0" 202 Accepted 2026-04-07 02:29:52,641 - lava_callback - INFO - Starting async job submit for node 69d1c914aa48d6fae7bb227c 2026-04-07 02:29:52,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:29:52,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c914aa48d6fae7bb227c HTTP/1.1" 200 None 2026-04-07 02:29:52,659 - lava_callback - DEBUG - Processing node 69d1c914aa48d6fae7bb227c: baseline-arm64-baylibre 2026-04-07 02:29:52,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c914aa48d6fae7bb227c 2026-04-07 02:29:52,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:29:52,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c914aa48d6fae7bb227c HTTP/1.1" 200 None 2026-04-07 02:29:52,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:29:52,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:29:52,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:29:52,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c914aa48d6fae7bb227c HTTP/1.1" 200 None 2026-04-07 02:29:52,712 - lava_callback - ERROR - Error processing callback for node 69d1c914aa48d6fae7bb227c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:30:22,301 - lava_callback - INFO - Received callback for node 69d46af98fbbb59103321781 INFO: 172.21.0.1:59290 - "POST /node/69d46af98fbbb59103321781 HTTP/1.0" 202 Accepted 2026-04-07 02:30:22,309 - lava_callback - INFO - Starting async job submit for node 69d46af98fbbb59103321781 2026-04-07 02:30:22,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:30:22,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46af98fbbb59103321781 HTTP/1.1" 200 None 2026-04-07 02:30:22,364 - lava_callback - DEBUG - Processing node 69d46af98fbbb59103321781: baseline-arm64 2026-04-07 02:30:22,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:30:22,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:30:22,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d46af98fbbb59103321781/log.txt.gz 2026-04-07 02:30:23,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:30:23,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:30:23,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d46af98fbbb59103321781/lava-logs.yaml 2026-04-07 02:30:23,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:30:23,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:30:23,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d46af98fbbb59103321781/lava_callback.json.gz DEBUG: Setup failed for 69d46af98fbbb59103321781. Transitting job node result: incomplete -> fail 2026-04-07 02:30:23,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:30:23,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46af98fbbb59103321781 HTTP/1.1" 200 None 2026-04-07 02:30:23,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:30:23,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:30:23,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:30:23,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d46af98fbbb59103321781 HTTP/1.1" 200 None 2026-04-07 02:30:23,854 - lava_callback - INFO - Completed processing callback for node 69d46af98fbbb59103321781 INFO: 172.21.0.1:59304 - "GET /node/698694e72de8e2dea3666270%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:30:50,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:30:50,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:31:12,771 - lava_callback - INFO - Received callback for node 69d1c95daa48d6fae7bb2281 INFO: 172.21.0.1:44228 - "POST /node/69d1c95daa48d6fae7bb2281 HTTP/1.0" 202 Accepted 2026-04-07 02:31:12,778 - lava_callback - INFO - Starting async job submit for node 69d1c95daa48d6fae7bb2281 2026-04-07 02:31:12,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:31:12,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c95daa48d6fae7bb2281 HTTP/1.1" 200 None 2026-04-07 02:31:12,802 - lava_callback - DEBUG - Processing node 69d1c95daa48d6fae7bb2281: baseline-arm64-baylibre 2026-04-07 02:31:12,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c95daa48d6fae7bb2281 2026-04-07 02:31:12,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:31:12,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c95daa48d6fae7bb2281 HTTP/1.1" 200 None 2026-04-07 02:31:12,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:31:12,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:31:12,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:31:12,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c95daa48d6fae7bb2281 HTTP/1.1" 200 None 2026-04-07 02:31:12,877 - lava_callback - ERROR - Error processing callback for node 69d1c95daa48d6fae7bb2281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:32:10,996 - lava_callback - INFO - Received callback for node 69d1c9a7aa48d6fae7bb22b4 INFO: 172.21.0.1:33856 - "POST /node/69d1c9a7aa48d6fae7bb22b4 HTTP/1.0" 202 Accepted 2026-04-07 02:32:11,002 - lava_callback - INFO - Starting async job submit for node 69d1c9a7aa48d6fae7bb22b4 2026-04-07 02:32:11,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:32:11,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c9a7aa48d6fae7bb22b4 HTTP/1.1" 200 None 2026-04-07 02:32:11,018 - lava_callback - DEBUG - Processing node 69d1c9a7aa48d6fae7bb22b4: baseline-arm64-clabbe 2026-04-07 02:32:11,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c9a7aa48d6fae7bb22b4 2026-04-07 02:32:11,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:32:11,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c9a7aa48d6fae7bb22b4 HTTP/1.1" 200 None 2026-04-07 02:32:11,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:32:11,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:32:11,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:32:11,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c9a7aa48d6fae7bb22b4 HTTP/1.1" 200 None 2026-04-07 02:32:11,092 - lava_callback - ERROR - Error processing callback for node 69d1c9a7aa48d6fae7bb22b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:33:10,076 - lava_callback - INFO - Received callback for node 69d46b928fbbb591033217f8 INFO: 172.21.0.1:47740 - "POST /node/69d46b928fbbb591033217f8 HTTP/1.0" 202 Accepted 2026-04-07 02:33:10,085 - lava_callback - INFO - Starting async job submit for node 69d46b928fbbb591033217f8 2026-04-07 02:33:10,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:10,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46b928fbbb591033217f8 HTTP/1.1" 200 None 2026-04-07 02:33:10,190 - lava_callback - DEBUG - Processing node 69d46b928fbbb591033217f8: baseline-arm64-foundriesio 2026-04-07 02:33:11,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:33:11,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:33:11,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d46b928fbbb591033217f8/log.txt.gz INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:33:12,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:33:12,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:33:12,661 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d46b928fbbb591033217f8/lava-logs.yaml 2026-04-07 02:33:12,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:33:12,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:33:12,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d46b928fbbb591033217f8/lava_callback.json.gz DEBUG: Setup failed for 69d46b928fbbb591033217f8. Transitting job node result: incomplete -> fail 2026-04-07 02:33:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:13,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46b928fbbb591033217f8 HTTP/1.1" 200 None 2026-04-07 02:33:13,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:13,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:33:13,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:13,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d46b928fbbb591033217f8 HTTP/1.1" 200 None 2026-04-07 02:33:13,193 - lava_callback - INFO - Completed processing callback for node 69d46b928fbbb591033217f8 INFO: 172.21.0.1:47750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:33:20,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:20,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:33:31,070 - lava_callback - INFO - Received callback for node 69d1c9e9aa48d6fae7bb22f7 INFO: 172.21.0.1:36820 - "POST /node/69d1c9e9aa48d6fae7bb22f7 HTTP/1.0" 202 Accepted 2026-04-07 02:33:31,077 - lava_callback - INFO - Starting async job submit for node 69d1c9e9aa48d6fae7bb22f7 2026-04-07 02:33:31,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:31,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c9e9aa48d6fae7bb22f7 HTTP/1.1" 200 None 2026-04-07 02:33:31,093 - lava_callback - DEBUG - Processing node 69d1c9e9aa48d6fae7bb22f7: baseline-arm64-clabbe 2026-04-07 02:33:31,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1c9e9aa48d6fae7bb22f7 2026-04-07 02:33:31,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:31,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c9e9aa48d6fae7bb22f7 HTTP/1.1" 200 None 2026-04-07 02:33:31,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:31,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:33:31,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:33:31,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c9e9aa48d6fae7bb22f7 HTTP/1.1" 200 None 2026-04-07 02:33:31,149 - lava_callback - ERROR - Error processing callback for node 69d1c9e9aa48d6fae7bb22f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET /node/6983f22a969566dcb0d2a7fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:34:31,151 - lava_callback - INFO - Received callback for node 69d1ca2daa48d6fae7bb2324 INFO: 172.21.0.1:40708 - "POST /node/69d1ca2daa48d6fae7bb2324 HTTP/1.0" 202 Accepted 2026-04-07 02:34:31,160 - lava_callback - INFO - Starting async job submit for node 69d1ca2daa48d6fae7bb2324 2026-04-07 02:34:31,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:34:31,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ca2daa48d6fae7bb2324 HTTP/1.1" 200 None 2026-04-07 02:34:31,181 - lava_callback - DEBUG - Processing node 69d1ca2daa48d6fae7bb2324: baseline-arm64-clabbe 2026-04-07 02:34:31,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ca2daa48d6fae7bb2324 2026-04-07 02:34:31,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:34:31,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ca2daa48d6fae7bb2324 HTTP/1.1" 200 None 2026-04-07 02:34:31,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:34:31,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:34:31,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:34:31,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ca2daa48d6fae7bb2324 HTTP/1.1" 200 None 2026-04-07 02:34:31,249 - lava_callback - ERROR - Error processing callback for node 69d1ca2daa48d6fae7bb2324: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:35:31,214 - lava_callback - INFO - Received callback for node 69d1ca6baa48d6fae7bb2385 INFO: 172.21.0.1:54328 - "POST /node/69d1ca6baa48d6fae7bb2385 HTTP/1.0" 202 Accepted 2026-04-07 02:35:31,219 - lava_callback - INFO - Starting async job submit for node 69d1ca6baa48d6fae7bb2385 2026-04-07 02:35:31,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:35:31,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ca6baa48d6fae7bb2385 HTTP/1.1" 200 None 2026-04-07 02:35:31,239 - lava_callback - DEBUG - Processing node 69d1ca6baa48d6fae7bb2385: baseline-arm64-clabbe 2026-04-07 02:35:31,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ca6baa48d6fae7bb2385 2026-04-07 02:35:31,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:35:31,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ca6baa48d6fae7bb2385 HTTP/1.1" 200 None 2026-04-07 02:35:31,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:35:31,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:35:31,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:35:31,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ca6baa48d6fae7bb2385 HTTP/1.1" 200 None 2026-04-07 02:35:31,296 - lava_callback - ERROR - Error processing callback for node 69d1ca6baa48d6fae7bb2385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET /node/695474156972f3788844d0dd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36292 - "GET /node/69973c248babaef6576763e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:36:51,292 - lava_callback - INFO - Received callback for node 69d1cab3aa48d6fae7bb23ad INFO: 172.21.0.1:43390 - "POST /node/69d1cab3aa48d6fae7bb23ad HTTP/1.0" 202 Accepted 2026-04-07 02:36:51,298 - lava_callback - INFO - Starting async job submit for node 69d1cab3aa48d6fae7bb23ad 2026-04-07 02:36:51,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:36:51,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cab3aa48d6fae7bb23ad HTTP/1.1" 200 None 2026-04-07 02:36:51,317 - lava_callback - DEBUG - Processing node 69d1cab3aa48d6fae7bb23ad: baseline-arm64-clabbe 2026-04-07 02:36:51,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cab3aa48d6fae7bb23ad 2026-04-07 02:36:51,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:36:51,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cab3aa48d6fae7bb23ad HTTP/1.1" 200 None 2026-04-07 02:36:51,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:36:51,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:36:51,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:36:51,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cab3aa48d6fae7bb23ad HTTP/1.1" 200 None 2026-04-07 02:36:51,378 - lava_callback - ERROR - Error processing callback for node 69d1cab3aa48d6fae7bb23ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:37:51,303 - lava_callback - INFO - Received callback for node 69d1cafaaa48d6fae7bb23c4 INFO: 172.21.0.1:36192 - "POST /node/69d1cafaaa48d6fae7bb23c4 HTTP/1.0" 202 Accepted 2026-04-07 02:37:51,313 - lava_callback - INFO - Starting async job submit for node 69d1cafaaa48d6fae7bb23c4 2026-04-07 02:37:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:37:51,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cafaaa48d6fae7bb23c4 HTTP/1.1" 200 None 2026-04-07 02:37:51,336 - lava_callback - DEBUG - Processing node 69d1cafaaa48d6fae7bb23c4: baseline-arm64-clabbe 2026-04-07 02:37:51,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cafaaa48d6fae7bb23c4 2026-04-07 02:37:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:37:51,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cafaaa48d6fae7bb23c4 HTTP/1.1" 200 None 2026-04-07 02:37:51,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:37:51,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-07 02:37:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:37:51,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cafaaa48d6fae7bb23c4 HTTP/1.1" 200 None 2026-04-07 02:37:51,409 - lava_callback - ERROR - Error processing callback for node 69d1cafaaa48d6fae7bb23c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET /node/694a3c662060d3d847922836%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34506 - "GET /node/693fc900575bc060ce149912%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET /node/693e493d407f32424eb5fb61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:39:26,708 - lava_callback - INFO - Received callback for node 69d469c28fbbb591033216b9 INFO: 172.21.0.1:36652 - "POST /node/69d469c28fbbb591033216b9 HTTP/1.0" 202 Accepted 2026-04-07 02:39:26,716 - lava_callback - INFO - Starting async job submit for node 69d469c28fbbb591033216b9 2026-04-07 02:39:26,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:39:26,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d469c28fbbb591033216b9 HTTP/1.1" 200 None 2026-04-07 02:39:26,787 - lava_callback - DEBUG - Processing node 69d469c28fbbb591033216b9: baseline-nfs-arm64 2026-04-07 02:39:28,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:39:28,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:39:28,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d469c28fbbb591033216b9/log.txt.gz 2026-04-07 02:39:29,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:39:29,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:39:29,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d469c28fbbb591033216b9/lava-logs.yaml 2026-04-07 02:39:29,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:39:29,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:39:29,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d469c28fbbb591033216b9/lava_callback.json.gz DEBUG: Setup failed for 69d469c28fbbb591033216b9. Transitting job node result: incomplete -> fail 2026-04-07 02:39:29,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:39:29,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d469c28fbbb591033216b9 HTTP/1.1" 200 None 2026-04-07 02:39:29,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:39:29,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:39:29,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:39:29,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d469c28fbbb591033216b9 HTTP/1.1" 200 None 2026-04-07 02:39:30,096 - lava_callback - INFO - Completed processing callback for node 69d469c28fbbb591033216b9 INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:39:50,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:39:50,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET /node/69848a4f3a8748f28208793c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET /node/693ff592575bc060ce14ece4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET /node/693f69420d8ce4018da91187%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38776 - "GET /node/698a226722b4cc0f227af356%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:41:53,412 - lava_callback - INFO - Received callback for node 69d1cbe4aa48d6fae7bb242b INFO: 172.21.0.1:48340 - "POST /node/69d1cbe4aa48d6fae7bb242b HTTP/1.0" 202 Accepted 2026-04-07 02:41:53,418 - lava_callback - INFO - Starting async job submit for node 69d1cbe4aa48d6fae7bb242b 2026-04-07 02:41:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:41:53,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cbe4aa48d6fae7bb242b HTTP/1.1" 200 None 2026-04-07 02:41:53,434 - lava_callback - DEBUG - Processing node 69d1cbe4aa48d6fae7bb242b: baseline-arm-baylibre 2026-04-07 02:41:53,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cbe4aa48d6fae7bb242b 2026-04-07 02:41:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:41:53,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cbe4aa48d6fae7bb242b HTTP/1.1" 200 None 2026-04-07 02:41:53,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:41:53,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:41:53,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:41:53,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cbe4aa48d6fae7bb242b HTTP/1.1" 200 None 2026-04-07 02:41:53,505 - lava_callback - ERROR - Error processing callback for node 69d1cbe4aa48d6fae7bb242b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET /node/6992f8b031166481c8ddd71b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42960 - "GET /node/698a816fd9a1cfa777a233cf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:43:33,452 - lava_callback - INFO - Received callback for node 69d1cc51aa48d6fae7bb246c INFO: 172.21.0.1:60748 - "POST /node/69d1cc51aa48d6fae7bb246c HTTP/1.0" 202 Accepted 2026-04-07 02:43:33,457 - lava_callback - INFO - Starting async job submit for node 69d1cc51aa48d6fae7bb246c 2026-04-07 02:43:33,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:43:33,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc51aa48d6fae7bb246c HTTP/1.1" 200 None 2026-04-07 02:43:33,474 - lava_callback - DEBUG - Processing node 69d1cc51aa48d6fae7bb246c: baseline-arm-baylibre 2026-04-07 02:43:33,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cc51aa48d6fae7bb246c 2026-04-07 02:43:33,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:43:33,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc51aa48d6fae7bb246c HTTP/1.1" 200 None 2026-04-07 02:43:33,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:43:33,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:43:33,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:43:33,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cc51aa48d6fae7bb246c HTTP/1.1" 200 None 2026-04-07 02:43:33,540 - lava_callback - ERROR - Error processing callback for node 69d1cc51aa48d6fae7bb246c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:44:13,440 - lava_callback - INFO - Received callback for node 69d1cc76aa48d6fae7bb2477 INFO: 172.21.0.1:52788 - "POST /node/69d1cc76aa48d6fae7bb2477 HTTP/1.0" 202 Accepted 2026-04-07 02:44:13,448 - lava_callback - INFO - Starting async job submit for node 69d1cc76aa48d6fae7bb2477 2026-04-07 02:44:13,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:13,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc76aa48d6fae7bb2477 HTTP/1.1" 200 None 2026-04-07 02:44:13,468 - lava_callback - DEBUG - Processing node 69d1cc76aa48d6fae7bb2477: baseline-arm-baylibre 2026-04-07 02:44:13,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cc76aa48d6fae7bb2477 2026-04-07 02:44:13,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:13,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc76aa48d6fae7bb2477 HTTP/1.1" 200 None 2026-04-07 02:44:13,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:13,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:44:13,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:13,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cc76aa48d6fae7bb2477 HTTP/1.1" 200 None 2026-04-07 02:44:13,528 - lava_callback - ERROR - Error processing callback for node 69d1cc76aa48d6fae7bb2477: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:44:53,533 - lava_callback - INFO - Received callback for node 69d1cc94aa48d6fae7bb24a6 INFO: 172.21.0.1:55132 - "POST /node/69d1cc94aa48d6fae7bb24a6 HTTP/1.0" 202 Accepted 2026-04-07 02:44:53,539 - lava_callback - INFO - Starting async job submit for node 69d1cc94aa48d6fae7bb24a6 2026-04-07 02:44:53,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:53,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc94aa48d6fae7bb24a6 HTTP/1.1" 200 None 2026-04-07 02:44:53,555 - lava_callback - DEBUG - Processing node 69d1cc94aa48d6fae7bb24a6: baseline-arm-baylibre 2026-04-07 02:44:53,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cc94aa48d6fae7bb24a6 2026-04-07 02:44:53,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:53,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc94aa48d6fae7bb24a6 HTTP/1.1" 200 None 2026-04-07 02:44:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:53,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:44:53,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:44:53,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cc94aa48d6fae7bb24a6 HTTP/1.1" 200 None 2026-04-07 02:44:53,613 - lava_callback - ERROR - Error processing callback for node 69d1cc94aa48d6fae7bb24a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:46:31,745 - lava_callback - INFO - Received callback for node 69d1ccfaaa48d6fae7bb24e1 INFO: 172.21.0.1:40344 - "POST /node/69d1ccfaaa48d6fae7bb24e1 HTTP/1.0" 202 Accepted 2026-04-07 02:46:31,750 - lava_callback - INFO - Starting async job submit for node 69d1ccfaaa48d6fae7bb24e1 2026-04-07 02:46:31,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:46:31,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ccfaaa48d6fae7bb24e1 HTTP/1.1" 200 None 2026-04-07 02:46:31,774 - lava_callback - DEBUG - Processing node 69d1ccfaaa48d6fae7bb24e1: baseline-arm-clabbe 2026-04-07 02:46:31,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ccfaaa48d6fae7bb24e1 2026-04-07 02:46:31,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:46:31,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ccfaaa48d6fae7bb24e1 HTTP/1.1" 200 None 2026-04-07 02:46:31,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:46:31,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:46:31,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:46:31,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ccfaaa48d6fae7bb24e1 HTTP/1.1" 200 None 2026-04-07 02:46:31,826 - lava_callback - ERROR - Error processing callback for node 69d1ccfaaa48d6fae7bb24e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:47:31,808 - lava_callback - INFO - Received callback for node 69d1cd30aa48d6fae7bb2505 INFO: 172.21.0.1:43202 - "POST /node/69d1cd30aa48d6fae7bb2505 HTTP/1.0" 202 Accepted 2026-04-07 02:47:31,814 - lava_callback - INFO - Starting async job submit for node 69d1cd30aa48d6fae7bb2505 2026-04-07 02:47:31,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:47:31,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cd30aa48d6fae7bb2505 HTTP/1.1" 200 None 2026-04-07 02:47:31,834 - lava_callback - DEBUG - Processing node 69d1cd30aa48d6fae7bb2505: baseline-arm-clabbe 2026-04-07 02:47:31,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cd30aa48d6fae7bb2505 2026-04-07 02:47:31,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:47:31,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cd30aa48d6fae7bb2505 HTTP/1.1" 200 None 2026-04-07 02:47:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:47:31,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:47:31,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:47:31,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cd30aa48d6fae7bb2505 HTTP/1.1" 200 None 2026-04-07 02:47:31,900 - lava_callback - ERROR - Error processing callback for node 69d1cd30aa48d6fae7bb2505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET /node/699381d2cebe99dd8e06e4b7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:48:31,801 - lava_callback - INFO - Received callback for node 69d1cd6daa48d6fae7bb2543 INFO: 172.21.0.1:59306 - "POST /node/69d1cd6daa48d6fae7bb2543 HTTP/1.0" 202 Accepted 2026-04-07 02:48:31,807 - lava_callback - INFO - Starting async job submit for node 69d1cd6daa48d6fae7bb2543 2026-04-07 02:48:31,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:48:31,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cd6daa48d6fae7bb2543 HTTP/1.1" 200 None 2026-04-07 02:48:31,824 - lava_callback - DEBUG - Processing node 69d1cd6daa48d6fae7bb2543: baseline-arm-clabbe 2026-04-07 02:48:31,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cd6daa48d6fae7bb2543 2026-04-07 02:48:31,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:48:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cd6daa48d6fae7bb2543 HTTP/1.1" 200 None 2026-04-07 02:48:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:48:31,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:48:31,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:48:31,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cd6daa48d6fae7bb2543 HTTP/1.1" 200 None 2026-04-07 02:48:31,882 - lava_callback - ERROR - Error processing callback for node 69d1cd6daa48d6fae7bb2543: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:49:11,965 - lava_callback - INFO - Received callback for node 69d46c838fbbb5910332192a INFO: 172.21.0.1:38482 - "POST /node/69d46c838fbbb5910332192a HTTP/1.0" 202 Accepted 2026-04-07 02:49:11,972 - lava_callback - INFO - Starting async job submit for node 69d46c838fbbb5910332192a 2026-04-07 02:49:12,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:12,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46c838fbbb5910332192a HTTP/1.1" 200 None 2026-04-07 02:49:12,041 - lava_callback - DEBUG - Processing node 69d46c838fbbb5910332192a: baseline-arm INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:49:12,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:49:12,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:49:12,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d46c838fbbb5910332192a/log.txt.gz 2026-04-07 02:49:13,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:49:13,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:49:13,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d46c838fbbb5910332192a/lava-logs.yaml 2026-04-07 02:49:13,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:49:13,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:49:13,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d46c838fbbb5910332192a/lava_callback.json.gz DEBUG: Setup failed for 69d46c838fbbb5910332192a. Transitting job node result: incomplete -> fail 2026-04-07 02:49:13,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:13,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46c838fbbb5910332192a HTTP/1.1" 200 None 2026-04-07 02:49:13,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:13,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d5a8fbbb5910331f997 HTTP/1.1" 200 None 2026-04-07 02:49:13,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:13,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d46c838fbbb5910332192a HTTP/1.1" 200 None 2026-04-07 02:49:14,019 - lava_callback - INFO - Completed processing callback for node 69d46c838fbbb5910332192a INFO: 172.21.0.1:38496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:49:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:20,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:49:31,784 - lava_callback - INFO - Received callback for node 69d1cda9aa48d6fae7bb2568 INFO: 172.21.0.1:58524 - "POST /node/69d1cda9aa48d6fae7bb2568 HTTP/1.0" 202 Accepted 2026-04-07 02:49:31,790 - lava_callback - INFO - Starting async job submit for node 69d1cda9aa48d6fae7bb2568 2026-04-07 02:49:31,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:31,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cda9aa48d6fae7bb2568 HTTP/1.1" 200 None 2026-04-07 02:49:31,806 - lava_callback - DEBUG - Processing node 69d1cda9aa48d6fae7bb2568: baseline-arm-clabbe 2026-04-07 02:49:31,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cda9aa48d6fae7bb2568 2026-04-07 02:49:31,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:31,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cda9aa48d6fae7bb2568 HTTP/1.1" 200 None 2026-04-07 02:49:31,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:49:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:49:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cda9aa48d6fae7bb2568 HTTP/1.1" 200 None 2026-04-07 02:49:31,901 - lava_callback - ERROR - Error processing callback for node 69d1cda9aa48d6fae7bb2568: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:50:31,845 - lava_callback - INFO - Received callback for node 69d1cde5aa48d6fae7bb2595 INFO: 172.21.0.1:58864 - "POST /node/69d1cde5aa48d6fae7bb2595 HTTP/1.0" 202 Accepted 2026-04-07 02:50:31,851 - lava_callback - INFO - Starting async job submit for node 69d1cde5aa48d6fae7bb2595 2026-04-07 02:50:31,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:31,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cde5aa48d6fae7bb2595 HTTP/1.1" 200 None 2026-04-07 02:50:31,867 - lava_callback - DEBUG - Processing node 69d1cde5aa48d6fae7bb2595: baseline-arm-clabbe 2026-04-07 02:50:31,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1cde5aa48d6fae7bb2595 2026-04-07 02:50:31,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:31,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cde5aa48d6fae7bb2595 HTTP/1.1" 200 None 2026-04-07 02:50:31,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:31,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:50:31,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:31,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cde5aa48d6fae7bb2595 HTTP/1.1" 200 None 2026-04-07 02:50:31,927 - lava_callback - ERROR - Error processing callback for node 69d1cde5aa48d6fae7bb2595: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:50:51,790 - lava_callback - INFO - Received callback for node 69d1ce08aa48d6fae7bb25a2 INFO: 172.21.0.1:42644 - "POST /node/69d1ce08aa48d6fae7bb25a2 HTTP/1.0" 202 Accepted 2026-04-07 02:50:51,797 - lava_callback - INFO - Starting async job submit for node 69d1ce08aa48d6fae7bb25a2 2026-04-07 02:50:51,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:51,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ce08aa48d6fae7bb25a2 HTTP/1.1" 200 None 2026-04-07 02:50:51,813 - lava_callback - DEBUG - Processing node 69d1ce08aa48d6fae7bb25a2: baseline-arm-clabbe 2026-04-07 02:50:51,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ce08aa48d6fae7bb25a2 2026-04-07 02:50:51,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:51,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ce08aa48d6fae7bb25a2 HTTP/1.1" 200 None 2026-04-07 02:50:51,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:51,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:50:51,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:50:51,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ce08aa48d6fae7bb25a2 HTTP/1.1" 200 None 2026-04-07 02:50:51,868 - lava_callback - ERROR - Error processing callback for node 69d1ce08aa48d6fae7bb25a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:51:31,849 - lava_callback - INFO - Received callback for node 69d1ce28aa48d6fae7bb25b4 INFO: 172.21.0.1:57722 - "POST /node/69d1ce28aa48d6fae7bb25b4 HTTP/1.0" 202 Accepted 2026-04-07 02:51:31,854 - lava_callback - INFO - Starting async job submit for node 69d1ce28aa48d6fae7bb25b4 2026-04-07 02:51:31,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:51:31,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ce28aa48d6fae7bb25b4 HTTP/1.1" 200 None 2026-04-07 02:51:31,871 - lava_callback - DEBUG - Processing node 69d1ce28aa48d6fae7bb25b4: baseline-arm-clabbe 2026-04-07 02:51:31,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1ce28aa48d6fae7bb25b4 2026-04-07 02:51:31,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:51:31,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ce28aa48d6fae7bb25b4 HTTP/1.1" 200 None 2026-04-07 02:51:31,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:51:31,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-07 02:51:31,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:51:31,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ce28aa48d6fae7bb25b4 HTTP/1.1" 200 None 2026-04-07 02:51:31,962 - lava_callback - ERROR - Error processing callback for node 69d1ce28aa48d6fae7bb25b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET /node/695474136972f3788844d0d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:59:27,521 - lava_callback - INFO - Received callback for node 69d46e6b8fbbb5910332196d INFO: 172.21.0.1:60612 - "POST /node/69d46e6b8fbbb5910332196d HTTP/1.0" 202 Accepted 2026-04-07 02:59:27,529 - lava_callback - INFO - Starting async job submit for node 69d46e6b8fbbb5910332196d 2026-04-07 02:59:27,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:59:27,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46e6b8fbbb5910332196d HTTP/1.1" 200 None 2026-04-07 02:59:27,609 - lava_callback - DEBUG - Processing node 69d46e6b8fbbb5910332196d: baseline-nfs-arm64 2026-04-07 02:59:28,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:59:28,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:59:28,904 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d46e6b8fbbb5910332196d/log.txt.gz 2026-04-07 02:59:29,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:59:29,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:59:29,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d46e6b8fbbb5910332196d/lava-logs.yaml 2026-04-07 02:59:29,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 02:59:30,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 02:59:30,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d46e6b8fbbb5910332196d/lava_callback.json.gz DEBUG: Setup failed for 69d46e6b8fbbb5910332196d. Transitting job node result: incomplete -> fail 2026-04-07 02:59:30,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:59:30,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d46e6b8fbbb5910332196d HTTP/1.1" 200 None 2026-04-07 02:59:30,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:59:30,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 02:59:30,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:59:30,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d46e6b8fbbb5910332196d HTTP/1.1" 200 None 2026-04-07 02:59:30,308 - lava_callback - INFO - Completed processing callback for node 69d46e6b8fbbb5910332196d INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK 2026-04-07 02:59:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 02:59:50,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:04:34,655 - lava_callback - INFO - Received callback for node 69d1d134aa48d6fae7bb26d0 INFO: 172.21.0.1:46936 - "POST /node/69d1d134aa48d6fae7bb26d0 HTTP/1.0" 202 Accepted 2026-04-07 03:04:34,661 - lava_callback - INFO - Starting async job submit for node 69d1d134aa48d6fae7bb26d0 2026-04-07 03:04:34,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:04:34,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d134aa48d6fae7bb26d0 HTTP/1.1" 200 None 2026-04-07 03:04:34,676 - lava_callback - DEBUG - Processing node 69d1d134aa48d6fae7bb26d0: baseline-arm64-baylibre 2026-04-07 03:04:34,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d134aa48d6fae7bb26d0 2026-04-07 03:04:34,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:04:34,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d134aa48d6fae7bb26d0 HTTP/1.1" 200 None 2026-04-07 03:04:34,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:04:34,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:04:34,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:04:34,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d134aa48d6fae7bb26d0 HTTP/1.1" 200 None 2026-04-07 03:04:34,727 - lava_callback - ERROR - Error processing callback for node 69d1d134aa48d6fae7bb26d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:05:34,663 - lava_callback - INFO - Received callback for node 69d1d175aa48d6fae7bb2714 INFO: 172.21.0.1:46978 - "POST /node/69d1d175aa48d6fae7bb2714 HTTP/1.0" 202 Accepted 2026-04-07 03:05:34,669 - lava_callback - INFO - Starting async job submit for node 69d1d175aa48d6fae7bb2714 2026-04-07 03:05:34,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:05:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d175aa48d6fae7bb2714 HTTP/1.1" 200 None 2026-04-07 03:05:34,685 - lava_callback - DEBUG - Processing node 69d1d175aa48d6fae7bb2714: baseline-arm64-baylibre 2026-04-07 03:05:34,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d175aa48d6fae7bb2714 2026-04-07 03:05:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:05:34,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d175aa48d6fae7bb2714 HTTP/1.1" 200 None 2026-04-07 03:05:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:05:34,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:05:34,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:05:34,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d175aa48d6fae7bb2714 HTTP/1.1" 200 None 2026-04-07 03:05:34,736 - lava_callback - ERROR - Error processing callback for node 69d1d175aa48d6fae7bb2714: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:06:54,716 - lava_callback - INFO - Received callback for node 69d1d1bbaa48d6fae7bb2739 INFO: 172.21.0.1:36738 - "POST /node/69d1d1bbaa48d6fae7bb2739 HTTP/1.0" 202 Accepted 2026-04-07 03:06:54,723 - lava_callback - INFO - Starting async job submit for node 69d1d1bbaa48d6fae7bb2739 2026-04-07 03:06:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:06:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d1bbaa48d6fae7bb2739 HTTP/1.1" 200 None 2026-04-07 03:06:54,740 - lava_callback - DEBUG - Processing node 69d1d1bbaa48d6fae7bb2739: baseline-arm64-baylibre 2026-04-07 03:06:54,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d1bbaa48d6fae7bb2739 2026-04-07 03:06:54,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:06:54,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d1bbaa48d6fae7bb2739 HTTP/1.1" 200 None 2026-04-07 03:06:54,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:06:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:06:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:06:54,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d1bbaa48d6fae7bb2739 HTTP/1.1" 200 None 2026-04-07 03:06:54,801 - lava_callback - ERROR - Error processing callback for node 69d1d1bbaa48d6fae7bb2739: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:07:54,783 - lava_callback - INFO - Received callback for node 69d1d1feaa48d6fae7bb2774 INFO: 172.21.0.1:55548 - "POST /node/69d1d1feaa48d6fae7bb2774 HTTP/1.0" 202 Accepted 2026-04-07 03:07:54,790 - lava_callback - INFO - Starting async job submit for node 69d1d1feaa48d6fae7bb2774 2026-04-07 03:07:54,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:07:54,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d1feaa48d6fae7bb2774 HTTP/1.1" 200 None 2026-04-07 03:07:54,809 - lava_callback - DEBUG - Processing node 69d1d1feaa48d6fae7bb2774: baseline-arm64-baylibre 2026-04-07 03:07:54,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d1feaa48d6fae7bb2774 2026-04-07 03:07:54,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:07:54,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d1feaa48d6fae7bb2774 HTTP/1.1" 200 None 2026-04-07 03:07:54,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:07:54,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:07:54,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:07:54,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d1feaa48d6fae7bb2774 HTTP/1.1" 200 None 2026-04-07 03:07:54,862 - lava_callback - ERROR - Error processing callback for node 69d1d1feaa48d6fae7bb2774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:09:34,951 - lava_callback - INFO - Received callback for node 69d1d263aa48d6fae7bb279e INFO: 172.21.0.1:58446 - "POST /node/69d1d263aa48d6fae7bb279e HTTP/1.0" 202 Accepted 2026-04-07 03:09:34,957 - lava_callback - INFO - Starting async job submit for node 69d1d263aa48d6fae7bb279e 2026-04-07 03:09:34,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:09:34,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d263aa48d6fae7bb279e HTTP/1.1" 200 None 2026-04-07 03:09:34,973 - lava_callback - DEBUG - Processing node 69d1d263aa48d6fae7bb279e: baseline-arm64-baylibre 2026-04-07 03:09:34,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d263aa48d6fae7bb279e 2026-04-07 03:09:34,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:09:34,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d263aa48d6fae7bb279e HTTP/1.1" 200 None 2026-04-07 03:09:34,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:09:35,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:09:35,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:09:35,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d263aa48d6fae7bb279e HTTP/1.1" 200 None 2026-04-07 03:09:35,053 - lava_callback - ERROR - Error processing callback for node 69d1d263aa48d6fae7bb279e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:10:34,927 - lava_callback - INFO - Received callback for node 69d1d2a4aa48d6fae7bb27ef INFO: 172.21.0.1:45454 - "POST /node/69d1d2a4aa48d6fae7bb27ef HTTP/1.0" 202 Accepted 2026-04-07 03:10:34,933 - lava_callback - INFO - Starting async job submit for node 69d1d2a4aa48d6fae7bb27ef 2026-04-07 03:10:34,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:10:34,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d2a4aa48d6fae7bb27ef HTTP/1.1" 200 None 2026-04-07 03:10:34,950 - lava_callback - DEBUG - Processing node 69d1d2a4aa48d6fae7bb27ef: baseline-arm64-baylibre 2026-04-07 03:10:34,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d2a4aa48d6fae7bb27ef 2026-04-07 03:10:34,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:10:34,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d2a4aa48d6fae7bb27ef HTTP/1.1" 200 None 2026-04-07 03:10:34,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:10:34,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:10:34,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:10:35,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d2a4aa48d6fae7bb27ef HTTP/1.1" 200 None 2026-04-07 03:10:35,018 - lava_callback - ERROR - Error processing callback for node 69d1d2a4aa48d6fae7bb27ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:11:52,815 - lava_callback - INFO - Received callback for node 69d1d2eaaa48d6fae7bb2836 INFO: 172.21.0.1:59842 - "POST /node/69d1d2eaaa48d6fae7bb2836 HTTP/1.0" 202 Accepted 2026-04-07 03:11:52,821 - lava_callback - INFO - Starting async job submit for node 69d1d2eaaa48d6fae7bb2836 2026-04-07 03:11:52,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:11:52,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d2eaaa48d6fae7bb2836 HTTP/1.1" 200 None 2026-04-07 03:11:52,863 - lava_callback - DEBUG - Processing node 69d1d2eaaa48d6fae7bb2836: baseline-arm64-clabbe 2026-04-07 03:11:52,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d2eaaa48d6fae7bb2836 2026-04-07 03:11:52,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:11:52,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d2eaaa48d6fae7bb2836 HTTP/1.1" 200 None 2026-04-07 03:11:52,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:11:52,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:11:52,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:11:52,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d2eaaa48d6fae7bb2836 HTTP/1.1" 200 None 2026-04-07 03:11:52,938 - lava_callback - ERROR - Error processing callback for node 69d1d2eaaa48d6fae7bb2836: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:12:52,808 - lava_callback - INFO - Received callback for node 69d1d330aa48d6fae7bb2857 INFO: 172.21.0.1:39210 - "POST /node/69d1d330aa48d6fae7bb2857 HTTP/1.0" 202 Accepted 2026-04-07 03:12:52,813 - lava_callback - INFO - Starting async job submit for node 69d1d330aa48d6fae7bb2857 2026-04-07 03:12:52,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:12:52,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d330aa48d6fae7bb2857 HTTP/1.1" 200 None 2026-04-07 03:12:52,852 - lava_callback - DEBUG - Processing node 69d1d330aa48d6fae7bb2857: baseline-arm64-clabbe 2026-04-07 03:12:52,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d330aa48d6fae7bb2857 2026-04-07 03:12:52,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:12:52,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d330aa48d6fae7bb2857 HTTP/1.1" 200 None 2026-04-07 03:12:52,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:12:52,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:12:52,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:12:52,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d330aa48d6fae7bb2857 HTTP/1.1" 200 None 2026-04-07 03:12:52,938 - lava_callback - ERROR - Error processing callback for node 69d1d330aa48d6fae7bb2857: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:14:12,858 - lava_callback - INFO - Received callback for node 69d1d374aa48d6fae7bb2882 INFO: 172.21.0.1:47408 - "POST /node/69d1d374aa48d6fae7bb2882 HTTP/1.0" 202 Accepted 2026-04-07 03:14:12,864 - lava_callback - INFO - Starting async job submit for node 69d1d374aa48d6fae7bb2882 2026-04-07 03:14:12,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:14:12,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d374aa48d6fae7bb2882 HTTP/1.1" 200 None 2026-04-07 03:14:12,879 - lava_callback - DEBUG - Processing node 69d1d374aa48d6fae7bb2882: baseline-arm64-clabbe 2026-04-07 03:14:12,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d374aa48d6fae7bb2882 2026-04-07 03:14:12,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:14:12,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d374aa48d6fae7bb2882 HTTP/1.1" 200 None 2026-04-07 03:14:12,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:14:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:14:12,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:14:12,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d374aa48d6fae7bb2882 HTTP/1.1" 200 None 2026-04-07 03:14:12,931 - lava_callback - ERROR - Error processing callback for node 69d1d374aa48d6fae7bb2882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:15:12,864 - lava_callback - INFO - Received callback for node 69d1d3b9aa48d6fae7bb28ba INFO: 172.21.0.1:37342 - "POST /node/69d1d3b9aa48d6fae7bb28ba HTTP/1.0" 202 Accepted 2026-04-07 03:15:12,870 - lava_callback - INFO - Starting async job submit for node 69d1d3b9aa48d6fae7bb28ba 2026-04-07 03:15:12,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:15:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d3b9aa48d6fae7bb28ba HTTP/1.1" 200 None 2026-04-07 03:15:12,886 - lava_callback - DEBUG - Processing node 69d1d3b9aa48d6fae7bb28ba: baseline-arm64-clabbe 2026-04-07 03:15:12,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d3b9aa48d6fae7bb28ba 2026-04-07 03:15:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:15:12,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d3b9aa48d6fae7bb28ba HTTP/1.1" 200 None 2026-04-07 03:15:12,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:15:12,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:15:12,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:15:12,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d3b9aa48d6fae7bb28ba HTTP/1.1" 200 None 2026-04-07 03:15:12,943 - lava_callback - ERROR - Error processing callback for node 69d1d3b9aa48d6fae7bb28ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:16:32,982 - lava_callback - INFO - Received callback for node 69d1d40eaa48d6fae7bb28df INFO: 172.21.0.1:36744 - "POST /node/69d1d40eaa48d6fae7bb28df HTTP/1.0" 202 Accepted 2026-04-07 03:16:32,991 - lava_callback - INFO - Starting async job submit for node 69d1d40eaa48d6fae7bb28df 2026-04-07 03:16:32,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:16:33,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d40eaa48d6fae7bb28df HTTP/1.1" 200 None 2026-04-07 03:16:33,014 - lava_callback - DEBUG - Processing node 69d1d40eaa48d6fae7bb28df: baseline-arm64-clabbe 2026-04-07 03:16:33,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d40eaa48d6fae7bb28df 2026-04-07 03:16:33,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:16:33,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d40eaa48d6fae7bb28df HTTP/1.1" 200 None 2026-04-07 03:16:33,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:16:33,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:16:33,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:16:33,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d40eaa48d6fae7bb28df HTTP/1.1" 200 None 2026-04-07 03:16:33,097 - lava_callback - ERROR - Error processing callback for node 69d1d40eaa48d6fae7bb28df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK 2026-04-07 03:17:53,036 - lava_callback - INFO - Received callback for node 69d1d453aa48d6fae7bb2914 INFO: 172.21.0.1:44716 - "POST /node/69d1d453aa48d6fae7bb2914 HTTP/1.0" 202 Accepted 2026-04-07 03:17:53,042 - lava_callback - INFO - Starting async job submit for node 69d1d453aa48d6fae7bb2914 2026-04-07 03:17:53,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:17:53,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d453aa48d6fae7bb2914 HTTP/1.1" 200 None 2026-04-07 03:17:53,058 - lava_callback - DEBUG - Processing node 69d1d453aa48d6fae7bb2914: baseline-arm64-clabbe 2026-04-07 03:17:53,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1d453aa48d6fae7bb2914 2026-04-07 03:17:53,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:17:53,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1d453aa48d6fae7bb2914 HTTP/1.1" 200 None 2026-04-07 03:17:53,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:17:53,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-07 03:17:53,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 03:17:53,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1d453aa48d6fae7bb2914 HTTP/1.1" 200 None 2026-04-07 03:17:53,121 - lava_callback - ERROR - Error processing callback for node 69d1d453aa48d6fae7bb2914: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET /node/6992eebf31166481c8dda095%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET /node/695206c95318368af0c45faa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET /node/693f9fef0d8ce4018da99a49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36292 - "GET /node/69937300cebe99dd8e069c95%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET /node/6985d90a71989fb14149a89a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET /node/694bd03dc19e09af58d47b6c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET /node/6949eb1b2060d3d84791d81d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59438 - "GET /node/6992d9f031166481c8dd4211%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET /node/6993d3a43e9ba49307713955%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37132 - "GET /node/692986f909677735f68af6ae%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET /node/69938262cebe99dd8e06ecdf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50832 - "GET /node/695142e655ab4e5dcfcc083e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET /node/692982fc09677735f68af280%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47650 - "GET /node/698625eb177ca0f097bd1f7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET /node/69b218e9b0f5558b5d7cd216%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37760 - "GET /node/6991865410b45da7d7d0fd50%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET /node/6984614a3a8748f282086534%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58164 - "GET /node/693fb0090d8ce4018da9c0da%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK 2026-04-07 05:27:22,306 - lava_callback - INFO - Received callback for node 69d454738fbbb5910331ff0d INFO: 172.21.0.1:59156 - "POST /node/69d454738fbbb5910331ff0d HTTP/1.0" 202 Accepted 2026-04-07 05:27:22,313 - lava_callback - INFO - Starting async job submit for node 69d454738fbbb5910331ff0d 2026-04-07 05:27:22,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:22,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454738fbbb5910331ff0d HTTP/1.1" 200 None 2026-04-07 05:27:22,354 - lava_callback - DEBUG - Processing node 69d454738fbbb5910331ff0d: baseline-arm64 2026-04-07 05:27:22,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:23,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:23,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454738fbbb5910331ff0d/log.txt.gz 2026-04-07 05:27:23,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:23,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:23,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454738fbbb5910331ff0d/lava-logs.yaml 2026-04-07 05:27:23,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:23,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:23,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d454738fbbb5910331ff0d/lava_callback.json.gz 2026-04-07 05:27:23,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:23,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454738fbbb5910331ff0d HTTP/1.1" 200 None 2026-04-07 05:27:23,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:23,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 05:27:23,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:23,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454738fbbb5910331ff0d HTTP/1.1" 200 None 2026-04-07 05:27:23,892 - lava_callback - INFO - Completed processing callback for node 69d454738fbbb5910331ff0d INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK 2026-04-07 05:27:28,107 - lava_callback - INFO - Received callback for node 69d454848fbbb5910331ff44 INFO: 172.21.0.1:59164 - "POST /node/69d454848fbbb5910331ff44 HTTP/1.0" 202 Accepted 2026-04-07 05:27:28,114 - lava_callback - INFO - Starting async job submit for node 69d454848fbbb5910331ff44 2026-04-07 05:27:28,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:28,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454848fbbb5910331ff44 HTTP/1.1" 200 None 2026-04-07 05:27:28,155 - lava_callback - DEBUG - Processing node 69d454848fbbb5910331ff44: baseline-nfs-arm64 2026-04-07 05:27:28,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:28,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:28,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454848fbbb5910331ff44/log.txt.gz 2026-04-07 05:27:29,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:29,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:29,386 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454848fbbb5910331ff44/lava-logs.yaml 2026-04-07 05:27:29,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-07 05:27:29,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-07 05:27:29,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d454848fbbb5910331ff44/lava_callback.json.gz 2026-04-07 05:27:29,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:29,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d454848fbbb5910331ff44 HTTP/1.1" 200 None 2026-04-07 05:27:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d44d6a8fbbb5910331f9a6 HTTP/1.1" 200 None 2026-04-07 05:27:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d454848fbbb5910331ff44 HTTP/1.1" 200 None 2026-04-07 05:27:29,731 - lava_callback - INFO - Completed processing callback for node 69d454848fbbb5910331ff44 INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK 2026-04-07 05:27:50,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 05:27:50,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET /node/698717ea6e077e4126a7f110%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET /node/6985d90971989fb14149a88c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51926 - "GET /node/69af6c18275c8d3b7939a58b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET /node/6941898decc59770562e6ec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40962 - "GET /node/6987bee9e31b58f834f1cc38%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET /node/6985ea5771989fb14149cb82%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:37:26,455 - lava_callback - INFO - Received callback for node 69d2031caa48d6fae7bb2a42 INFO: 172.21.0.1:57826 - "POST /node/69d2031caa48d6fae7bb2a42 HTTP/1.0" 202 Accepted 2026-04-07 06:37:26,461 - lava_callback - INFO - Starting async job submit for node 69d2031caa48d6fae7bb2a42 2026-04-07 06:37:26,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:37:26,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2031caa48d6fae7bb2a42 HTTP/1.1" 200 None 2026-04-07 06:37:26,477 - lava_callback - DEBUG - Processing node 69d2031caa48d6fae7bb2a42: baseline-arm-baylibre 2026-04-07 06:37:26,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2031caa48d6fae7bb2a42 2026-04-07 06:37:26,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:37:26,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2031caa48d6fae7bb2a42 HTTP/1.1" 200 None 2026-04-07 06:37:26,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:37:26,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:37:26,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:37:26,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2031caa48d6fae7bb2a42 HTTP/1.1" 200 None 2026-04-07 06:37:26,558 - lava_callback - ERROR - Error processing callback for node 69d2031caa48d6fae7bb2a42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:38:06,402 - lava_callback - INFO - Received callback for node 69d2033baa48d6fae7bb2a50 INFO: 172.21.0.1:48560 - "POST /node/69d2033baa48d6fae7bb2a50 HTTP/1.0" 202 Accepted 2026-04-07 06:38:06,408 - lava_callback - INFO - Starting async job submit for node 69d2033baa48d6fae7bb2a50 2026-04-07 06:38:06,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:06,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2033baa48d6fae7bb2a50 HTTP/1.1" 200 None 2026-04-07 06:38:06,427 - lava_callback - DEBUG - Processing node 69d2033baa48d6fae7bb2a50: baseline-arm-baylibre 2026-04-07 06:38:06,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2033baa48d6fae7bb2a50 2026-04-07 06:38:06,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:06,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2033baa48d6fae7bb2a50 HTTP/1.1" 200 None 2026-04-07 06:38:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:06,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:38:06,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:06,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2033baa48d6fae7bb2a50 HTTP/1.1" 200 None 2026-04-07 06:38:06,513 - lava_callback - ERROR - Error processing callback for node 69d2033baa48d6fae7bb2a50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:38:26,392 - lava_callback - INFO - Received callback for node 69d20359aa48d6fae7bb2a84 INFO: 172.21.0.1:52932 - "POST /node/69d20359aa48d6fae7bb2a84 HTTP/1.0" 202 Accepted 2026-04-07 06:38:26,398 - lava_callback - INFO - Starting async job submit for node 69d20359aa48d6fae7bb2a84 2026-04-07 06:38:26,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:26,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20359aa48d6fae7bb2a84 HTTP/1.1" 200 None 2026-04-07 06:38:26,413 - lava_callback - DEBUG - Processing node 69d20359aa48d6fae7bb2a84: baseline-arm-baylibre 2026-04-07 06:38:26,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20359aa48d6fae7bb2a84 2026-04-07 06:38:26,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:26,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20359aa48d6fae7bb2a84 HTTP/1.1" 200 None 2026-04-07 06:38:26,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:26,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:38:26,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:38:26,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20359aa48d6fae7bb2a84 HTTP/1.1" 200 None 2026-04-07 06:38:26,470 - lava_callback - ERROR - Error processing callback for node 69d20359aa48d6fae7bb2a84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:39:01,634 - lava_callback - INFO - Received callback for node 69d2037daa48d6fae7bb2aa5 INFO: 172.21.0.1:53236 - "POST /node/69d2037daa48d6fae7bb2aa5 HTTP/1.0" 202 Accepted 2026-04-07 06:39:01,640 - lava_callback - INFO - Starting async job submit for node 69d2037daa48d6fae7bb2aa5 2026-04-07 06:39:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:01,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2037daa48d6fae7bb2aa5 HTTP/1.1" 200 None 2026-04-07 06:39:01,661 - lava_callback - DEBUG - Processing node 69d2037daa48d6fae7bb2aa5: baseline-arm-clabbe 2026-04-07 06:39:01,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2037daa48d6fae7bb2aa5 2026-04-07 06:39:01,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:01,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2037daa48d6fae7bb2aa5 HTTP/1.1" 200 None 2026-04-07 06:39:01,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:01,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:39:01,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:01,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2037daa48d6fae7bb2aa5 HTTP/1.1" 200 None 2026-04-07 06:39:01,721 - lava_callback - ERROR - Error processing callback for node 69d2037daa48d6fae7bb2aa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:39:26,492 - lava_callback - INFO - Received callback for node 69d2039caa48d6fae7bb2ac3 INFO: 172.21.0.1:33750 - "POST /node/69d2039caa48d6fae7bb2ac3 HTTP/1.0" 202 Accepted 2026-04-07 06:39:26,498 - lava_callback - INFO - Starting async job submit for node 69d2039caa48d6fae7bb2ac3 2026-04-07 06:39:26,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:26,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2039caa48d6fae7bb2ac3 HTTP/1.1" 200 None 2026-04-07 06:39:26,518 - lava_callback - DEBUG - Processing node 69d2039caa48d6fae7bb2ac3: baseline-arm-baylibre 2026-04-07 06:39:26,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2039caa48d6fae7bb2ac3 2026-04-07 06:39:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:39:26,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2039caa48d6fae7bb2ac3 HTTP/1.1" 200 None 2026-04-07 06:39:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:26,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:39:26,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:39:26,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2039caa48d6fae7bb2ac3 HTTP/1.1" 200 None 2026-04-07 06:39:26,602 - lava_callback - ERROR - Error processing callback for node 69d2039caa48d6fae7bb2ac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:40:01,672 - lava_callback - INFO - Received callback for node 69d203baaa48d6fae7bb2b1a INFO: 172.21.0.1:41204 - "POST /node/69d203baaa48d6fae7bb2b1a HTTP/1.0" 202 Accepted 2026-04-07 06:40:01,678 - lava_callback - INFO - Starting async job submit for node 69d203baaa48d6fae7bb2b1a 2026-04-07 06:40:01,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:01,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203baaa48d6fae7bb2b1a HTTP/1.1" 200 None 2026-04-07 06:40:01,694 - lava_callback - DEBUG - Processing node 69d203baaa48d6fae7bb2b1a: baseline-arm-clabbe 2026-04-07 06:40:01,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d203baaa48d6fae7bb2b1a 2026-04-07 06:40:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:01,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203baaa48d6fae7bb2b1a HTTP/1.1" 200 None 2026-04-07 06:40:01,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:01,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:40:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:01,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d203baaa48d6fae7bb2b1a HTTP/1.1" 200 None 2026-04-07 06:40:01,755 - lava_callback - ERROR - Error processing callback for node 69d203baaa48d6fae7bb2b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:40:41,681 - lava_callback - INFO - Received callback for node 69d203daaa48d6fae7bb2b2a INFO: 172.21.0.1:39118 - "POST /node/69d203daaa48d6fae7bb2b2a HTTP/1.0" 202 Accepted 2026-04-07 06:40:41,686 - lava_callback - INFO - Starting async job submit for node 69d203daaa48d6fae7bb2b2a 2026-04-07 06:40:41,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:41,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203daaa48d6fae7bb2b2a HTTP/1.1" 200 None 2026-04-07 06:40:41,701 - lava_callback - DEBUG - Processing node 69d203daaa48d6fae7bb2b2a: baseline-arm-clabbe 2026-04-07 06:40:41,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d203daaa48d6fae7bb2b2a 2026-04-07 06:40:41,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:41,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203daaa48d6fae7bb2b2a HTTP/1.1" 200 None 2026-04-07 06:40:41,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:41,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:40:41,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:40:41,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d203daaa48d6fae7bb2b2a HTTP/1.1" 200 None 2026-04-07 06:40:41,759 - lava_callback - ERROR - Error processing callback for node 69d203daaa48d6fae7bb2b2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:41:06,561 - lava_callback - INFO - Received callback for node 69d203f5aa48d6fae7bb2b55 INFO: 172.21.0.1:42400 - "POST /node/69d203f5aa48d6fae7bb2b55 HTTP/1.0" 202 Accepted 2026-04-07 06:41:06,567 - lava_callback - INFO - Starting async job submit for node 69d203f5aa48d6fae7bb2b55 2026-04-07 06:41:06,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:06,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203f5aa48d6fae7bb2b55 HTTP/1.1" 200 None 2026-04-07 06:41:06,583 - lava_callback - DEBUG - Processing node 69d203f5aa48d6fae7bb2b55: baseline-arm-baylibre 2026-04-07 06:41:06,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d203f5aa48d6fae7bb2b55 2026-04-07 06:41:06,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:06,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d203f5aa48d6fae7bb2b55 HTTP/1.1" 200 None 2026-04-07 06:41:06,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:06,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:41:06,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:06,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d203f5aa48d6fae7bb2b55 HTTP/1.1" 200 None 2026-04-07 06:41:06,647 - lava_callback - ERROR - Error processing callback for node 69d203f5aa48d6fae7bb2b55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:41:41,731 - lava_callback - INFO - Received callback for node 69d20415aa48d6fae7bb2b8e INFO: 172.21.0.1:54644 - "POST /node/69d20415aa48d6fae7bb2b8e HTTP/1.0" 202 Accepted 2026-04-07 06:41:41,737 - lava_callback - INFO - Starting async job submit for node 69d20415aa48d6fae7bb2b8e 2026-04-07 06:41:41,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:41,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20415aa48d6fae7bb2b8e HTTP/1.1" 200 None 2026-04-07 06:41:41,757 - lava_callback - DEBUG - Processing node 69d20415aa48d6fae7bb2b8e: baseline-arm-clabbe 2026-04-07 06:41:41,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20415aa48d6fae7bb2b8e 2026-04-07 06:41:41,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:41,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20415aa48d6fae7bb2b8e HTTP/1.1" 200 None 2026-04-07 06:41:41,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:41,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:41:41,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:41:41,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20415aa48d6fae7bb2b8e HTTP/1.1" 200 None 2026-04-07 06:41:41,823 - lava_callback - ERROR - Error processing callback for node 69d20415aa48d6fae7bb2b8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:42:06,624 - lava_callback - INFO - Received callback for node 69d20433aa48d6fae7bb2be2 INFO: 172.21.0.1:34424 - "POST /node/69d20433aa48d6fae7bb2be2 HTTP/1.0" 202 Accepted 2026-04-07 06:42:06,630 - lava_callback - INFO - Starting async job submit for node 69d20433aa48d6fae7bb2be2 2026-04-07 06:42:06,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:42:06,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20433aa48d6fae7bb2be2 HTTP/1.1" 200 None 2026-04-07 06:42:06,646 - lava_callback - DEBUG - Processing node 69d20433aa48d6fae7bb2be2: baseline-arm-baylibre 2026-04-07 06:42:06,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20433aa48d6fae7bb2be2 2026-04-07 06:42:06,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:42:06,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20433aa48d6fae7bb2be2 HTTP/1.1" 200 None 2026-04-07 06:42:06,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:42:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:42:06,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:42:06,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20433aa48d6fae7bb2be2 HTTP/1.1" 200 None 2026-04-07 06:42:06,709 - lava_callback - ERROR - Error processing callback for node 69d20433aa48d6fae7bb2be2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:43:46,805 - lava_callback - INFO - Received callback for node 69d20499aa48d6fae7bb2c40 INFO: 172.21.0.1:54158 - "POST /node/69d20499aa48d6fae7bb2c40 HTTP/1.0" 202 Accepted 2026-04-07 06:43:46,811 - lava_callback - INFO - Starting async job submit for node 69d20499aa48d6fae7bb2c40 2026-04-07 06:43:46,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:43:46,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20499aa48d6fae7bb2c40 HTTP/1.1" 200 None 2026-04-07 06:43:46,827 - lava_callback - DEBUG - Processing node 69d20499aa48d6fae7bb2c40: baseline-arm-baylibre 2026-04-07 06:43:46,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20499aa48d6fae7bb2c40 2026-04-07 06:43:46,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:43:46,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20499aa48d6fae7bb2c40 HTTP/1.1" 200 None 2026-04-07 06:43:46,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:43:46,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:43:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:43:46,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20499aa48d6fae7bb2c40 HTTP/1.1" 200 None 2026-04-07 06:43:46,906 - lava_callback - ERROR - Error processing callback for node 69d20499aa48d6fae7bb2c40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:44:21,905 - lava_callback - INFO - Received callback for node 69d204b9aa48d6fae7bb2c69 INFO: 172.21.0.1:50628 - "POST /node/69d204b9aa48d6fae7bb2c69 HTTP/1.0" 202 Accepted 2026-04-07 06:44:21,911 - lava_callback - INFO - Starting async job submit for node 69d204b9aa48d6fae7bb2c69 2026-04-07 06:44:21,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:44:21,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204b9aa48d6fae7bb2c69 HTTP/1.1" 200 None 2026-04-07 06:44:21,929 - lava_callback - DEBUG - Processing node 69d204b9aa48d6fae7bb2c69: baseline-arm-clabbe 2026-04-07 06:44:21,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d204b9aa48d6fae7bb2c69 2026-04-07 06:44:21,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:44:21,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204b9aa48d6fae7bb2c69 HTTP/1.1" 200 None 2026-04-07 06:44:21,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:44:21,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:44:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:44:21,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d204b9aa48d6fae7bb2c69 HTTP/1.1" 200 None 2026-04-07 06:44:21,989 - lava_callback - ERROR - Error processing callback for node 69d204b9aa48d6fae7bb2c69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:45:01,849 - lava_callback - INFO - Received callback for node 69d204dbaa48d6fae7bb2c88 INFO: 172.21.0.1:32768 - "POST /node/69d204dbaa48d6fae7bb2c88 HTTP/1.0" 202 Accepted 2026-04-07 06:45:01,855 - lava_callback - INFO - Starting async job submit for node 69d204dbaa48d6fae7bb2c88 2026-04-07 06:45:01,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204dbaa48d6fae7bb2c88 HTTP/1.1" 200 None 2026-04-07 06:45:01,872 - lava_callback - DEBUG - Processing node 69d204dbaa48d6fae7bb2c88: baseline-arm-clabbe 2026-04-07 06:45:01,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d204dbaa48d6fae7bb2c88 2026-04-07 06:45:01,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:01,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204dbaa48d6fae7bb2c88 HTTP/1.1" 200 None 2026-04-07 06:45:01,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:01,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:45:01,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:01,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d204dbaa48d6fae7bb2c88 HTTP/1.1" 200 None 2026-04-07 06:45:01,931 - lava_callback - ERROR - Error processing callback for node 69d204dbaa48d6fae7bb2c88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:45:26,863 - lava_callback - INFO - Received callback for node 69d204faaa48d6fae7bb2c91 INFO: 172.21.0.1:50104 - "POST /node/69d204faaa48d6fae7bb2c91 HTTP/1.0" 202 Accepted 2026-04-07 06:45:26,869 - lava_callback - INFO - Starting async job submit for node 69d204faaa48d6fae7bb2c91 2026-04-07 06:45:26,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:26,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204faaa48d6fae7bb2c91 HTTP/1.1" 200 None 2026-04-07 06:45:26,886 - lava_callback - DEBUG - Processing node 69d204faaa48d6fae7bb2c91: baseline-arm-baylibre 2026-04-07 06:45:26,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d204faaa48d6fae7bb2c91 2026-04-07 06:45:26,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:26,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d204faaa48d6fae7bb2c91 HTTP/1.1" 200 None 2026-04-07 06:45:26,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:26,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:45:26,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:26,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d204faaa48d6fae7bb2c91 HTTP/1.1" 200 None 2026-04-07 06:45:26,950 - lava_callback - ERROR - Error processing callback for node 69d204faaa48d6fae7bb2c91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:45:46,825 - lava_callback - INFO - Received callback for node 69d20519aa48d6fae7bb2caa INFO: 172.21.0.1:58916 - "POST /node/69d20519aa48d6fae7bb2caa HTTP/1.0" 202 Accepted 2026-04-07 06:45:46,831 - lava_callback - INFO - Starting async job submit for node 69d20519aa48d6fae7bb2caa 2026-04-07 06:45:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:46,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20519aa48d6fae7bb2caa HTTP/1.1" 200 None 2026-04-07 06:45:46,849 - lava_callback - DEBUG - Processing node 69d20519aa48d6fae7bb2caa: baseline-arm-baylibre 2026-04-07 06:45:46,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20519aa48d6fae7bb2caa 2026-04-07 06:45:46,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:46,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20519aa48d6fae7bb2caa HTTP/1.1" 200 None 2026-04-07 06:45:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:46,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:45:46,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:45:46,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20519aa48d6fae7bb2caa HTTP/1.1" 200 None 2026-04-07 06:45:46,921 - lava_callback - ERROR - Error processing callback for node 69d20519aa48d6fae7bb2caa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:46:26,854 - lava_callback - INFO - Received callback for node 69d2053aaa48d6fae7bb2ccf INFO: 172.21.0.1:57080 - "POST /node/69d2053aaa48d6fae7bb2ccf HTTP/1.0" 202 Accepted 2026-04-07 06:46:26,859 - lava_callback - INFO - Starting async job submit for node 69d2053aaa48d6fae7bb2ccf 2026-04-07 06:46:26,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:46:26,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2053aaa48d6fae7bb2ccf HTTP/1.1" 200 None 2026-04-07 06:46:26,880 - lava_callback - DEBUG - Processing node 69d2053aaa48d6fae7bb2ccf: baseline-arm-baylibre 2026-04-07 06:46:26,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2053aaa48d6fae7bb2ccf 2026-04-07 06:46:26,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:46:26,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2053aaa48d6fae7bb2ccf HTTP/1.1" 200 None 2026-04-07 06:46:26,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:46:26,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:46:26,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:46:26,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2053aaa48d6fae7bb2ccf HTTP/1.1" 200 None 2026-04-07 06:46:26,945 - lava_callback - ERROR - Error processing callback for node 69d2053aaa48d6fae7bb2ccf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:47:06,958 - lava_callback - INFO - Received callback for node 69d2055daa48d6fae7bb2cf3 INFO: 172.21.0.1:49292 - "POST /node/69d2055daa48d6fae7bb2cf3 HTTP/1.0" 202 Accepted 2026-04-07 06:47:06,964 - lava_callback - INFO - Starting async job submit for node 69d2055daa48d6fae7bb2cf3 2026-04-07 06:47:06,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:06,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2055daa48d6fae7bb2cf3 HTTP/1.1" 200 None 2026-04-07 06:47:06,980 - lava_callback - DEBUG - Processing node 69d2055daa48d6fae7bb2cf3: baseline-arm-baylibre 2026-04-07 06:47:06,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2055daa48d6fae7bb2cf3 2026-04-07 06:47:06,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:06,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2055daa48d6fae7bb2cf3 HTTP/1.1" 200 None 2026-04-07 06:47:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:07,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:47:07,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2055daa48d6fae7bb2cf3 HTTP/1.1" 200 None 2026-04-07 06:47:07,057 - lava_callback - ERROR - Error processing callback for node 69d2055daa48d6fae7bb2cf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:47:46,938 - lava_callback - INFO - Received callback for node 69d20581aa48d6fae7bb2d14 INFO: 172.21.0.1:45376 - "POST /node/69d20581aa48d6fae7bb2d14 HTTP/1.0" 202 Accepted 2026-04-07 06:47:46,944 - lava_callback - INFO - Starting async job submit for node 69d20581aa48d6fae7bb2d14 2026-04-07 06:47:46,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:46,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20581aa48d6fae7bb2d14 HTTP/1.1" 200 None 2026-04-07 06:47:46,961 - lava_callback - DEBUG - Processing node 69d20581aa48d6fae7bb2d14: baseline-arm-baylibre 2026-04-07 06:47:46,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20581aa48d6fae7bb2d14 2026-04-07 06:47:46,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:46,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20581aa48d6fae7bb2d14 HTTP/1.1" 200 None 2026-04-07 06:47:46,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:46,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:47:47,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:47:47,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20581aa48d6fae7bb2d14 HTTP/1.1" 200 None 2026-04-07 06:47:47,029 - lava_callback - ERROR - Error processing callback for node 69d20581aa48d6fae7bb2d14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:48:06,971 - lava_callback - INFO - Received callback for node 69d205a0aa48d6fae7bb2d3c INFO: 172.21.0.1:52726 - "POST /node/69d205a0aa48d6fae7bb2d3c HTTP/1.0" 202 Accepted 2026-04-07 06:48:06,977 - lava_callback - INFO - Starting async job submit for node 69d205a0aa48d6fae7bb2d3c 2026-04-07 06:48:06,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:48:06,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d205a0aa48d6fae7bb2d3c HTTP/1.1" 200 None 2026-04-07 06:48:06,993 - lava_callback - DEBUG - Processing node 69d205a0aa48d6fae7bb2d3c: baseline-arm-baylibre 2026-04-07 06:48:06,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d205a0aa48d6fae7bb2d3c 2026-04-07 06:48:06,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:48:07,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d205a0aa48d6fae7bb2d3c HTTP/1.1" 200 None 2026-04-07 06:48:07,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:48:07,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:48:07,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:48:07,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d205a0aa48d6fae7bb2d3c HTTP/1.1" 200 None 2026-04-07 06:48:07,064 - lava_callback - ERROR - Error processing callback for node 69d205a0aa48d6fae7bb2d3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:49:42,073 - lava_callback - INFO - Received callback for node 69d20602aa48d6fae7bb2d9e INFO: 172.21.0.1:38306 - "POST /node/69d20602aa48d6fae7bb2d9e HTTP/1.0" 202 Accepted 2026-04-07 06:49:42,079 - lava_callback - INFO - Starting async job submit for node 69d20602aa48d6fae7bb2d9e 2026-04-07 06:49:42,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:49:42,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20602aa48d6fae7bb2d9e HTTP/1.1" 200 None 2026-04-07 06:49:42,096 - lava_callback - DEBUG - Processing node 69d20602aa48d6fae7bb2d9e: baseline-arm-clabbe 2026-04-07 06:49:42,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20602aa48d6fae7bb2d9e 2026-04-07 06:49:42,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:49:42,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20602aa48d6fae7bb2d9e HTTP/1.1" 200 None 2026-04-07 06:49:42,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:49:42,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:49:42,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:49:42,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20602aa48d6fae7bb2d9e HTTP/1.1" 200 None 2026-04-07 06:49:42,159 - lava_callback - ERROR - Error processing callback for node 69d20602aa48d6fae7bb2d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:50:22,053 - lava_callback - INFO - Received callback for node 69d20625aa48d6fae7bb2da9 INFO: 172.21.0.1:43044 - "POST /node/69d20625aa48d6fae7bb2da9 HTTP/1.0" 202 Accepted 2026-04-07 06:50:22,058 - lava_callback - INFO - Starting async job submit for node 69d20625aa48d6fae7bb2da9 2026-04-07 06:50:22,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:50:22,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20625aa48d6fae7bb2da9 HTTP/1.1" 200 None 2026-04-07 06:50:22,076 - lava_callback - DEBUG - Processing node 69d20625aa48d6fae7bb2da9: baseline-arm-clabbe 2026-04-07 06:50:22,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20625aa48d6fae7bb2da9 2026-04-07 06:50:22,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:50:22,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20625aa48d6fae7bb2da9 HTTP/1.1" 200 None 2026-04-07 06:50:22,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:50:22,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:50:22,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:50:22,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20625aa48d6fae7bb2da9 HTTP/1.1" 200 None 2026-04-07 06:50:22,142 - lava_callback - ERROR - Error processing callback for node 69d20625aa48d6fae7bb2da9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:51:02,132 - lava_callback - INFO - Received callback for node 69d20647aa48d6fae7bb2dcb INFO: 172.21.0.1:52346 - "POST /node/69d20647aa48d6fae7bb2dcb HTTP/1.0" 202 Accepted 2026-04-07 06:51:02,138 - lava_callback - INFO - Starting async job submit for node 69d20647aa48d6fae7bb2dcb 2026-04-07 06:51:02,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20647aa48d6fae7bb2dcb HTTP/1.1" 200 None 2026-04-07 06:51:02,161 - lava_callback - DEBUG - Processing node 69d20647aa48d6fae7bb2dcb: baseline-arm-clabbe 2026-04-07 06:51:02,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20647aa48d6fae7bb2dcb 2026-04-07 06:51:02,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:02,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20647aa48d6fae7bb2dcb HTTP/1.1" 200 None 2026-04-07 06:51:02,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:02,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:51:02,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:02,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20647aa48d6fae7bb2dcb HTTP/1.1" 200 None 2026-04-07 06:51:02,228 - lava_callback - ERROR - Error processing callback for node 69d20647aa48d6fae7bb2dcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:51:22,125 - lava_callback - INFO - Received callback for node 69d20667aa48d6fae7bb2de4 INFO: 172.21.0.1:52104 - "POST /node/69d20667aa48d6fae7bb2de4 HTTP/1.0" 202 Accepted 2026-04-07 06:51:22,131 - lava_callback - INFO - Starting async job submit for node 69d20667aa48d6fae7bb2de4 2026-04-07 06:51:22,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20667aa48d6fae7bb2de4 HTTP/1.1" 200 None 2026-04-07 06:51:22,148 - lava_callback - DEBUG - Processing node 69d20667aa48d6fae7bb2de4: baseline-arm-clabbe 2026-04-07 06:51:22,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20667aa48d6fae7bb2de4 2026-04-07 06:51:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:22,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20667aa48d6fae7bb2de4 HTTP/1.1" 200 None 2026-04-07 06:51:22,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:51:22,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:51:22,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20667aa48d6fae7bb2de4 HTTP/1.1" 200 None 2026-04-07 06:51:22,205 - lava_callback - ERROR - Error processing callback for node 69d20667aa48d6fae7bb2de4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:52:02,130 - lava_callback - INFO - Received callback for node 69d20688aa48d6fae7bb2e06 INFO: 172.21.0.1:53626 - "POST /node/69d20688aa48d6fae7bb2e06 HTTP/1.0" 202 Accepted 2026-04-07 06:52:02,136 - lava_callback - INFO - Starting async job submit for node 69d20688aa48d6fae7bb2e06 2026-04-07 06:52:02,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:02,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20688aa48d6fae7bb2e06 HTTP/1.1" 200 None 2026-04-07 06:52:02,151 - lava_callback - DEBUG - Processing node 69d20688aa48d6fae7bb2e06: baseline-arm-clabbe 2026-04-07 06:52:02,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20688aa48d6fae7bb2e06 2026-04-07 06:52:02,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:02,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20688aa48d6fae7bb2e06 HTTP/1.1" 200 None 2026-04-07 06:52:02,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:02,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:52:02,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:02,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20688aa48d6fae7bb2e06 HTTP/1.1" 200 None 2026-04-07 06:52:02,213 - lava_callback - ERROR - Error processing callback for node 69d20688aa48d6fae7bb2e06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:52:42,166 - lava_callback - INFO - Received callback for node 69d206a6aa48d6fae7bb2e22 INFO: 172.21.0.1:34160 - "POST /node/69d206a6aa48d6fae7bb2e22 HTTP/1.0" 202 Accepted 2026-04-07 06:52:42,172 - lava_callback - INFO - Starting async job submit for node 69d206a6aa48d6fae7bb2e22 2026-04-07 06:52:42,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206a6aa48d6fae7bb2e22 HTTP/1.1" 200 None 2026-04-07 06:52:42,188 - lava_callback - DEBUG - Processing node 69d206a6aa48d6fae7bb2e22: baseline-arm-clabbe 2026-04-07 06:52:42,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d206a6aa48d6fae7bb2e22 2026-04-07 06:52:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:42,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206a6aa48d6fae7bb2e22 HTTP/1.1" 200 None 2026-04-07 06:52:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:42,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:52:42,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:52:42,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d206a6aa48d6fae7bb2e22 HTTP/1.1" 200 None 2026-04-07 06:52:42,250 - lava_callback - ERROR - Error processing callback for node 69d206a6aa48d6fae7bb2e22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:53:02,176 - lava_callback - INFO - Received callback for node 69d206c8aa48d6fae7bb2e4c INFO: 172.21.0.1:41512 - "POST /node/69d206c8aa48d6fae7bb2e4c HTTP/1.0" 202 Accepted 2026-04-07 06:53:02,181 - lava_callback - INFO - Starting async job submit for node 69d206c8aa48d6fae7bb2e4c 2026-04-07 06:53:02,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:02,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206c8aa48d6fae7bb2e4c HTTP/1.1" 200 None 2026-04-07 06:53:02,197 - lava_callback - DEBUG - Processing node 69d206c8aa48d6fae7bb2e4c: baseline-arm-clabbe 2026-04-07 06:53:02,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d206c8aa48d6fae7bb2e4c 2026-04-07 06:53:02,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:02,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206c8aa48d6fae7bb2e4c HTTP/1.1" 200 None 2026-04-07 06:53:02,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:02,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:53:02,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:02,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d206c8aa48d6fae7bb2e4c HTTP/1.1" 200 None 2026-04-07 06:53:02,265 - lava_callback - ERROR - Error processing callback for node 69d206c8aa48d6fae7bb2e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:53:42,185 - lava_callback - INFO - Received callback for node 69d206e8aa48d6fae7bb2e66 INFO: 172.21.0.1:43154 - "POST /node/69d206e8aa48d6fae7bb2e66 HTTP/1.0" 202 Accepted 2026-04-07 06:53:42,191 - lava_callback - INFO - Starting async job submit for node 69d206e8aa48d6fae7bb2e66 2026-04-07 06:53:42,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:42,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206e8aa48d6fae7bb2e66 HTTP/1.1" 200 None 2026-04-07 06:53:42,212 - lava_callback - DEBUG - Processing node 69d206e8aa48d6fae7bb2e66: baseline-arm-clabbe 2026-04-07 06:53:42,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d206e8aa48d6fae7bb2e66 2026-04-07 06:53:42,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d206e8aa48d6fae7bb2e66 HTTP/1.1" 200 None 2026-04-07 06:53:42,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:42,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 06:53:42,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:53:42,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d206e8aa48d6fae7bb2e66 HTTP/1.1" 200 None 2026-04-07 06:53:42,284 - lava_callback - ERROR - Error processing callback for node 69d206e8aa48d6fae7bb2e66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:54:22,283 - lava_callback - INFO - Received callback for node 69d2070baa48d6fae7bb2e9e INFO: 172.21.0.1:34032 - "POST /node/69d2070baa48d6fae7bb2e9e HTTP/1.0" 202 Accepted 2026-04-07 06:54:22,289 - lava_callback - INFO - Starting async job submit for node 69d2070baa48d6fae7bb2e9e 2026-04-07 06:54:22,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:22,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2070baa48d6fae7bb2e9e HTTP/1.1" 200 None 2026-04-07 06:54:22,303 - lava_callback - DEBUG - Processing node 69d2070baa48d6fae7bb2e9e: baseline-arm-clabbe 2026-04-07 06:54:22,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2070baa48d6fae7bb2e9e 2026-04-07 06:54:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:22,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2070baa48d6fae7bb2e9e HTTP/1.1" 200 None 2026-04-07 06:54:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:22,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:54:22,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:22,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2070baa48d6fae7bb2e9e HTTP/1.1" 200 None 2026-04-07 06:54:22,366 - lava_callback - ERROR - Error processing callback for node 69d2070baa48d6fae7bb2e9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:54:42,238 - lava_callback - INFO - Received callback for node 69d2072daa48d6fae7bb2ece INFO: 172.21.0.1:49422 - "POST /node/69d2072daa48d6fae7bb2ece HTTP/1.0" 202 Accepted 2026-04-07 06:54:42,244 - lava_callback - INFO - Starting async job submit for node 69d2072daa48d6fae7bb2ece 2026-04-07 06:54:42,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:42,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2072daa48d6fae7bb2ece HTTP/1.1" 200 None 2026-04-07 06:54:42,261 - lava_callback - DEBUG - Processing node 69d2072daa48d6fae7bb2ece: baseline-arm-clabbe 2026-04-07 06:54:42,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2072daa48d6fae7bb2ece 2026-04-07 06:54:42,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:42,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2072daa48d6fae7bb2ece HTTP/1.1" 200 None 2026-04-07 06:54:42,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:42,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:54:42,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:54:42,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2072daa48d6fae7bb2ece HTTP/1.1" 200 None 2026-04-07 06:54:42,322 - lava_callback - ERROR - Error processing callback for node 69d2072daa48d6fae7bb2ece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:56:22,332 - lava_callback - INFO - Received callback for node 69d20790aa48d6fae7bb2efb INFO: 172.21.0.1:50668 - "POST /node/69d20790aa48d6fae7bb2efb HTTP/1.0" 202 Accepted 2026-04-07 06:56:22,338 - lava_callback - INFO - Starting async job submit for node 69d20790aa48d6fae7bb2efb 2026-04-07 06:56:22,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:56:22,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20790aa48d6fae7bb2efb HTTP/1.1" 200 None 2026-04-07 06:56:22,374 - lava_callback - DEBUG - Processing node 69d20790aa48d6fae7bb2efb: baseline-arm-clabbe 2026-04-07 06:56:22,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20790aa48d6fae7bb2efb 2026-04-07 06:56:22,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:56:22,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20790aa48d6fae7bb2efb HTTP/1.1" 200 None 2026-04-07 06:56:22,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:56:22,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:56:22,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:56:22,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20790aa48d6fae7bb2efb HTTP/1.1" 200 None 2026-04-07 06:56:22,438 - lava_callback - ERROR - Error processing callback for node 69d20790aa48d6fae7bb2efb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:57:02,353 - lava_callback - INFO - Received callback for node 69d207b0aa48d6fae7bb2f0b INFO: 172.21.0.1:42192 - "POST /node/69d207b0aa48d6fae7bb2f0b HTTP/1.0" 202 Accepted 2026-04-07 06:57:02,359 - lava_callback - INFO - Starting async job submit for node 69d207b0aa48d6fae7bb2f0b 2026-04-07 06:57:02,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:02,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207b0aa48d6fae7bb2f0b HTTP/1.1" 200 None 2026-04-07 06:57:02,375 - lava_callback - DEBUG - Processing node 69d207b0aa48d6fae7bb2f0b: baseline-arm-clabbe 2026-04-07 06:57:02,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d207b0aa48d6fae7bb2f0b 2026-04-07 06:57:02,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:02,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207b0aa48d6fae7bb2f0b HTTP/1.1" 200 None 2026-04-07 06:57:02,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:02,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:57:02,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d207b0aa48d6fae7bb2f0b HTTP/1.1" 200 None 2026-04-07 06:57:02,449 - lava_callback - ERROR - Error processing callback for node 69d207b0aa48d6fae7bb2f0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:57:22,401 - lava_callback - INFO - Received callback for node 69d207cfaa48d6fae7bb2f3d INFO: 172.21.0.1:43502 - "POST /node/69d207cfaa48d6fae7bb2f3d HTTP/1.0" 202 Accepted 2026-04-07 06:57:22,406 - lava_callback - INFO - Starting async job submit for node 69d207cfaa48d6fae7bb2f3d 2026-04-07 06:57:22,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:22,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207cfaa48d6fae7bb2f3d HTTP/1.1" 200 None 2026-04-07 06:57:22,423 - lava_callback - DEBUG - Processing node 69d207cfaa48d6fae7bb2f3d: baseline-arm-clabbe 2026-04-07 06:57:22,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d207cfaa48d6fae7bb2f3d 2026-04-07 06:57:22,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207cfaa48d6fae7bb2f3d HTTP/1.1" 200 None 2026-04-07 06:57:22,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:22,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:57:22,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:57:22,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d207cfaa48d6fae7bb2f3d HTTP/1.1" 200 None 2026-04-07 06:57:22,485 - lava_callback - ERROR - Error processing callback for node 69d207cfaa48d6fae7bb2f3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:58:02,373 - lava_callback - INFO - Received callback for node 69d207f1aa48d6fae7bb2f5c INFO: 172.21.0.1:32952 - "POST /node/69d207f1aa48d6fae7bb2f5c HTTP/1.0" 202 Accepted 2026-04-07 06:58:02,379 - lava_callback - INFO - Starting async job submit for node 69d207f1aa48d6fae7bb2f5c 2026-04-07 06:58:02,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:02,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207f1aa48d6fae7bb2f5c HTTP/1.1" 200 None 2026-04-07 06:58:02,395 - lava_callback - DEBUG - Processing node 69d207f1aa48d6fae7bb2f5c: baseline-arm-clabbe 2026-04-07 06:58:02,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d207f1aa48d6fae7bb2f5c 2026-04-07 06:58:02,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:02,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d207f1aa48d6fae7bb2f5c HTTP/1.1" 200 None 2026-04-07 06:58:02,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:02,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:58:02,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d207f1aa48d6fae7bb2f5c HTTP/1.1" 200 None 2026-04-07 06:58:02,453 - lava_callback - ERROR - Error processing callback for node 69d207f1aa48d6fae7bb2f5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:58:42,429 - lava_callback - INFO - Received callback for node 69d20813aa48d6fae7bb2f6f INFO: 172.21.0.1:46032 - "POST /node/69d20813aa48d6fae7bb2f6f HTTP/1.0" 202 Accepted 2026-04-07 06:58:42,435 - lava_callback - INFO - Starting async job submit for node 69d20813aa48d6fae7bb2f6f 2026-04-07 06:58:42,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:42,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20813aa48d6fae7bb2f6f HTTP/1.1" 200 None 2026-04-07 06:58:42,452 - lava_callback - DEBUG - Processing node 69d20813aa48d6fae7bb2f6f: baseline-arm-clabbe 2026-04-07 06:58:42,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20813aa48d6fae7bb2f6f 2026-04-07 06:58:42,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:42,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20813aa48d6fae7bb2f6f HTTP/1.1" 200 None 2026-04-07 06:58:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:58:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:58:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20813aa48d6fae7bb2f6f HTTP/1.1" 200 None 2026-04-07 06:58:42,504 - lava_callback - ERROR - Error processing callback for node 69d20813aa48d6fae7bb2f6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:59:02,432 - lava_callback - INFO - Received callback for node 69d20832aa48d6fae7bb2f81 INFO: 172.21.0.1:58056 - "POST /node/69d20832aa48d6fae7bb2f81 HTTP/1.0" 202 Accepted 2026-04-07 06:59:02,440 - lava_callback - INFO - Starting async job submit for node 69d20832aa48d6fae7bb2f81 2026-04-07 06:59:02,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:02,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20832aa48d6fae7bb2f81 HTTP/1.1" 200 None 2026-04-07 06:59:02,473 - lava_callback - DEBUG - Processing node 69d20832aa48d6fae7bb2f81: baseline-arm-clabbe 2026-04-07 06:59:02,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20832aa48d6fae7bb2f81 2026-04-07 06:59:02,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:02,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20832aa48d6fae7bb2f81 HTTP/1.1" 200 None 2026-04-07 06:59:02,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:02,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:59:02,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:02,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20832aa48d6fae7bb2f81 HTTP/1.1" 200 None 2026-04-07 06:59:02,556 - lava_callback - ERROR - Error processing callback for node 69d20832aa48d6fae7bb2f81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-04-07 06:59:42,498 - lava_callback - INFO - Received callback for node 69d20850aa48d6fae7bb2fac INFO: 172.21.0.1:47606 - "POST /node/69d20850aa48d6fae7bb2fac HTTP/1.0" 202 Accepted 2026-04-07 06:59:42,504 - lava_callback - INFO - Starting async job submit for node 69d20850aa48d6fae7bb2fac 2026-04-07 06:59:42,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:42,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20850aa48d6fae7bb2fac HTTP/1.1" 200 None 2026-04-07 06:59:42,519 - lava_callback - DEBUG - Processing node 69d20850aa48d6fae7bb2fac: baseline-arm-clabbe 2026-04-07 06:59:42,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20850aa48d6fae7bb2fac 2026-04-07 06:59:42,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:42,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20850aa48d6fae7bb2fac HTTP/1.1" 200 None 2026-04-07 06:59:42,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:42,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 06:59:42,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 06:59:42,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20850aa48d6fae7bb2fac HTTP/1.1" 200 None 2026-04-07 06:59:42,594 - lava_callback - ERROR - Error processing callback for node 69d20850aa48d6fae7bb2fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:00:22,474 - lava_callback - INFO - Received callback for node 69d20874aa48d6fae7bb2fe2 INFO: 172.21.0.1:32872 - "POST /node/69d20874aa48d6fae7bb2fe2 HTTP/1.0" 202 Accepted 2026-04-07 07:00:22,480 - lava_callback - INFO - Starting async job submit for node 69d20874aa48d6fae7bb2fe2 2026-04-07 07:00:22,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:22,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20874aa48d6fae7bb2fe2 HTTP/1.1" 200 None 2026-04-07 07:00:22,502 - lava_callback - DEBUG - Processing node 69d20874aa48d6fae7bb2fe2: baseline-arm-clabbe 2026-04-07 07:00:22,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20874aa48d6fae7bb2fe2 2026-04-07 07:00:22,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:22,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20874aa48d6fae7bb2fe2 HTTP/1.1" 200 None 2026-04-07 07:00:22,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:22,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 07:00:22,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:22,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20874aa48d6fae7bb2fe2 HTTP/1.1" 200 None 2026-04-07 07:00:22,560 - lava_callback - ERROR - Error processing callback for node 69d20874aa48d6fae7bb2fe2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:00:42,548 - lava_callback - INFO - Received callback for node 69d20896aa48d6fae7bb2fff INFO: 172.21.0.1:56472 - "POST /node/69d20896aa48d6fae7bb2fff HTTP/1.0" 202 Accepted 2026-04-07 07:00:42,555 - lava_callback - INFO - Starting async job submit for node 69d20896aa48d6fae7bb2fff 2026-04-07 07:00:42,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20896aa48d6fae7bb2fff HTTP/1.1" 200 None 2026-04-07 07:00:42,571 - lava_callback - DEBUG - Processing node 69d20896aa48d6fae7bb2fff: baseline-arm-clabbe 2026-04-07 07:00:42,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20896aa48d6fae7bb2fff 2026-04-07 07:00:42,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:42,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20896aa48d6fae7bb2fff HTTP/1.1" 200 None 2026-04-07 07:00:42,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:42,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 07:00:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:00:42,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20896aa48d6fae7bb2fff HTTP/1.1" 200 None 2026-04-07 07:00:42,630 - lava_callback - ERROR - Error processing callback for node 69d20896aa48d6fae7bb2fff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:01:22,511 - lava_callback - INFO - Received callback for node 69d208b1aa48d6fae7bb303d INFO: 172.21.0.1:36582 - "POST /node/69d208b1aa48d6fae7bb303d HTTP/1.0" 202 Accepted 2026-04-07 07:01:22,520 - lava_callback - INFO - Starting async job submit for node 69d208b1aa48d6fae7bb303d 2026-04-07 07:01:22,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:01:22,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d208b1aa48d6fae7bb303d HTTP/1.1" 200 None 2026-04-07 07:01:22,541 - lava_callback - DEBUG - Processing node 69d208b1aa48d6fae7bb303d: baseline-arm-clabbe 2026-04-07 07:01:22,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d208b1aa48d6fae7bb303d 2026-04-07 07:01:22,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:01:22,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d208b1aa48d6fae7bb303d HTTP/1.1" 200 None 2026-04-07 07:01:22,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:01:22,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-07 07:01:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:01:22,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d208b1aa48d6fae7bb303d HTTP/1.1" 200 None 2026-04-07 07:01:22,625 - lava_callback - ERROR - Error processing callback for node 69d208b1aa48d6fae7bb303d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:02:02,577 - lava_callback - INFO - Received callback for node 69d208d5aa48d6fae7bb3057 INFO: 172.21.0.1:54900 - "POST /node/69d208d5aa48d6fae7bb3057 HTTP/1.0" 202 Accepted 2026-04-07 07:02:02,582 - lava_callback - INFO - Starting async job submit for node 69d208d5aa48d6fae7bb3057 2026-04-07 07:02:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:02:02,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d208d5aa48d6fae7bb3057 HTTP/1.1" 200 None 2026-04-07 07:02:02,600 - lava_callback - DEBUG - Processing node 69d208d5aa48d6fae7bb3057: baseline-arm-clabbe 2026-04-07 07:02:02,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d208d5aa48d6fae7bb3057 2026-04-07 07:02:02,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:02:02,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d208d5aa48d6fae7bb3057 HTTP/1.1" 200 None 2026-04-07 07:02:02,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:02:02,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-07 07:02:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:02:02,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d208d5aa48d6fae7bb3057 HTTP/1.1" 200 None 2026-04-07 07:02:02,658 - lava_callback - ERROR - Error processing callback for node 69d208d5aa48d6fae7bb3057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:06:48,074 - lava_callback - INFO - Received callback for node 69d209ffaa48d6fae7bb3142 INFO: 172.21.0.1:34134 - "POST /node/69d209ffaa48d6fae7bb3142 HTTP/1.0" 202 Accepted 2026-04-07 07:06:48,080 - lava_callback - INFO - Starting async job submit for node 69d209ffaa48d6fae7bb3142 2026-04-07 07:06:48,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:06:48,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d209ffaa48d6fae7bb3142 HTTP/1.1" 200 None 2026-04-07 07:06:48,095 - lava_callback - DEBUG - Processing node 69d209ffaa48d6fae7bb3142: baseline-arm-baylibre 2026-04-07 07:06:48,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d209ffaa48d6fae7bb3142 2026-04-07 07:06:48,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:06:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d209ffaa48d6fae7bb3142 HTTP/1.1" 200 None 2026-04-07 07:06:48,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:06:48,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:06:48,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:06:48,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d209ffaa48d6fae7bb3142 HTTP/1.1" 200 None 2026-04-07 07:06:48,151 - lava_callback - ERROR - Error processing callback for node 69d209ffaa48d6fae7bb3142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:07:27,914 - lava_callback - INFO - Received callback for node 69d20a26aa48d6fae7bb3169 INFO: 172.21.0.1:51170 - "POST /node/69d20a26aa48d6fae7bb3169 HTTP/1.0" 202 Accepted 2026-04-07 07:07:27,919 - lava_callback - INFO - Starting async job submit for node 69d20a26aa48d6fae7bb3169 2026-04-07 07:07:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:07:27,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20a26aa48d6fae7bb3169 HTTP/1.1" 200 None 2026-04-07 07:07:27,936 - lava_callback - DEBUG - Processing node 69d20a26aa48d6fae7bb3169: baseline-arm64-baylibre 2026-04-07 07:07:27,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20a26aa48d6fae7bb3169 2026-04-07 07:07:27,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:07:27,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20a26aa48d6fae7bb3169 HTTP/1.1" 200 None 2026-04-07 07:07:27,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:07:27,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:07:27,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:07:27,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20a26aa48d6fae7bb3169 HTTP/1.1" 200 None 2026-04-07 07:07:28,000 - lava_callback - ERROR - Error processing callback for node 69d20a26aa48d6fae7bb3169: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:08:48,049 - lava_callback - INFO - Received callback for node 69d20a6caa48d6fae7bb3185 INFO: 172.21.0.1:58934 - "POST /node/69d20a6caa48d6fae7bb3185 HTTP/1.0" 202 Accepted 2026-04-07 07:08:48,054 - lava_callback - INFO - Starting async job submit for node 69d20a6caa48d6fae7bb3185 2026-04-07 07:08:48,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:08:48,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20a6caa48d6fae7bb3185 HTTP/1.1" 200 None 2026-04-07 07:08:48,070 - lava_callback - DEBUG - Processing node 69d20a6caa48d6fae7bb3185: baseline-arm64-baylibre 2026-04-07 07:08:48,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20a6caa48d6fae7bb3185 2026-04-07 07:08:48,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:08:48,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20a6caa48d6fae7bb3185 HTTP/1.1" 200 None 2026-04-07 07:08:48,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:08:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:08:48,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:08:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20a6caa48d6fae7bb3185 HTTP/1.1" 200 None 2026-04-07 07:08:48,135 - lava_callback - ERROR - Error processing callback for node 69d20a6caa48d6fae7bb3185: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:09:48,098 - lava_callback - INFO - Received callback for node 69d20ab3aa48d6fae7bb31b3 INFO: 172.21.0.1:54512 - "POST /node/69d20ab3aa48d6fae7bb31b3 HTTP/1.0" 202 Accepted 2026-04-07 07:09:48,104 - lava_callback - INFO - Starting async job submit for node 69d20ab3aa48d6fae7bb31b3 2026-04-07 07:09:48,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:09:48,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ab3aa48d6fae7bb31b3 HTTP/1.1" 200 None 2026-04-07 07:09:48,119 - lava_callback - DEBUG - Processing node 69d20ab3aa48d6fae7bb31b3: baseline-arm64-baylibre 2026-04-07 07:09:48,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20ab3aa48d6fae7bb31b3 2026-04-07 07:09:48,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:09:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ab3aa48d6fae7bb31b3 HTTP/1.1" 200 None 2026-04-07 07:09:48,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:09:48,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:09:48,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:09:48,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20ab3aa48d6fae7bb31b3 HTTP/1.1" 200 None 2026-04-07 07:09:48,191 - lava_callback - ERROR - Error processing callback for node 69d20ab3aa48d6fae7bb31b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:11:08,223 - lava_callback - INFO - Received callback for node 69d20af9aa48d6fae7bb31db INFO: 172.21.0.1:43860 - "POST /node/69d20af9aa48d6fae7bb31db HTTP/1.0" 202 Accepted 2026-04-07 07:11:08,229 - lava_callback - INFO - Starting async job submit for node 69d20af9aa48d6fae7bb31db 2026-04-07 07:11:08,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:11:08,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20af9aa48d6fae7bb31db HTTP/1.1" 200 None 2026-04-07 07:11:08,244 - lava_callback - DEBUG - Processing node 69d20af9aa48d6fae7bb31db: baseline-arm64-baylibre 2026-04-07 07:11:08,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20af9aa48d6fae7bb31db 2026-04-07 07:11:08,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:11:08,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20af9aa48d6fae7bb31db HTTP/1.1" 200 None 2026-04-07 07:11:08,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:11:08,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:11:08,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:11:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20af9aa48d6fae7bb31db HTTP/1.1" 200 None 2026-04-07 07:11:08,318 - lava_callback - ERROR - Error processing callback for node 69d20af9aa48d6fae7bb31db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:12:08,346 - lava_callback - INFO - Received callback for node 69d20b43aa48d6fae7bb31ef INFO: 172.21.0.1:53848 - "POST /node/69d20b43aa48d6fae7bb31ef HTTP/1.0" 202 Accepted 2026-04-07 07:12:08,352 - lava_callback - INFO - Starting async job submit for node 69d20b43aa48d6fae7bb31ef 2026-04-07 07:12:08,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:12:08,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20b43aa48d6fae7bb31ef HTTP/1.1" 200 None 2026-04-07 07:12:08,368 - lava_callback - DEBUG - Processing node 69d20b43aa48d6fae7bb31ef: baseline-arm64-baylibre 2026-04-07 07:12:08,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20b43aa48d6fae7bb31ef 2026-04-07 07:12:08,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:12:08,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20b43aa48d6fae7bb31ef HTTP/1.1" 200 None 2026-04-07 07:12:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:12:08,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:12:08,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:12:08,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20b43aa48d6fae7bb31ef HTTP/1.1" 200 None 2026-04-07 07:12:08,423 - lava_callback - ERROR - Error processing callback for node 69d20b43aa48d6fae7bb31ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:13:28,284 - lava_callback - INFO - Received callback for node 69d20b89aa48d6fae7bb3215 INFO: 172.21.0.1:36080 - "POST /node/69d20b89aa48d6fae7bb3215 HTTP/1.0" 202 Accepted 2026-04-07 07:13:28,291 - lava_callback - INFO - Starting async job submit for node 69d20b89aa48d6fae7bb3215 2026-04-07 07:13:28,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:13:28,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20b89aa48d6fae7bb3215 HTTP/1.1" 200 None 2026-04-07 07:13:28,311 - lava_callback - DEBUG - Processing node 69d20b89aa48d6fae7bb3215: baseline-arm64-baylibre 2026-04-07 07:13:28,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20b89aa48d6fae7bb3215 2026-04-07 07:13:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:13:28,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20b89aa48d6fae7bb3215 HTTP/1.1" 200 None 2026-04-07 07:13:28,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:13:28,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:13:28,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:13:28,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20b89aa48d6fae7bb3215 HTTP/1.1" 200 None 2026-04-07 07:13:28,411 - lava_callback - ERROR - Error processing callback for node 69d20b89aa48d6fae7bb3215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:14:43,181 - lava_callback - INFO - Received callback for node 69d20bcfaa48d6fae7bb325d INFO: 172.21.0.1:56492 - "POST /node/69d20bcfaa48d6fae7bb325d HTTP/1.0" 202 Accepted 2026-04-07 07:14:43,187 - lava_callback - INFO - Starting async job submit for node 69d20bcfaa48d6fae7bb325d 2026-04-07 07:14:43,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:14:43,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20bcfaa48d6fae7bb325d HTTP/1.1" 200 None 2026-04-07 07:14:43,204 - lava_callback - DEBUG - Processing node 69d20bcfaa48d6fae7bb325d: baseline-arm64-clabbe 2026-04-07 07:14:43,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20bcfaa48d6fae7bb325d 2026-04-07 07:14:43,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:14:43,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20bcfaa48d6fae7bb325d HTTP/1.1" 200 None 2026-04-07 07:14:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:14:43,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:14:43,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:14:43,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20bcfaa48d6fae7bb325d HTTP/1.1" 200 None 2026-04-07 07:14:43,261 - lava_callback - ERROR - Error processing callback for node 69d20bcfaa48d6fae7bb325d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:15:43,172 - lava_callback - INFO - Received callback for node 69d20c18aa48d6fae7bb3284 INFO: 172.21.0.1:50018 - "POST /node/69d20c18aa48d6fae7bb3284 HTTP/1.0" 202 Accepted 2026-04-07 07:15:43,178 - lava_callback - INFO - Starting async job submit for node 69d20c18aa48d6fae7bb3284 2026-04-07 07:15:43,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:15:43,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c18aa48d6fae7bb3284 HTTP/1.1" 200 None 2026-04-07 07:15:43,194 - lava_callback - DEBUG - Processing node 69d20c18aa48d6fae7bb3284: baseline-arm64-clabbe 2026-04-07 07:15:43,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20c18aa48d6fae7bb3284 2026-04-07 07:15:43,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:15:43,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c18aa48d6fae7bb3284 HTTP/1.1" 200 None 2026-04-07 07:15:43,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:15:43,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:15:43,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:15:43,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20c18aa48d6fae7bb3284 HTTP/1.1" 200 None 2026-04-07 07:15:43,256 - lava_callback - ERROR - Error processing callback for node 69d20c18aa48d6fae7bb3284: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:17:03,238 - lava_callback - INFO - Received callback for node 69d20c58aa48d6fae7bb32d2 INFO: 172.21.0.1:48268 - "POST /node/69d20c58aa48d6fae7bb32d2 HTTP/1.0" 202 Accepted 2026-04-07 07:17:03,244 - lava_callback - INFO - Starting async job submit for node 69d20c58aa48d6fae7bb32d2 2026-04-07 07:17:03,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:17:03,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c58aa48d6fae7bb32d2 HTTP/1.1" 200 None 2026-04-07 07:17:03,259 - lava_callback - DEBUG - Processing node 69d20c58aa48d6fae7bb32d2: baseline-arm64-clabbe 2026-04-07 07:17:03,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20c58aa48d6fae7bb32d2 2026-04-07 07:17:03,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:17:03,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c58aa48d6fae7bb32d2 HTTP/1.1" 200 None 2026-04-07 07:17:03,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:17:03,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:17:03,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:17:03,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20c58aa48d6fae7bb32d2 HTTP/1.1" 200 None 2026-04-07 07:17:03,313 - lava_callback - ERROR - Error processing callback for node 69d20c58aa48d6fae7bb32d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:18:03,269 - lava_callback - INFO - Received callback for node 69d20c9aaa48d6fae7bb3323 INFO: 172.21.0.1:43320 - "POST /node/69d20c9aaa48d6fae7bb3323 HTTP/1.0" 202 Accepted 2026-04-07 07:18:03,275 - lava_callback - INFO - Starting async job submit for node 69d20c9aaa48d6fae7bb3323 2026-04-07 07:18:03,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:18:03,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c9aaa48d6fae7bb3323 HTTP/1.1" 200 None 2026-04-07 07:18:03,302 - lava_callback - DEBUG - Processing node 69d20c9aaa48d6fae7bb3323: baseline-arm64-clabbe 2026-04-07 07:18:03,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20c9aaa48d6fae7bb3323 2026-04-07 07:18:03,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:18:03,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20c9aaa48d6fae7bb3323 HTTP/1.1" 200 None 2026-04-07 07:18:03,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:18:03,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:18:03,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:18:03,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20c9aaa48d6fae7bb3323 HTTP/1.1" 200 None 2026-04-07 07:18:03,370 - lava_callback - ERROR - Error processing callback for node 69d20c9aaa48d6fae7bb3323: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:19:03,313 - lava_callback - INFO - Received callback for node 69d20ce3aa48d6fae7bb333c INFO: 172.21.0.1:33516 - "POST /node/69d20ce3aa48d6fae7bb333c HTTP/1.0" 202 Accepted 2026-04-07 07:19:03,320 - lava_callback - INFO - Starting async job submit for node 69d20ce3aa48d6fae7bb333c 2026-04-07 07:19:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:19:03,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ce3aa48d6fae7bb333c HTTP/1.1" 200 None 2026-04-07 07:19:03,338 - lava_callback - DEBUG - Processing node 69d20ce3aa48d6fae7bb333c: baseline-arm64-clabbe 2026-04-07 07:19:03,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20ce3aa48d6fae7bb333c 2026-04-07 07:19:03,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:19:03,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ce3aa48d6fae7bb333c HTTP/1.1" 200 None 2026-04-07 07:19:03,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:19:03,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:19:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:19:03,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20ce3aa48d6fae7bb333c HTTP/1.1" 200 None 2026-04-07 07:19:03,396 - lava_callback - ERROR - Error processing callback for node 69d20ce3aa48d6fae7bb333c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:20:23,384 - lava_callback - INFO - Received callback for node 69d20d2baa48d6fae7bb3363 INFO: 172.21.0.1:58498 - "POST /node/69d20d2baa48d6fae7bb3363 HTTP/1.0" 202 Accepted 2026-04-07 07:20:23,390 - lava_callback - INFO - Starting async job submit for node 69d20d2baa48d6fae7bb3363 2026-04-07 07:20:23,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:20:23,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d2baa48d6fae7bb3363 HTTP/1.1" 200 None 2026-04-07 07:20:23,405 - lava_callback - DEBUG - Processing node 69d20d2baa48d6fae7bb3363: baseline-arm64-clabbe 2026-04-07 07:20:23,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20d2baa48d6fae7bb3363 2026-04-07 07:20:23,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:20:23,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d2baa48d6fae7bb3363 HTTP/1.1" 200 None 2026-04-07 07:20:23,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:20:23,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-07 07:20:23,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:20:23,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20d2baa48d6fae7bb3363 HTTP/1.1" 200 None 2026-04-07 07:20:23,466 - lava_callback - ERROR - Error processing callback for node 69d20d2baa48d6fae7bb3363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:21:08,745 - lava_callback - INFO - Received callback for node 69d20d61aa48d6fae7bb337f INFO: 172.21.0.1:33820 - "POST /node/69d20d61aa48d6fae7bb337f HTTP/1.0" 202 Accepted 2026-04-07 07:21:08,751 - lava_callback - INFO - Starting async job submit for node 69d20d61aa48d6fae7bb337f 2026-04-07 07:21:08,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:08,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d61aa48d6fae7bb337f HTTP/1.1" 200 None 2026-04-07 07:21:08,766 - lava_callback - DEBUG - Processing node 69d20d61aa48d6fae7bb337f: baseline-arm-baylibre 2026-04-07 07:21:08,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20d61aa48d6fae7bb337f 2026-04-07 07:21:08,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:08,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d61aa48d6fae7bb337f HTTP/1.1" 200 None 2026-04-07 07:21:08,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:08,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:21:08,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:08,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20d61aa48d6fae7bb337f HTTP/1.1" 200 None 2026-04-07 07:21:08,816 - lava_callback - ERROR - Error processing callback for node 69d20d61aa48d6fae7bb337f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:21:48,774 - lava_callback - INFO - Received callback for node 69d20d86aa48d6fae7bb3389 INFO: 172.21.0.1:54624 - "POST /node/69d20d86aa48d6fae7bb3389 HTTP/1.0" 202 Accepted 2026-04-07 07:21:48,780 - lava_callback - INFO - Starting async job submit for node 69d20d86aa48d6fae7bb3389 2026-04-07 07:21:48,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:48,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d86aa48d6fae7bb3389 HTTP/1.1" 200 None 2026-04-07 07:21:48,795 - lava_callback - DEBUG - Processing node 69d20d86aa48d6fae7bb3389: baseline-arm-baylibre 2026-04-07 07:21:48,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20d86aa48d6fae7bb3389 2026-04-07 07:21:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:48,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20d86aa48d6fae7bb3389 HTTP/1.1" 200 None 2026-04-07 07:21:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:48,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:21:48,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:21:48,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20d86aa48d6fae7bb3389 HTTP/1.1" 200 None 2026-04-07 07:21:48,860 - lava_callback - ERROR - Error processing callback for node 69d20d86aa48d6fae7bb3389: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:22:28,849 - lava_callback - INFO - Received callback for node 69d20da5aa48d6fae7bb33a0 INFO: 172.21.0.1:41322 - "POST /node/69d20da5aa48d6fae7bb33a0 HTTP/1.0" 202 Accepted 2026-04-07 07:22:28,855 - lava_callback - INFO - Starting async job submit for node 69d20da5aa48d6fae7bb33a0 2026-04-07 07:22:28,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:28,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20da5aa48d6fae7bb33a0 HTTP/1.1" 200 None 2026-04-07 07:22:28,871 - lava_callback - DEBUG - Processing node 69d20da5aa48d6fae7bb33a0: baseline-arm-baylibre 2026-04-07 07:22:28,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20da5aa48d6fae7bb33a0 2026-04-07 07:22:28,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:28,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20da5aa48d6fae7bb33a0 HTTP/1.1" 200 None 2026-04-07 07:22:28,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:28,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:22:28,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:28,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20da5aa48d6fae7bb33a0 HTTP/1.1" 200 None 2026-04-07 07:22:28,922 - lava_callback - ERROR - Error processing callback for node 69d20da5aa48d6fae7bb33a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:22:48,814 - lava_callback - INFO - Received callback for node 69d20dc3aa48d6fae7bb33dd INFO: 172.21.0.1:53708 - "POST /node/69d20dc3aa48d6fae7bb33dd HTTP/1.0" 202 Accepted 2026-04-07 07:22:48,820 - lava_callback - INFO - Starting async job submit for node 69d20dc3aa48d6fae7bb33dd 2026-04-07 07:22:48,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:48,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20dc3aa48d6fae7bb33dd HTTP/1.1" 200 None 2026-04-07 07:22:48,836 - lava_callback - DEBUG - Processing node 69d20dc3aa48d6fae7bb33dd: baseline-arm-baylibre 2026-04-07 07:22:48,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20dc3aa48d6fae7bb33dd 2026-04-07 07:22:48,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:48,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20dc3aa48d6fae7bb33dd HTTP/1.1" 200 None 2026-04-07 07:22:48,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:48,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:22:48,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:22:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20dc3aa48d6fae7bb33dd HTTP/1.1" 200 None 2026-04-07 07:22:48,895 - lava_callback - ERROR - Error processing callback for node 69d20dc3aa48d6fae7bb33dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:23:28,830 - lava_callback - INFO - Received callback for node 69d20de4aa48d6fae7bb33ed INFO: 172.21.0.1:38894 - "POST /node/69d20de4aa48d6fae7bb33ed HTTP/1.0" 202 Accepted 2026-04-07 07:23:28,835 - lava_callback - INFO - Starting async job submit for node 69d20de4aa48d6fae7bb33ed 2026-04-07 07:23:28,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:23:28,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20de4aa48d6fae7bb33ed HTTP/1.1" 200 None 2026-04-07 07:23:28,851 - lava_callback - DEBUG - Processing node 69d20de4aa48d6fae7bb33ed: baseline-arm-baylibre 2026-04-07 07:23:28,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20de4aa48d6fae7bb33ed 2026-04-07 07:23:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:23:28,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20de4aa48d6fae7bb33ed HTTP/1.1" 200 None 2026-04-07 07:23:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:23:28,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:23:28,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:23:28,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20de4aa48d6fae7bb33ed HTTP/1.1" 200 None 2026-04-07 07:23:28,902 - lava_callback - ERROR - Error processing callback for node 69d20de4aa48d6fae7bb33ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:24:03,595 - lava_callback - INFO - Received callback for node 69d20e08aa48d6fae7bb3400 INFO: 172.21.0.1:35502 - "POST /node/69d20e08aa48d6fae7bb3400 HTTP/1.0" 202 Accepted 2026-04-07 07:24:03,602 - lava_callback - INFO - Starting async job submit for node 69d20e08aa48d6fae7bb3400 2026-04-07 07:24:03,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:03,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e08aa48d6fae7bb3400 HTTP/1.1" 200 None 2026-04-07 07:24:03,646 - lava_callback - DEBUG - Processing node 69d20e08aa48d6fae7bb3400: baseline-arm-clabbe 2026-04-07 07:24:03,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20e08aa48d6fae7bb3400 2026-04-07 07:24:03,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:03,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e08aa48d6fae7bb3400 HTTP/1.1" 200 None 2026-04-07 07:24:03,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:03,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:24:03,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:03,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20e08aa48d6fae7bb3400 HTTP/1.1" 200 None 2026-04-07 07:24:03,739 - lava_callback - ERROR - Error processing callback for node 69d20e08aa48d6fae7bb3400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:24:43,589 - lava_callback - INFO - Received callback for node 69d20e25aa48d6fae7bb3430 INFO: 172.21.0.1:35304 - "POST /node/69d20e25aa48d6fae7bb3430 HTTP/1.0" 202 Accepted 2026-04-07 07:24:43,595 - lava_callback - INFO - Starting async job submit for node 69d20e25aa48d6fae7bb3430 2026-04-07 07:24:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:43,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e25aa48d6fae7bb3430 HTTP/1.1" 200 None 2026-04-07 07:24:43,637 - lava_callback - DEBUG - Processing node 69d20e25aa48d6fae7bb3430: baseline-arm-clabbe 2026-04-07 07:24:43,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20e25aa48d6fae7bb3430 2026-04-07 07:24:43,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:43,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e25aa48d6fae7bb3430 HTTP/1.1" 200 None 2026-04-07 07:24:43,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:43,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:24:43,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:43,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20e25aa48d6fae7bb3430 HTTP/1.1" 200 None 2026-04-07 07:24:43,710 - lava_callback - ERROR - Error processing callback for node 69d20e25aa48d6fae7bb3430: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:24:48,928 - lava_callback - INFO - Received callback for node 69d20e3faa48d6fae7bb3469 INFO: 172.21.0.1:35332 - "POST /node/69d20e3faa48d6fae7bb3469 HTTP/1.0" 202 Accepted 2026-04-07 07:24:48,934 - lava_callback - INFO - Starting async job submit for node 69d20e3faa48d6fae7bb3469 2026-04-07 07:24:48,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:48,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e3faa48d6fae7bb3469 HTTP/1.1" 200 None 2026-04-07 07:24:48,951 - lava_callback - DEBUG - Processing node 69d20e3faa48d6fae7bb3469: baseline-arm-baylibre 2026-04-07 07:24:48,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20e3faa48d6fae7bb3469 2026-04-07 07:24:48,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:48,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e3faa48d6fae7bb3469 HTTP/1.1" 200 None 2026-04-07 07:24:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:48,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:24:48,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:24:49,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20e3faa48d6fae7bb3469 HTTP/1.1" 200 None 2026-04-07 07:24:49,022 - lava_callback - ERROR - Error processing callback for node 69d20e3faa48d6fae7bb3469: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:25:43,673 - lava_callback - INFO - Received callback for node 69d20e66aa48d6fae7bb348f INFO: 172.21.0.1:60564 - "POST /node/69d20e66aa48d6fae7bb348f HTTP/1.0" 202 Accepted 2026-04-07 07:25:43,678 - lava_callback - INFO - Starting async job submit for node 69d20e66aa48d6fae7bb348f 2026-04-07 07:25:43,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:25:43,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e66aa48d6fae7bb348f HTTP/1.1" 200 None 2026-04-07 07:25:43,699 - lava_callback - DEBUG - Processing node 69d20e66aa48d6fae7bb348f: baseline-arm-clabbe 2026-04-07 07:25:43,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20e66aa48d6fae7bb348f 2026-04-07 07:25:43,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:25:43,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e66aa48d6fae7bb348f HTTP/1.1" 200 None 2026-04-07 07:25:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:25:43,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:25:43,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:25:43,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20e66aa48d6fae7bb348f HTTP/1.1" 200 None 2026-04-07 07:25:43,759 - lava_callback - ERROR - Error processing callback for node 69d20e66aa48d6fae7bb348f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56528 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:26:23,699 - lava_callback - INFO - Received callback for node 69d20e8aaa48d6fae7bb34a1 INFO: 172.21.0.1:53214 - "POST /node/69d20e8aaa48d6fae7bb34a1 HTTP/1.0" 202 Accepted 2026-04-07 07:26:23,704 - lava_callback - INFO - Starting async job submit for node 69d20e8aaa48d6fae7bb34a1 2026-04-07 07:26:23,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:23,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e8aaa48d6fae7bb34a1 HTTP/1.1" 200 None 2026-04-07 07:26:23,720 - lava_callback - DEBUG - Processing node 69d20e8aaa48d6fae7bb34a1: baseline-arm-clabbe 2026-04-07 07:26:23,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20e8aaa48d6fae7bb34a1 2026-04-07 07:26:23,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:23,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20e8aaa48d6fae7bb34a1 HTTP/1.1" 200 None 2026-04-07 07:26:23,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:23,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:26:23,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:23,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20e8aaa48d6fae7bb34a1 HTTP/1.1" 200 None 2026-04-07 07:26:23,796 - lava_callback - ERROR - Error processing callback for node 69d20e8aaa48d6fae7bb34a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:26:49,097 - lava_callback - INFO - Received callback for node 69d20ea7aa48d6fae7bb34c2 INFO: 172.21.0.1:41292 - "POST /node/69d20ea7aa48d6fae7bb34c2 HTTP/1.0" 202 Accepted 2026-04-07 07:26:49,103 - lava_callback - INFO - Starting async job submit for node 69d20ea7aa48d6fae7bb34c2 2026-04-07 07:26:49,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:49,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ea7aa48d6fae7bb34c2 HTTP/1.1" 200 None 2026-04-07 07:26:49,118 - lava_callback - DEBUG - Processing node 69d20ea7aa48d6fae7bb34c2: baseline-arm-baylibre 2026-04-07 07:26:49,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20ea7aa48d6fae7bb34c2 2026-04-07 07:26:49,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:49,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ea7aa48d6fae7bb34c2 HTTP/1.1" 200 None 2026-04-07 07:26:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:49,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:26:49,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:26:49,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20ea7aa48d6fae7bb34c2 HTTP/1.1" 200 None 2026-04-07 07:26:49,233 - lava_callback - ERROR - Error processing callback for node 69d20ea7aa48d6fae7bb34c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:27:23,822 - lava_callback - INFO - Received callback for node 69d20ecbaa48d6fae7bb34e2 INFO: 172.21.0.1:41376 - "POST /node/69d20ecbaa48d6fae7bb34e2 HTTP/1.0" 202 Accepted 2026-04-07 07:27:23,828 - lava_callback - INFO - Starting async job submit for node 69d20ecbaa48d6fae7bb34e2 2026-04-07 07:27:23,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:23,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ecbaa48d6fae7bb34e2 HTTP/1.1" 200 None 2026-04-07 07:27:23,844 - lava_callback - DEBUG - Processing node 69d20ecbaa48d6fae7bb34e2: baseline-arm-clabbe 2026-04-07 07:27:23,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20ecbaa48d6fae7bb34e2 2026-04-07 07:27:23,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:23,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ecbaa48d6fae7bb34e2 HTTP/1.1" 200 None 2026-04-07 07:27:23,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:23,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:27:23,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:23,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20ecbaa48d6fae7bb34e2 HTTP/1.1" 200 None 2026-04-07 07:27:23,932 - lava_callback - ERROR - Error processing callback for node 69d20ecbaa48d6fae7bb34e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:27:49,058 - lava_callback - INFO - Received callback for node 69d20ee9aa48d6fae7bb34f7 INFO: 172.21.0.1:36376 - "POST /node/69d20ee9aa48d6fae7bb34f7 HTTP/1.0" 202 Accepted 2026-04-07 07:27:49,064 - lava_callback - INFO - Starting async job submit for node 69d20ee9aa48d6fae7bb34f7 2026-04-07 07:27:49,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:49,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ee9aa48d6fae7bb34f7 HTTP/1.1" 200 None 2026-04-07 07:27:49,092 - lava_callback - DEBUG - Processing node 69d20ee9aa48d6fae7bb34f7: baseline-arm-baylibre 2026-04-07 07:27:49,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20ee9aa48d6fae7bb34f7 2026-04-07 07:27:49,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:49,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20ee9aa48d6fae7bb34f7 HTTP/1.1" 200 None 2026-04-07 07:27:49,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:49,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:27:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:27:49,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20ee9aa48d6fae7bb34f7 HTTP/1.1" 200 None 2026-04-07 07:27:49,152 - lava_callback - ERROR - Error processing callback for node 69d20ee9aa48d6fae7bb34f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:28:29,144 - lava_callback - INFO - Received callback for node 69d20f0eaa48d6fae7bb3505 INFO: 172.21.0.1:56084 - "POST /node/69d20f0eaa48d6fae7bb3505 HTTP/1.0" 202 Accepted 2026-04-07 07:28:29,149 - lava_callback - INFO - Starting async job submit for node 69d20f0eaa48d6fae7bb3505 2026-04-07 07:28:29,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:28:29,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f0eaa48d6fae7bb3505 HTTP/1.1" 200 None 2026-04-07 07:28:29,167 - lava_callback - DEBUG - Processing node 69d20f0eaa48d6fae7bb3505: baseline-arm-baylibre 2026-04-07 07:28:29,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20f0eaa48d6fae7bb3505 2026-04-07 07:28:29,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:28:29,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f0eaa48d6fae7bb3505 HTTP/1.1" 200 None 2026-04-07 07:28:29,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:28:29,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:28:29,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:28:29,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20f0eaa48d6fae7bb3505 HTTP/1.1" 200 None 2026-04-07 07:28:29,228 - lava_callback - ERROR - Error processing callback for node 69d20f0eaa48d6fae7bb3505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:29:09,140 - lava_callback - INFO - Received callback for node 69d20f32aa48d6fae7bb350e INFO: 172.21.0.1:53130 - "POST /node/69d20f32aa48d6fae7bb350e HTTP/1.0" 202 Accepted 2026-04-07 07:29:09,146 - lava_callback - INFO - Starting async job submit for node 69d20f32aa48d6fae7bb350e 2026-04-07 07:29:09,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f32aa48d6fae7bb350e HTTP/1.1" 200 None 2026-04-07 07:29:09,162 - lava_callback - DEBUG - Processing node 69d20f32aa48d6fae7bb350e: baseline-arm-baylibre 2026-04-07 07:29:09,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20f32aa48d6fae7bb350e 2026-04-07 07:29:09,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:09,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f32aa48d6fae7bb350e HTTP/1.1" 200 None 2026-04-07 07:29:09,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:09,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:29:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:09,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20f32aa48d6fae7bb350e HTTP/1.1" 200 None 2026-04-07 07:29:09,223 - lava_callback - ERROR - Error processing callback for node 69d20f32aa48d6fae7bb350e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:29:43,900 - lava_callback - INFO - Received callback for node 69d20f58aa48d6fae7bb351a INFO: 172.21.0.1:48218 - "POST /node/69d20f58aa48d6fae7bb351a HTTP/1.0" 202 Accepted 2026-04-07 07:29:43,906 - lava_callback - INFO - Starting async job submit for node 69d20f58aa48d6fae7bb351a 2026-04-07 07:29:43,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:43,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f58aa48d6fae7bb351a HTTP/1.1" 200 None 2026-04-07 07:29:43,923 - lava_callback - DEBUG - Processing node 69d20f58aa48d6fae7bb351a: baseline-arm-clabbe 2026-04-07 07:29:43,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20f58aa48d6fae7bb351a 2026-04-07 07:29:43,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:43,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f58aa48d6fae7bb351a HTTP/1.1" 200 None 2026-04-07 07:29:43,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:43,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:29:43,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:29:44,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20f58aa48d6fae7bb351a HTTP/1.1" 200 None 2026-04-07 07:29:44,013 - lava_callback - ERROR - Error processing callback for node 69d20f58aa48d6fae7bb351a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:30:03,915 - lava_callback - INFO - Received callback for node 69d20f77aa48d6fae7bb3527 INFO: 172.21.0.1:36656 - "POST /node/69d20f77aa48d6fae7bb3527 HTTP/1.0" 202 Accepted 2026-04-07 07:30:03,920 - lava_callback - INFO - Starting async job submit for node 69d20f77aa48d6fae7bb3527 2026-04-07 07:30:03,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:03,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f77aa48d6fae7bb3527 HTTP/1.1" 200 None 2026-04-07 07:30:03,935 - lava_callback - DEBUG - Processing node 69d20f77aa48d6fae7bb3527: baseline-arm-clabbe 2026-04-07 07:30:03,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20f77aa48d6fae7bb3527 2026-04-07 07:30:03,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:03,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f77aa48d6fae7bb3527 HTTP/1.1" 200 None 2026-04-07 07:30:03,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:03,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:30:03,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:03,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20f77aa48d6fae7bb3527 HTTP/1.1" 200 None 2026-04-07 07:30:03,989 - lava_callback - ERROR - Error processing callback for node 69d20f77aa48d6fae7bb3527: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:30:43,950 - lava_callback - INFO - Received callback for node 69d20f9baa48d6fae7bb355a INFO: 172.21.0.1:40818 - "POST /node/69d20f9baa48d6fae7bb355a HTTP/1.0" 202 Accepted 2026-04-07 07:30:43,956 - lava_callback - INFO - Starting async job submit for node 69d20f9baa48d6fae7bb355a 2026-04-07 07:30:43,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:43,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f9baa48d6fae7bb355a HTTP/1.1" 200 None 2026-04-07 07:30:43,990 - lava_callback - DEBUG - Processing node 69d20f9baa48d6fae7bb355a: baseline-arm-clabbe 2026-04-07 07:30:43,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20f9baa48d6fae7bb355a 2026-04-07 07:30:43,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:44,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20f9baa48d6fae7bb355a HTTP/1.1" 200 None 2026-04-07 07:30:44,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:44,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:30:44,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:30:44,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20f9baa48d6fae7bb355a HTTP/1.1" 200 None 2026-04-07 07:30:44,047 - lava_callback - ERROR - Error processing callback for node 69d20f9baa48d6fae7bb355a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:31:23,907 - lava_callback - INFO - Received callback for node 69d20fbeaa48d6fae7bb3570 INFO: 172.21.0.1:34128 - "POST /node/69d20fbeaa48d6fae7bb3570 HTTP/1.0" 202 Accepted 2026-04-07 07:31:23,915 - lava_callback - INFO - Starting async job submit for node 69d20fbeaa48d6fae7bb3570 2026-04-07 07:31:23,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:31:23,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fbeaa48d6fae7bb3570 HTTP/1.1" 200 None 2026-04-07 07:31:23,934 - lava_callback - DEBUG - Processing node 69d20fbeaa48d6fae7bb3570: baseline-arm-clabbe 2026-04-07 07:31:23,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20fbeaa48d6fae7bb3570 2026-04-07 07:31:23,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:31:23,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fbeaa48d6fae7bb3570 HTTP/1.1" 200 None 2026-04-07 07:31:23,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:31:23,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:31:23,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:31:23,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20fbeaa48d6fae7bb3570 HTTP/1.1" 200 None 2026-04-07 07:31:23,998 - lava_callback - ERROR - Error processing callback for node 69d20fbeaa48d6fae7bb3570: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:32:03,991 - lava_callback - INFO - Received callback for node 69d20fe1aa48d6fae7bb357d INFO: 172.21.0.1:45568 - "POST /node/69d20fe1aa48d6fae7bb357d HTTP/1.0" 202 Accepted 2026-04-07 07:32:03,996 - lava_callback - INFO - Starting async job submit for node 69d20fe1aa48d6fae7bb357d 2026-04-07 07:32:03,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:04,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fe1aa48d6fae7bb357d HTTP/1.1" 200 None 2026-04-07 07:32:04,015 - lava_callback - DEBUG - Processing node 69d20fe1aa48d6fae7bb357d: baseline-arm-clabbe 2026-04-07 07:32:04,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20fe1aa48d6fae7bb357d 2026-04-07 07:32:04,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:04,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fe1aa48d6fae7bb357d HTTP/1.1" 200 None 2026-04-07 07:32:04,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:04,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:32:04,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:04,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20fe1aa48d6fae7bb357d HTTP/1.1" 200 None 2026-04-07 07:32:04,066 - lava_callback - ERROR - Error processing callback for node 69d20fe1aa48d6fae7bb357d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:32:23,956 - lava_callback - INFO - Received callback for node 69d20fffaa48d6fae7bb35a3 INFO: 172.21.0.1:48938 - "POST /node/69d20fffaa48d6fae7bb35a3 HTTP/1.0" 202 Accepted 2026-04-07 07:32:23,962 - lava_callback - INFO - Starting async job submit for node 69d20fffaa48d6fae7bb35a3 2026-04-07 07:32:23,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:23,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fffaa48d6fae7bb35a3 HTTP/1.1" 200 None 2026-04-07 07:32:23,978 - lava_callback - DEBUG - Processing node 69d20fffaa48d6fae7bb35a3: baseline-arm-clabbe 2026-04-07 07:32:23,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d20fffaa48d6fae7bb35a3 2026-04-07 07:32:23,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:23,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d20fffaa48d6fae7bb35a3 HTTP/1.1" 200 None 2026-04-07 07:32:24,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:24,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-07 07:32:24,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:32:24,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d20fffaa48d6fae7bb35a3 HTTP/1.1" 200 None 2026-04-07 07:32:24,042 - lava_callback - ERROR - Error processing callback for node 69d20fffaa48d6fae7bb35a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:33:09,419 - lava_callback - INFO - Received callback for node 69d21023aa48d6fae7bb35da INFO: 172.21.0.1:35780 - "POST /node/69d21023aa48d6fae7bb35da HTTP/1.0" 202 Accepted 2026-04-07 07:33:09,425 - lava_callback - INFO - Starting async job submit for node 69d21023aa48d6fae7bb35da 2026-04-07 07:33:09,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:33:09,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21023aa48d6fae7bb35da HTTP/1.1" 200 None 2026-04-07 07:33:09,440 - lava_callback - DEBUG - Processing node 69d21023aa48d6fae7bb35da: baseline-arm64-baylibre 2026-04-07 07:33:09,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21023aa48d6fae7bb35da 2026-04-07 07:33:09,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:33:09,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21023aa48d6fae7bb35da HTTP/1.1" 200 None 2026-04-07 07:33:09,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:33:09,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:33:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:33:09,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21023aa48d6fae7bb35da HTTP/1.1" 200 None 2026-04-07 07:33:09,512 - lava_callback - ERROR - Error processing callback for node 69d21023aa48d6fae7bb35da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:34:24,097 - lava_callback - INFO - Received callback for node 69d2106aaa48d6fae7bb362e INFO: 172.21.0.1:56012 - "POST /node/69d2106aaa48d6fae7bb362e HTTP/1.0" 202 Accepted 2026-04-07 07:34:24,106 - lava_callback - INFO - Starting async job submit for node 69d2106aaa48d6fae7bb362e 2026-04-07 07:34:24,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:34:24,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2106aaa48d6fae7bb362e HTTP/1.1" 200 None 2026-04-07 07:34:24,121 - lava_callback - DEBUG - Processing node 69d2106aaa48d6fae7bb362e: baseline-arm64-clabbe 2026-04-07 07:34:24,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2106aaa48d6fae7bb362e 2026-04-07 07:34:24,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:34:24,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2106aaa48d6fae7bb362e HTTP/1.1" 200 None 2026-04-07 07:34:24,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:34:24,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:34:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:34:24,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2106aaa48d6fae7bb362e HTTP/1.1" 200 None 2026-04-07 07:34:24,186 - lava_callback - ERROR - Error processing callback for node 69d2106aaa48d6fae7bb362e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:35:24,130 - lava_callback - INFO - Received callback for node 69d210afaa48d6fae7bb365a INFO: 172.21.0.1:41020 - "POST /node/69d210afaa48d6fae7bb365a HTTP/1.0" 202 Accepted 2026-04-07 07:35:24,136 - lava_callback - INFO - Starting async job submit for node 69d210afaa48d6fae7bb365a 2026-04-07 07:35:24,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:35:24,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d210afaa48d6fae7bb365a HTTP/1.1" 200 None 2026-04-07 07:35:24,152 - lava_callback - DEBUG - Processing node 69d210afaa48d6fae7bb365a: baseline-arm64-clabbe 2026-04-07 07:35:24,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d210afaa48d6fae7bb365a 2026-04-07 07:35:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:35:24,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d210afaa48d6fae7bb365a HTTP/1.1" 200 None 2026-04-07 07:35:24,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:35:24,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:35:24,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:35:24,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d210afaa48d6fae7bb365a HTTP/1.1" 200 None 2026-04-07 07:35:24,225 - lava_callback - ERROR - Error processing callback for node 69d210afaa48d6fae7bb365a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:36:29,644 - lava_callback - INFO - Received callback for node 69d210edaa48d6fae7bb3686 INFO: 172.21.0.1:39292 - "POST /node/69d210edaa48d6fae7bb3686 HTTP/1.0" 202 Accepted 2026-04-07 07:36:29,649 - lava_callback - INFO - Starting async job submit for node 69d210edaa48d6fae7bb3686 2026-04-07 07:36:29,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:36:29,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d210edaa48d6fae7bb3686 HTTP/1.1" 200 None 2026-04-07 07:36:29,665 - lava_callback - DEBUG - Processing node 69d210edaa48d6fae7bb3686: baseline-arm64-baylibre 2026-04-07 07:36:29,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d210edaa48d6fae7bb3686 2026-04-07 07:36:29,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:36:29,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d210edaa48d6fae7bb3686 HTTP/1.1" 200 None 2026-04-07 07:36:29,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:36:29,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:36:29,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:36:29,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d210edaa48d6fae7bb3686 HTTP/1.1" 200 None 2026-04-07 07:36:29,724 - lava_callback - ERROR - Error processing callback for node 69d210edaa48d6fae7bb3686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:37:44,209 - lava_callback - INFO - Received callback for node 69d2113eaa48d6fae7bb369f INFO: 172.21.0.1:33300 - "POST /node/69d2113eaa48d6fae7bb369f HTTP/1.0" 202 Accepted 2026-04-07 07:37:44,215 - lava_callback - INFO - Starting async job submit for node 69d2113eaa48d6fae7bb369f 2026-04-07 07:37:44,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:37:44,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2113eaa48d6fae7bb369f HTTP/1.1" 200 None 2026-04-07 07:37:44,233 - lava_callback - DEBUG - Processing node 69d2113eaa48d6fae7bb369f: baseline-arm64-clabbe 2026-04-07 07:37:44,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d2113eaa48d6fae7bb369f 2026-04-07 07:37:44,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:37:44,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2113eaa48d6fae7bb369f HTTP/1.1" 200 None 2026-04-07 07:37:44,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:37:44,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:37:44,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:37:44,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2113eaa48d6fae7bb369f HTTP/1.1" 200 None 2026-04-07 07:37:44,316 - lava_callback - ERROR - Error processing callback for node 69d2113eaa48d6fae7bb369f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:38:49,743 - lava_callback - INFO - Received callback for node 69d21177aa48d6fae7bb36de INFO: 172.21.0.1:57164 - "POST /node/69d21177aa48d6fae7bb36de HTTP/1.0" 202 Accepted 2026-04-07 07:38:49,749 - lava_callback - INFO - Starting async job submit for node 69d21177aa48d6fae7bb36de 2026-04-07 07:38:49,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:38:49,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21177aa48d6fae7bb36de HTTP/1.1" 200 None 2026-04-07 07:38:49,765 - lava_callback - DEBUG - Processing node 69d21177aa48d6fae7bb36de: baseline-arm64-baylibre 2026-04-07 07:38:49,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21177aa48d6fae7bb36de 2026-04-07 07:38:49,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:38:49,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21177aa48d6fae7bb36de HTTP/1.1" 200 None 2026-04-07 07:38:49,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:38:49,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:38:49,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:38:49,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21177aa48d6fae7bb36de HTTP/1.1" 200 None 2026-04-07 07:38:49,822 - lava_callback - ERROR - Error processing callback for node 69d21177aa48d6fae7bb36de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:40:04,462 - lava_callback - INFO - Received callback for node 69d211bfaa48d6fae7bb3720 INFO: 172.21.0.1:56118 - "POST /node/69d211bfaa48d6fae7bb3720 HTTP/1.0" 202 Accepted 2026-04-07 07:40:04,467 - lava_callback - INFO - Starting async job submit for node 69d211bfaa48d6fae7bb3720 2026-04-07 07:40:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:40:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d211bfaa48d6fae7bb3720 HTTP/1.1" 200 None 2026-04-07 07:40:04,483 - lava_callback - DEBUG - Processing node 69d211bfaa48d6fae7bb3720: baseline-arm64-clabbe 2026-04-07 07:40:04,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d211bfaa48d6fae7bb3720 2026-04-07 07:40:04,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:40:04,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d211bfaa48d6fae7bb3720 HTTP/1.1" 200 None 2026-04-07 07:40:04,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:40:04,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:40:04,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:40:04,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d211bfaa48d6fae7bb3720 HTTP/1.1" 200 None 2026-04-07 07:40:04,537 - lava_callback - ERROR - Error processing callback for node 69d211bfaa48d6fae7bb3720: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:41:04,415 - lava_callback - INFO - Received callback for node 69d21204aa48d6fae7bb374e INFO: 172.21.0.1:53012 - "POST /node/69d21204aa48d6fae7bb374e HTTP/1.0" 202 Accepted 2026-04-07 07:41:04,421 - lava_callback - INFO - Starting async job submit for node 69d21204aa48d6fae7bb374e 2026-04-07 07:41:04,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:41:04,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21204aa48d6fae7bb374e HTTP/1.1" 200 None 2026-04-07 07:41:04,441 - lava_callback - DEBUG - Processing node 69d21204aa48d6fae7bb374e: baseline-arm64-clabbe 2026-04-07 07:41:04,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21204aa48d6fae7bb374e 2026-04-07 07:41:04,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:41:04,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21204aa48d6fae7bb374e HTTP/1.1" 200 None 2026-04-07 07:41:04,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:41:04,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:41:04,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:41:04,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21204aa48d6fae7bb374e HTTP/1.1" 200 None 2026-04-07 07:41:04,499 - lava_callback - ERROR - Error processing callback for node 69d21204aa48d6fae7bb374e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK 2026-04-07 07:42:04,459 - lava_callback - INFO - Received callback for node 69d21247aa48d6fae7bb3786 INFO: 172.21.0.1:32948 - "POST /node/69d21247aa48d6fae7bb3786 HTTP/1.0" 202 Accepted 2026-04-07 07:42:04,465 - lava_callback - INFO - Starting async job submit for node 69d21247aa48d6fae7bb3786 2026-04-07 07:42:04,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:42:04,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21247aa48d6fae7bb3786 HTTP/1.1" 200 None 2026-04-07 07:42:04,496 - lava_callback - DEBUG - Processing node 69d21247aa48d6fae7bb3786: baseline-arm64-clabbe 2026-04-07 07:42:04,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d21247aa48d6fae7bb3786 2026-04-07 07:42:04,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:42:04,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21247aa48d6fae7bb3786 HTTP/1.1" 200 None 2026-04-07 07:42:04,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-07 07:42:04,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-07 07:42:04,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000