INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET /node/697dc1262e5e2d09e1d90f53%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60758 - "GET /node/693f70730d8ce4018da92ff6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58136 - "GET /node/6911887af15111fc8ce4bbd5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58150 - "GET /node/6953226b31522df6df79b133%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET /node/6992d9f131166481c8dd421c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44910 - "GET /node/6986fa856e077e4126a7d323%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET /node/69876b21e31b58f834f197a0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60674 - "GET /node/69877972e31b58f834f1b090%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET /node/6985dbc971989fb14149adc3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46204 - "GET /node/69876b21e31b58f834f1979b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET /node/69a1be5369d5b6151c03ae1d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60772 - "GET /node/698b68440a16aea5a0dc76b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET /node/69299d9d09677735f68afa46%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57574 - "GET /node/698f60ff3013abef95cfa1b1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:43:33,456 - lava_callback - INFO - Received callback for node 69d301ab13dd9a95098938de 2026-04-06 00:43:33,463 - lava_callback - INFO - Starting async job submit for node 69d301ab13dd9a95098938de INFO: 172.21.0.1:59290 - "POST /node/69d301ab13dd9a95098938de HTTP/1.0" 202 Accepted 2026-04-06 00:43:33,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:33,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ab13dd9a95098938de HTTP/1.1" 200 None 2026-04-06 00:43:33,488 - lava_callback - DEBUG - Processing node 69d301ab13dd9a95098938de: baseline-arm 2026-04-06 00:43:33,494 - lava_callback - WARNING - Failed to upload log 2026-04-06 00:43:33,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:33,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:33,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ab13dd9a95098938de/lava-logs.yaml 2026-04-06 00:43:33,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:33,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:33,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ab13dd9a95098938de/lava_callback.json.gz 2026-04-06 00:43:33,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:33,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ab13dd9a95098938de HTTP/1.1" 200 None 2026-04-06 00:43:33,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:43:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:33,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ab13dd9a95098938de HTTP/1.1" 200 None 2026-04-06 00:43:33,824 - lava_callback - INFO - Completed processing callback for node 69d301ab13dd9a95098938de INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:43:47,971 - lava_callback - INFO - Received callback for node 69d301b613dd9a9509893905 INFO: 172.21.0.1:59270 - "POST /node/69d301b613dd9a9509893905 HTTP/1.0" 202 Accepted 2026-04-06 00:43:47,986 - lava_callback - INFO - Starting async job submit for node 69d301b613dd9a9509893905 2026-04-06 00:43:47,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:48,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b613dd9a9509893905 HTTP/1.1" 200 None 2026-04-06 00:43:48,020 - lava_callback - DEBUG - Processing node 69d301b613dd9a9509893905: baseline-arm 2026-04-06 00:43:48,029 - lava_callback - WARNING - Failed to upload log 2026-04-06 00:43:48,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:48,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:48,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301b613dd9a9509893905/lava-logs.yaml 2026-04-06 00:43:48,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:48,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:48,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301b613dd9a9509893905/lava_callback.json.gz 2026-04-06 00:43:48,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:48,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b613dd9a9509893905 HTTP/1.1" 200 None 2026-04-06 00:43:48,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:48,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:43:48,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:48,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b613dd9a9509893905 HTTP/1.1" 200 None 2026-04-06 00:43:48,509 - lava_callback - INFO - Completed processing callback for node 69d301b613dd9a9509893905 INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:43:49,085 - lava_callback - INFO - Received callback for node 69d05eb4d2be3e1cf2a5ac55 INFO: 172.21.0.1:59282 - "POST /node/69d05eb4d2be3e1cf2a5ac55 HTTP/1.0" 202 Accepted 2026-04-06 00:43:49,094 - lava_callback - INFO - Starting async job submit for node 69d05eb4d2be3e1cf2a5ac55 2026-04-06 00:43:49,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb4d2be3e1cf2a5ac55 HTTP/1.1" 200 None 2026-04-06 00:43:49,112 - lava_callback - DEBUG - Processing node 69d05eb4d2be3e1cf2a5ac55: baseline-arm-baylibre 2026-04-06 00:43:49,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05eb4d2be3e1cf2a5ac55 2026-04-06 00:43:49,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb4d2be3e1cf2a5ac55 HTTP/1.1" 200 None 2026-04-06 00:43:49,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05eb4d2be3e1cf2a5ac55 HTTP/1.1" 200 None 2026-04-06 00:43:49,190 - lava_callback - ERROR - Error processing callback for node 69d05eb4d2be3e1cf2a5ac55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:49,752 - lava_callback - INFO - Received callback for node 69d05eb5d2be3e1cf2a5ac5d INFO: 172.21.0.1:54164 - "POST /node/69d05eb5d2be3e1cf2a5ac5d HTTP/1.0" 202 Accepted 2026-04-06 00:43:49,767 - lava_callback - INFO - Starting async job submit for node 69d05eb5d2be3e1cf2a5ac5d 2026-04-06 00:43:49,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb5d2be3e1cf2a5ac5d HTTP/1.1" 200 None 2026-04-06 00:43:49,792 - lava_callback - DEBUG - Processing node 69d05eb5d2be3e1cf2a5ac5d: baseline-arm-baylibre 2026-04-06 00:43:49,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05eb5d2be3e1cf2a5ac5d 2026-04-06 00:43:49,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb5d2be3e1cf2a5ac5d HTTP/1.1" 200 None 2026-04-06 00:43:49,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:49,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:49,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05eb5d2be3e1cf2a5ac5d HTTP/1.1" 200 None 2026-04-06 00:43:49,890 - lava_callback - ERROR - Error processing callback for node 69d05eb5d2be3e1cf2a5ac5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:50,421 - lava_callback - INFO - Received callback for node 69d05eb7d2be3e1cf2a5ac60 INFO: 172.21.0.1:54166 - "POST /node/69d05eb7d2be3e1cf2a5ac60 HTTP/1.0" 202 Accepted 2026-04-06 00:43:50,427 - lava_callback - INFO - Starting async job submit for node 69d05eb7d2be3e1cf2a5ac60 2026-04-06 00:43:50,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:50,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb7d2be3e1cf2a5ac60 HTTP/1.1" 200 None 2026-04-06 00:43:50,459 - lava_callback - DEBUG - Processing node 69d05eb7d2be3e1cf2a5ac60: baseline-arm-baylibre 2026-04-06 00:43:50,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05eb7d2be3e1cf2a5ac60 2026-04-06 00:43:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:50,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb7d2be3e1cf2a5ac60 HTTP/1.1" 200 None 2026-04-06 00:43:50,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:50,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:50,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:50,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05eb7d2be3e1cf2a5ac60 HTTP/1.1" 200 None 2026-04-06 00:43:50,613 - lava_callback - ERROR - Error processing callback for node 69d05eb7d2be3e1cf2a5ac60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:51,114 - lava_callback - INFO - Received callback for node 69d05eb8d2be3e1cf2a5ac63 INFO: 172.21.0.1:54172 - "POST /node/69d05eb8d2be3e1cf2a5ac63 HTTP/1.0" 202 Accepted 2026-04-06 00:43:51,120 - lava_callback - INFO - Starting async job submit for node 69d05eb8d2be3e1cf2a5ac63 2026-04-06 00:43:51,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb8d2be3e1cf2a5ac63 HTTP/1.1" 200 None 2026-04-06 00:43:51,137 - lava_callback - DEBUG - Processing node 69d05eb8d2be3e1cf2a5ac63: baseline-arm-baylibre 2026-04-06 00:43:51,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05eb8d2be3e1cf2a5ac63 2026-04-06 00:43:51,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eb8d2be3e1cf2a5ac63 HTTP/1.1" 200 None 2026-04-06 00:43:51,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:51,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05eb8d2be3e1cf2a5ac63 HTTP/1.1" 200 None 2026-04-06 00:43:51,198 - lava_callback - ERROR - Error processing callback for node 69d05eb8d2be3e1cf2a5ac63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:51,811 - lava_callback - INFO - Received callback for node 69d05ebbd2be3e1cf2a5ac6e INFO: 172.21.0.1:54174 - "POST /node/69d05ebbd2be3e1cf2a5ac6e HTTP/1.0" 202 Accepted 2026-04-06 00:43:51,817 - lava_callback - INFO - Starting async job submit for node 69d05ebbd2be3e1cf2a5ac6e 2026-04-06 00:43:51,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ebbd2be3e1cf2a5ac6e HTTP/1.1" 200 None 2026-04-06 00:43:51,833 - lava_callback - DEBUG - Processing node 69d05ebbd2be3e1cf2a5ac6e: baseline-arm-baylibre 2026-04-06 00:43:51,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ebbd2be3e1cf2a5ac6e 2026-04-06 00:43:51,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ebbd2be3e1cf2a5ac6e HTTP/1.1" 200 None 2026-04-06 00:43:51,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:51,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ebbd2be3e1cf2a5ac6e HTTP/1.1" 200 None 2026-04-06 00:43:51,903 - lava_callback - ERROR - Error processing callback for node 69d05ebbd2be3e1cf2a5ac6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:52,506 - lava_callback - INFO - Received callback for node 69d05ebcd2be3e1cf2a5ac71 INFO: 172.21.0.1:54188 - "POST /node/69d05ebcd2be3e1cf2a5ac71 HTTP/1.0" 202 Accepted 2026-04-06 00:43:52,515 - lava_callback - INFO - Starting async job submit for node 69d05ebcd2be3e1cf2a5ac71 2026-04-06 00:43:52,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:52,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ebcd2be3e1cf2a5ac71 HTTP/1.1" 200 None 2026-04-06 00:43:52,534 - lava_callback - DEBUG - Processing node 69d05ebcd2be3e1cf2a5ac71: baseline-arm-baylibre 2026-04-06 00:43:52,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ebcd2be3e1cf2a5ac71 2026-04-06 00:43:52,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:52,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ebcd2be3e1cf2a5ac71 HTTP/1.1" 200 None 2026-04-06 00:43:52,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:43:52,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:52,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ebcd2be3e1cf2a5ac71 HTTP/1.1" 200 None 2026-04-06 00:43:52,597 - lava_callback - ERROR - Error processing callback for node 69d05ebcd2be3e1cf2a5ac71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:43:55,189 - lava_callback - INFO - Received callback for node 69d301ae13dd9a95098938ea INFO: 172.21.0.1:54196 - "POST /node/69d301ae13dd9a95098938ea HTTP/1.0" 202 Accepted 2026-04-06 00:43:55,238 - lava_callback - INFO - Starting async job submit for node 69d301ae13dd9a95098938ea 2026-04-06 00:43:55,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:55,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ae13dd9a95098938ea HTTP/1.1" 200 None 2026-04-06 00:43:55,271 - lava_callback - DEBUG - Processing node 69d301ae13dd9a95098938ea: baseline-arm 2026-04-06 00:43:55,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:55,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:55,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938ea/log.txt.gz 2026-04-06 00:43:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:55,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:55,765 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938ea/lava-logs.yaml 2026-04-06 00:43:55,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:43:55,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:43:55,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938ea/lava_callback.json.gz 2026-04-06 00:43:55,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:55,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ae13dd9a95098938ea HTTP/1.1" 200 None 2026-04-06 00:43:55,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:55,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:43:55,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:43:55,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ae13dd9a95098938ea HTTP/1.1" 200 None 2026-04-06 00:43:56,004 - lava_callback - INFO - Completed processing callback for node 69d301ae13dd9a95098938ea INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:44:00,657 - lava_callback - INFO - Received callback for node 69d05ec4d2be3e1cf2a5ac8c INFO: 172.21.0.1:60664 - "POST /node/69d05ec4d2be3e1cf2a5ac8c HTTP/1.0" 202 Accepted 2026-04-06 00:44:00,671 - lava_callback - INFO - Starting async job submit for node 69d05ec4d2be3e1cf2a5ac8c 2026-04-06 00:44:00,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:00,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec4d2be3e1cf2a5ac8c HTTP/1.1" 200 None 2026-04-06 00:44:00,706 - lava_callback - DEBUG - Processing node 69d05ec4d2be3e1cf2a5ac8c: baseline-arm-clabbe 2026-04-06 00:44:00,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ec4d2be3e1cf2a5ac8c 2026-04-06 00:44:00,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:00,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec4d2be3e1cf2a5ac8c HTTP/1.1" 200 None 2026-04-06 00:44:00,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:00,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:00,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:00,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ec4d2be3e1cf2a5ac8c HTTP/1.1" 200 None 2026-04-06 00:44:00,793 - lava_callback - ERROR - Error processing callback for node 69d05ec4d2be3e1cf2a5ac8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:01,352 - lava_callback - INFO - Received callback for node 69d05ec7d2be3e1cf2a5ac95 INFO: 172.21.0.1:60680 - "POST /node/69d05ec7d2be3e1cf2a5ac95 HTTP/1.0" 202 Accepted 2026-04-06 00:44:01,362 - lava_callback - INFO - Starting async job submit for node 69d05ec7d2be3e1cf2a5ac95 2026-04-06 00:44:01,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:01,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec7d2be3e1cf2a5ac95 HTTP/1.1" 200 None 2026-04-06 00:44:01,384 - lava_callback - DEBUG - Processing node 69d05ec7d2be3e1cf2a5ac95: baseline-arm-clabbe 2026-04-06 00:44:01,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ec7d2be3e1cf2a5ac95 2026-04-06 00:44:01,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:01,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec7d2be3e1cf2a5ac95 HTTP/1.1" 200 None 2026-04-06 00:44:01,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:01,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:01,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:01,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ec7d2be3e1cf2a5ac95 HTTP/1.1" 200 None 2026-04-06 00:44:01,489 - lava_callback - ERROR - Error processing callback for node 69d05ec7d2be3e1cf2a5ac95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:02,036 - lava_callback - INFO - Received callback for node 69d05ec8d2be3e1cf2a5ac9c INFO: 172.21.0.1:60692 - "POST /node/69d05ec8d2be3e1cf2a5ac9c HTTP/1.0" 202 Accepted 2026-04-06 00:44:02,048 - lava_callback - INFO - Starting async job submit for node 69d05ec8d2be3e1cf2a5ac9c 2026-04-06 00:44:02,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec8d2be3e1cf2a5ac9c HTTP/1.1" 200 None 2026-04-06 00:44:02,075 - lava_callback - DEBUG - Processing node 69d05ec8d2be3e1cf2a5ac9c: baseline-arm-clabbe 2026-04-06 00:44:02,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ec8d2be3e1cf2a5ac9c 2026-04-06 00:44:02,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec8d2be3e1cf2a5ac9c HTTP/1.1" 200 None 2026-04-06 00:44:02,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:02,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ec8d2be3e1cf2a5ac9c HTTP/1.1" 200 None 2026-04-06 00:44:02,155 - lava_callback - ERROR - Error processing callback for node 69d05ec8d2be3e1cf2a5ac9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:02,747 - lava_callback - INFO - Received callback for node 69d05ec9d2be3e1cf2a5ac9f INFO: 172.21.0.1:60700 - "POST /node/69d05ec9d2be3e1cf2a5ac9f HTTP/1.0" 202 Accepted 2026-04-06 00:44:02,753 - lava_callback - INFO - Starting async job submit for node 69d05ec9d2be3e1cf2a5ac9f 2026-04-06 00:44:02,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec9d2be3e1cf2a5ac9f HTTP/1.1" 200 None 2026-04-06 00:44:02,770 - lava_callback - DEBUG - Processing node 69d05ec9d2be3e1cf2a5ac9f: baseline-arm-clabbe 2026-04-06 00:44:02,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ec9d2be3e1cf2a5ac9f 2026-04-06 00:44:02,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec9d2be3e1cf2a5ac9f HTTP/1.1" 200 None 2026-04-06 00:44:02,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:02,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:02,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ec9d2be3e1cf2a5ac9f HTTP/1.1" 200 None 2026-04-06 00:44:02,849 - lava_callback - ERROR - Error processing callback for node 69d05ec9d2be3e1cf2a5ac9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:03,427 - lava_callback - INFO - Received callback for node 69d05ecad2be3e1cf2a5aca2 INFO: 172.21.0.1:60716 - "POST /node/69d05ecad2be3e1cf2a5aca2 HTTP/1.0" 202 Accepted 2026-04-06 00:44:03,432 - lava_callback - INFO - Starting async job submit for node 69d05ecad2be3e1cf2a5aca2 2026-04-06 00:44:03,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:03,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ecad2be3e1cf2a5aca2 HTTP/1.1" 200 None 2026-04-06 00:44:03,454 - lava_callback - DEBUG - Processing node 69d05ecad2be3e1cf2a5aca2: baseline-arm-clabbe 2026-04-06 00:44:03,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ecad2be3e1cf2a5aca2 2026-04-06 00:44:03,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:03,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ecad2be3e1cf2a5aca2 HTTP/1.1" 200 None 2026-04-06 00:44:03,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:03,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:03,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:03,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ecad2be3e1cf2a5aca2 HTTP/1.1" 200 None 2026-04-06 00:44:03,521 - lava_callback - ERROR - Error processing callback for node 69d05ecad2be3e1cf2a5aca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:03,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:03,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:44:04,120 - lava_callback - INFO - Received callback for node 69d05eccd2be3e1cf2a5aca8 INFO: 172.21.0.1:60720 - "POST /node/69d05eccd2be3e1cf2a5aca8 HTTP/1.0" 202 Accepted 2026-04-06 00:44:04,129 - lava_callback - INFO - Starting async job submit for node 69d05eccd2be3e1cf2a5aca8 2026-04-06 00:44:04,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eccd2be3e1cf2a5aca8 HTTP/1.1" 200 None 2026-04-06 00:44:04,152 - lava_callback - DEBUG - Processing node 69d05eccd2be3e1cf2a5aca8: baseline-arm-clabbe 2026-04-06 00:44:04,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05eccd2be3e1cf2a5aca8 2026-04-06 00:44:04,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05eccd2be3e1cf2a5aca8 HTTP/1.1" 200 None 2026-04-06 00:44:04,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:04,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05eccd2be3e1cf2a5aca8 HTTP/1.1" 200 None 2026-04-06 00:44:04,210 - lava_callback - ERROR - Error processing callback for node 69d05eccd2be3e1cf2a5aca8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:04,502 - lava_callback - INFO - Received callback for node 69d301ab13dd9a95098938e1 INFO: 172.21.0.1:60730 - "POST /node/69d301ab13dd9a95098938e1 HTTP/1.0" 202 Accepted 2026-04-06 00:44:04,553 - lava_callback - INFO - Starting async job submit for node 69d301ab13dd9a95098938e1 2026-04-06 00:44:04,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ab13dd9a95098938e1 HTTP/1.1" 200 None 2026-04-06 00:44:04,592 - lava_callback - DEBUG - Processing node 69d301ab13dd9a95098938e1: baseline-arm 2026-04-06 00:44:04,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:44:04,804 - lava_callback - INFO - Received callback for node 69d05ecdd2be3e1cf2a5acab 2026-04-06 00:44:04,813 - lava_callback - INFO - Starting async job submit for node 69d05ecdd2be3e1cf2a5acab INFO: 172.21.0.1:60742 - "POST /node/69d05ecdd2be3e1cf2a5acab HTTP/1.0" 202 Accepted 2026-04-06 00:44:04,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ecdd2be3e1cf2a5acab HTTP/1.1" 200 None 2026-04-06 00:44:04,836 - lava_callback - DEBUG - Processing node 69d05ecdd2be3e1cf2a5acab: baseline-arm-clabbe 2026-04-06 00:44:04,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ecdd2be3e1cf2a5acab 2026-04-06 00:44:04,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:04,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ab13dd9a95098938e1/log.txt.gz 2026-04-06 00:44:04,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ecdd2be3e1cf2a5acab HTTP/1.1" 200 None 2026-04-06 00:44:04,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:44:04,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 00:44:04,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:04,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ecdd2be3e1cf2a5acab HTTP/1.1" 200 None 2026-04-06 00:44:04,976 - lava_callback - ERROR - Error processing callback for node 69d05ecdd2be3e1cf2a5acab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:44:05,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:05,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ab13dd9a95098938e1/lava-logs.yaml 2026-04-06 00:44:05,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:44:05,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:05,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ab13dd9a95098938e1/lava_callback.json.gz 2026-04-06 00:44:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:05,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ab13dd9a95098938e1 HTTP/1.1" 200 None 2026-04-06 00:44:05,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:05,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:44:05,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:05,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ab13dd9a95098938e1 HTTP/1.1" 200 None 2026-04-06 00:44:05,424 - lava_callback - INFO - Completed processing callback for node 69d301ab13dd9a95098938e1 INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:44:08,646 - lava_callback - INFO - Received callback for node 69d05ec4d2be3e1cf2a5ac86 INFO: 172.21.0.1:60762 - "POST /node/69d05ec4d2be3e1cf2a5ac86 HTTP/1.0" 202 Accepted 2026-04-06 00:44:08,651 - lava_callback - INFO - Starting async job submit for node 69d05ec4d2be3e1cf2a5ac86 2026-04-06 00:44:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:08,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec4d2be3e1cf2a5ac86 HTTP/1.1" 200 None 2026-04-06 00:44:08,667 - lava_callback - DEBUG - Processing node 69d05ec4d2be3e1cf2a5ac86: baseline-arm-baylibre 2026-04-06 00:44:08,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d05ec4d2be3e1cf2a5ac86 2026-04-06 00:44:08,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:08,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d05ec4d2be3e1cf2a5ac86 HTTP/1.1" 200 None 2026-04-06 00:44:08,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:08,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 00:44:08,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:08,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d05ec4d2be3e1cf2a5ac86 HTTP/1.1" 200 None 2026-04-06 00:44:08,731 - lava_callback - ERROR - Error processing callback for node 69d05ec4d2be3e1cf2a5ac86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53524 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:44:33,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:33,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:44:55,932 - lava_callback - INFO - Received callback for node 69d301aa13dd9a95098938db INFO: 172.21.0.1:48890 - "POST /node/69d301aa13dd9a95098938db HTTP/1.0" 202 Accepted 2026-04-06 00:44:55,938 - lava_callback - INFO - Starting async job submit for node 69d301aa13dd9a95098938db 2026-04-06 00:44:55,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:55,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301aa13dd9a95098938db HTTP/1.1" 200 None 2026-04-06 00:44:55,989 - lava_callback - DEBUG - Processing node 69d301aa13dd9a95098938db: baseline-arm 2026-04-06 00:44:56,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:44:56,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:56,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d301aa13dd9a95098938db/log.txt.gz 2026-04-06 00:44:56,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:44:56,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:56,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301aa13dd9a95098938db/lava-logs.yaml 2026-04-06 00:44:56,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:44:56,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:44:56,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301aa13dd9a95098938db/lava_callback.json.gz 2026-04-06 00:44:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:56,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301aa13dd9a95098938db HTTP/1.1" 200 None 2026-04-06 00:44:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:44:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:44:56,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301aa13dd9a95098938db HTTP/1.1" 200 None 2026-04-06 00:44:56,901 - lava_callback - INFO - Completed processing callback for node 69d301aa13dd9a95098938db 2026-04-06 00:45:03,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:03,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:45:12,800 - lava_callback - INFO - Received callback for node 69d301d013dd9a95098939a8 INFO: 172.21.0.1:51336 - "POST /node/69d301d013dd9a95098939a8 HTTP/1.0" 202 Accepted 2026-04-06 00:45:12,849 - lava_callback - INFO - Starting async job submit for node 69d301d013dd9a95098939a8 2026-04-06 00:45:12,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:12,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301d013dd9a95098939a8 HTTP/1.1" 200 None 2026-04-06 00:45:12,885 - lava_callback - DEBUG - Processing node 69d301d013dd9a95098939a8: baseline-arm-pengutronix 2026-04-06 00:45:13,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:13,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:13,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301d013dd9a95098939a8/log.txt.gz 2026-04-06 00:45:13,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:13,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:13,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301d013dd9a95098939a8/lava-logs.yaml 2026-04-06 00:45:13,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:13,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:13,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301d013dd9a95098939a8/lava_callback.json.gz 2026-04-06 00:45:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:13,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301d013dd9a95098939a8 HTTP/1.1" 200 None 2026-04-06 00:45:13,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:13,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:13,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:13,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301d013dd9a95098939a8 HTTP/1.1" 200 None 2026-04-06 00:45:13,579 - lava_callback - INFO - Completed processing callback for node 69d301d013dd9a95098939a8 2026-04-06 00:45:14,970 - lava_callback - INFO - Received callback for node 69d301bc13dd9a950989391a INFO: 172.21.0.1:51340 - "POST /node/69d301bc13dd9a950989391a HTTP/1.0" 202 Accepted 2026-04-06 00:45:14,977 - lava_callback - INFO - Starting async job submit for node 69d301bc13dd9a950989391a 2026-04-06 00:45:14,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:15,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301bc13dd9a950989391a HTTP/1.1" 200 None 2026-04-06 00:45:15,022 - lava_callback - DEBUG - Processing node 69d301bc13dd9a950989391a: baseline-arm-broonie INFO: 172.21.0.1:51342 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 00:45:15,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:15,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:15,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bc13dd9a950989391a/log.txt.gz 2026-04-06 00:45:15,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:15,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:15,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bc13dd9a950989391a/lava-logs.yaml 2026-04-06 00:45:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:15,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:15,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bc13dd9a950989391a/lava_callback.json.gz 2026-04-06 00:45:15,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:15,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301bc13dd9a950989391a HTTP/1.1" 200 None 2026-04-06 00:45:15,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:16,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:16,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301bc13dd9a950989391a HTTP/1.1" 200 None 2026-04-06 00:45:16,049 - lava_callback - INFO - Completed processing callback for node 69d301bc13dd9a950989391a INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:45:20,105 - lava_callback - INFO - Received callback for node 69d301cf13dd9a95098939a5 INFO: 172.21.0.1:39828 - "POST /node/69d301cf13dd9a95098939a5 HTTP/1.0" 202 Accepted 2026-04-06 00:45:20,112 - lava_callback - INFO - Starting async job submit for node 69d301cf13dd9a95098939a5 2026-04-06 00:45:20,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:20,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cf13dd9a95098939a5 HTTP/1.1" 200 None 2026-04-06 00:45:20,147 - lava_callback - DEBUG - Processing node 69d301cf13dd9a95098939a5: baseline-arm-pengutronix 2026-04-06 00:45:20,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:20,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:20,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cf13dd9a95098939a5/log.txt.gz 2026-04-06 00:45:20,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:20,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:20,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cf13dd9a95098939a5/lava-logs.yaml 2026-04-06 00:45:20,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:20,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:20,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cf13dd9a95098939a5/lava_callback.json.gz 2026-04-06 00:45:20,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:20,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cf13dd9a95098939a5 HTTP/1.1" 200 None 2026-04-06 00:45:20,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:20,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:20,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301cf13dd9a95098939a5 HTTP/1.1" 200 None 2026-04-06 00:45:20,999 - lava_callback - INFO - Completed processing callback for node 69d301cf13dd9a95098939a5 2026-04-06 00:45:23,424 - lava_callback - INFO - Received callback for node 69d301be13dd9a9509893920 INFO: 172.21.0.1:39844 - "POST /node/69d301be13dd9a9509893920 HTTP/1.0" 202 Accepted 2026-04-06 00:45:23,432 - lava_callback - INFO - Starting async job submit for node 69d301be13dd9a9509893920 2026-04-06 00:45:23,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:23,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301be13dd9a9509893920 HTTP/1.1" 200 None 2026-04-06 00:45:23,474 - lava_callback - DEBUG - Processing node 69d301be13dd9a9509893920: baseline-arm-broonie 2026-04-06 00:45:23,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:23,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:23,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301be13dd9a9509893920/log.txt.gz 2026-04-06 00:45:24,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:24,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:24,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301be13dd9a9509893920/lava-logs.yaml 2026-04-06 00:45:24,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:24,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:24,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301be13dd9a9509893920/lava_callback.json.gz 2026-04-06 00:45:24,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301be13dd9a9509893920 HTTP/1.1" 200 None 2026-04-06 00:45:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:24,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:24,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:24,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301be13dd9a9509893920 HTTP/1.1" 200 None 2026-04-06 00:45:24,498 - lava_callback - INFO - Completed processing callback for node 69d301be13dd9a9509893920 INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:45:32,348 - lava_callback - INFO - Received callback for node 69d301c913dd9a9509893956 INFO: 172.21.0.1:33668 - "POST /node/69d301c913dd9a9509893956 HTTP/1.0" 202 Accepted 2026-04-06 00:45:32,354 - lava_callback - INFO - Starting async job submit for node 69d301c913dd9a9509893956 2026-04-06 00:45:32,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:32,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c913dd9a9509893956 HTTP/1.1" 200 None 2026-04-06 00:45:32,391 - lava_callback - DEBUG - Processing node 69d301c913dd9a9509893956: baseline-arm-kontron 2026-04-06 00:45:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:32,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:32,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301c913dd9a9509893956/log.txt.gz 2026-04-06 00:45:32,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:33,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:33,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301c913dd9a9509893956/lava-logs.yaml 2026-04-06 00:45:33,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:33,117 - lava_callback - INFO - Received callback for node 69d301cd13dd9a950989399a INFO: 172.21.0.1:33684 - "POST /node/69d301cd13dd9a950989399a HTTP/1.0" 202 Accepted 2026-04-06 00:45:33,126 - lava_callback - INFO - Starting async job submit for node 69d301cd13dd9a950989399a 2026-04-06 00:45:33,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:33,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cd13dd9a950989399a HTTP/1.1" 200 None 2026-04-06 00:45:33,166 - lava_callback - DEBUG - Processing node 69d301cd13dd9a950989399a: baseline-arm-pengutronix 2026-04-06 00:45:33,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:33,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301c913dd9a9509893956/lava_callback.json.gz 2026-04-06 00:45:33,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:33,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c913dd9a9509893956 HTTP/1.1" 200 None 2026-04-06 00:45:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:33,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:33,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:33,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:33,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c913dd9a9509893956 HTTP/1.1" 200 None 2026-04-06 00:45:33,437 - lava_callback - INFO - Completed processing callback for node 69d301c913dd9a9509893956 2026-04-06 00:45:33,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:33,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cd13dd9a950989399a/log.txt.gz 2026-04-06 00:45:33,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:33,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:33,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cd13dd9a950989399a/lava-logs.yaml 2026-04-06 00:45:33,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:33,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:33,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 00:45:34,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:34,047 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d301cd13dd9a950989399a/lava_callback.json.gz 2026-04-06 00:45:34,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:34,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cd13dd9a950989399a HTTP/1.1" 200 None 2026-04-06 00:45:34,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:34,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:34,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:34,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301cd13dd9a950989399a HTTP/1.1" 200 None 2026-04-06 00:45:34,152 - lava_callback - INFO - Completed processing callback for node 69d301cd13dd9a950989399a 2026-04-06 00:45:35,001 - lava_callback - INFO - Received callback for node 69d301bd13dd9a950989391d INFO: 172.21.0.1:33686 - "POST /node/69d301bd13dd9a950989391d HTTP/1.0" 202 Accepted 2026-04-06 00:45:35,008 - lava_callback - INFO - Starting async job submit for node 69d301bd13dd9a950989391d 2026-04-06 00:45:35,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:35,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301bd13dd9a950989391d HTTP/1.1" 200 None 2026-04-06 00:45:35,049 - lava_callback - DEBUG - Processing node 69d301bd13dd9a950989391d: baseline-arm-broonie 2026-04-06 00:45:35,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:35,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:35,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bd13dd9a950989391d/log.txt.gz 2026-04-06 00:45:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:35,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:35,832 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bd13dd9a950989391d/lava-logs.yaml 2026-04-06 00:45:35,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:35,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:35,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d301bd13dd9a950989391d/lava_callback.json.gz 2026-04-06 00:45:35,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:36,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301bd13dd9a950989391d HTTP/1.1" 200 None 2026-04-06 00:45:36,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:36,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:36,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:36,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301bd13dd9a950989391d HTTP/1.1" 200 None 2026-04-06 00:45:36,064 - lava_callback - INFO - Completed processing callback for node 69d301bd13dd9a950989391d INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:45:52,310 - lava_callback - INFO - Received callback for node 69d301cb13dd9a9509893959 INFO: 172.21.0.1:43092 - "POST /node/69d301cb13dd9a9509893959 HTTP/1.0" 202 Accepted 2026-04-06 00:45:52,320 - lava_callback - INFO - Starting async job submit for node 69d301cb13dd9a9509893959 2026-04-06 00:45:52,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:52,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cb13dd9a9509893959 HTTP/1.1" 200 None 2026-04-06 00:45:52,368 - lava_callback - DEBUG - Processing node 69d301cb13dd9a9509893959: baseline-arm-kontron 2026-04-06 00:45:52,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:53,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:53,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301cb13dd9a9509893959/log.txt.gz 2026-04-06 00:45:53,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:53,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:53,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301cb13dd9a9509893959/lava-logs.yaml 2026-04-06 00:45:53,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:45:53,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:45:53,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d301cb13dd9a9509893959/lava_callback.json.gz 2026-04-06 00:45:53,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:54,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301cb13dd9a9509893959 HTTP/1.1" 200 None 2026-04-06 00:45:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:54,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:45:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:45:54,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301cb13dd9a9509893959 HTTP/1.1" 200 None 2026-04-06 00:45:54,083 - lava_callback - INFO - Completed processing callback for node 69d301cb13dd9a9509893959 INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:03,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:03,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:23,606 - lava_callback - INFO - Received callback for node 69d3023713dd9a9509893acf INFO: 172.21.0.1:46368 - "POST /node/69d3023713dd9a9509893acf HTTP/1.0" 202 Accepted 2026-04-06 00:46:23,615 - lava_callback - INFO - Starting async job submit for node 69d3023713dd9a9509893acf 2026-04-06 00:46:23,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:23,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023713dd9a9509893acf HTTP/1.1" 200 None 2026-04-06 00:46:23,679 - lava_callback - DEBUG - Processing node 69d3023713dd9a9509893acf: baseline-x86 2026-04-06 00:46:23,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:24,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:24,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023713dd9a9509893acf/log.txt.gz 2026-04-06 00:46:24,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:24,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:24,818 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023713dd9a9509893acf/lava-logs.yaml 2026-04-06 00:46:24,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:25,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:25,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023713dd9a9509893acf/lava_callback.json.gz 2026-04-06 00:46:25,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:25,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023713dd9a9509893acf HTTP/1.1" 200 None 2026-04-06 00:46:25,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:25,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbbb13dd9a95098934f5 HTTP/1.1" 200 None 2026-04-06 00:46:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:25,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3023713dd9a9509893acf HTTP/1.1" 200 None 2026-04-06 00:46:25,145 - lava_callback - INFO - Completed processing callback for node 69d3023713dd9a9509893acf INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:33,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:33,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:44,820 - lava_callback - INFO - Received callback for node 69d3026013dd9a9509893b05 INFO: 172.21.0.1:48508 - "POST /node/69d3026013dd9a9509893b05 HTTP/1.0" 202 Accepted 2026-04-06 00:46:44,829 - lava_callback - INFO - Starting async job submit for node 69d3026013dd9a9509893b05 2026-04-06 00:46:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:44,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3026013dd9a9509893b05 HTTP/1.1" 200 None 2026-04-06 00:46:44,858 - lava_callback - DEBUG - Processing node 69d3026013dd9a9509893b05: baseline-arm 2026-04-06 00:46:44,866 - lava_callback - WARNING - Failed to upload log 2026-04-06 00:46:44,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:45,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:45,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d3026013dd9a9509893b05/lava-logs.yaml 2026-04-06 00:46:45,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:45,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:45,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d3026013dd9a9509893b05/lava_callback.json.gz 2026-04-06 00:46:45,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:45,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3026013dd9a9509893b05 HTTP/1.1" 200 None 2026-04-06 00:46:45,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:45,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:46:45,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:45,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3026013dd9a9509893b05 HTTP/1.1" 200 None 2026-04-06 00:46:45,536 - lava_callback - INFO - Completed processing callback for node 69d3026013dd9a9509893b05 INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:55,173 - lava_callback - INFO - Received callback for node 69d3023513dd9a9509893ac9 INFO: 172.21.0.1:55632 - "POST /node/69d3023513dd9a9509893ac9 HTTP/1.0" 202 Accepted 2026-04-06 00:46:55,180 - lava_callback - INFO - Starting async job submit for node 69d3023513dd9a9509893ac9 2026-04-06 00:46:55,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:55,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023513dd9a9509893ac9 HTTP/1.1" 200 None 2026-04-06 00:46:55,214 - lava_callback - DEBUG - Processing node 69d3023513dd9a9509893ac9: baseline-x86 2026-04-06 00:46:55,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:55,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:55,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023513dd9a9509893ac9/log.txt.gz 2026-04-06 00:46:56,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:56,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:56,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023513dd9a9509893ac9/lava-logs.yaml 2026-04-06 00:46:56,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:46:56,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:56,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023513dd9a9509893ac9/lava_callback.json.gz 2026-04-06 00:46:56,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:56,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023513dd9a9509893ac9 HTTP/1.1" 200 None 2026-04-06 00:46:56,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:56,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbbb13dd9a95098934f5 HTTP/1.1" 200 None 2026-04-06 00:46:56,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:56,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3023513dd9a9509893ac9 HTTP/1.1" 200 None 2026-04-06 00:46:56,853 - lava_callback - INFO - Completed processing callback for node 69d3023513dd9a9509893ac9 2026-04-06 00:46:57,360 - lava_callback - INFO - Received callback for node 69d3023613dd9a9509893acc INFO: 172.21.0.1:55656 - "POST /node/69d3023613dd9a9509893acc HTTP/1.0" 202 Accepted 2026-04-06 00:46:57,372 - lava_callback - INFO - Starting async job submit for node 69d3023613dd9a9509893acc 2026-04-06 00:46:57,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:57,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023613dd9a9509893acc HTTP/1.1" 200 None 2026-04-06 00:46:57,439 - lava_callback - DEBUG - Processing node 69d3023613dd9a9509893acc: baseline-x86 2026-04-06 00:46:57,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:58,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:58,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023613dd9a9509893acc/log.txt.gz 2026-04-06 00:46:58,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:58,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:58,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023613dd9a9509893acc/lava-logs.yaml 2026-04-06 00:46:58,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:46:59,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:46:59,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023613dd9a9509893acc/lava_callback.json.gz 2026-04-06 00:46:59,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:59,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023613dd9a9509893acc HTTP/1.1" 200 None 2026-04-06 00:46:59,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:59,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbbb13dd9a95098934f5 HTTP/1.1" 200 None 2026-04-06 00:46:59,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:46:59,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3023613dd9a9509893acc HTTP/1.1" 200 None 2026-04-06 00:46:59,290 - lava_callback - INFO - Completed processing callback for node 69d3023613dd9a9509893acc 2026-04-06 00:47:03,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:04,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39070 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:47:13,035 - lava_callback - INFO - Received callback for node 69d3023413dd9a9509893ac6 INFO: 172.21.0.1:48392 - "POST /node/69d3023413dd9a9509893ac6 HTTP/1.0" 202 Accepted 2026-04-06 00:47:13,045 - lava_callback - INFO - Starting async job submit for node 69d3023413dd9a9509893ac6 2026-04-06 00:47:13,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:13,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023413dd9a9509893ac6 HTTP/1.1" 200 None 2026-04-06 00:47:13,109 - lava_callback - DEBUG - Processing node 69d3023413dd9a9509893ac6: baseline-x86 2026-04-06 00:47:13,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:47:13,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:47:13,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023413dd9a9509893ac6/log.txt.gz 2026-04-06 00:47:14,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:47:14,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:47:14,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023413dd9a9509893ac6/lava-logs.yaml 2026-04-06 00:47:14,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:47:14,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:47:14,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023413dd9a9509893ac6/lava_callback.json.gz 2026-04-06 00:47:14,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:14,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023413dd9a9509893ac6 HTTP/1.1" 200 None 2026-04-06 00:47:14,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:14,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbbb13dd9a95098934f5 HTTP/1.1" 200 None 2026-04-06 00:47:14,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:14,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3023413dd9a9509893ac6 HTTP/1.1" 200 None 2026-04-06 00:47:14,728 - lava_callback - INFO - Completed processing callback for node 69d3023413dd9a9509893ac6 INFO: 172.21.0.1:48402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:47:34,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:47:34,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:48:22,938 - lava_callback - INFO - Received callback for node 69d301e313dd9a9509893a10 INFO: 172.21.0.1:39140 - "POST /node/69d301e313dd9a9509893a10 HTTP/1.0" 202 Accepted 2026-04-06 00:48:22,945 - lava_callback - INFO - Starting async job submit for node 69d301e313dd9a9509893a10 2026-04-06 00:48:22,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:22,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e313dd9a9509893a10 HTTP/1.1" 200 None 2026-04-06 00:48:22,988 - lava_callback - DEBUG - Processing node 69d301e313dd9a9509893a10: ltp-fs_bind 2026-04-06 00:48:23,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:23,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:23,979 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d301e313dd9a9509893a10/log.txt.gz 2026-04-06 00:48:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:24,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:24,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d301e313dd9a9509893a10/lava-logs.yaml 2026-04-06 00:48:24,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:25,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:25,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d301e313dd9a9509893a10/lava_callback.json.gz 2026-04-06 00:48:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:25,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e313dd9a9509893a10 HTTP/1.1" 200 None 2026-04-06 00:48:25,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:25,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:48:25,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:25,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301e313dd9a9509893a10 HTTP/1.1" 200 None 2026-04-06 00:48:25,733 - lava_callback - INFO - Completed processing callback for node 69d301e313dd9a9509893a10 INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:48:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:34,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:48:35,106 - lava_callback - INFO - Received callback for node 69d301e613dd9a9509893a17 INFO: 172.21.0.1:48592 - "POST /node/69d301e613dd9a9509893a17 HTTP/1.0" 202 Accepted 2026-04-06 00:48:35,116 - lava_callback - INFO - Starting async job submit for node 69d301e613dd9a9509893a17 2026-04-06 00:48:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:35,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e613dd9a9509893a17 HTTP/1.1" 200 None 2026-04-06 00:48:35,179 - lava_callback - DEBUG - Processing node 69d301e613dd9a9509893a17: ltp-input 2026-04-06 00:48:35,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:35,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:35,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d301e613dd9a9509893a17/log.txt.gz 2026-04-06 00:48:36,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48600 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:48:36,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:36,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d301e613dd9a9509893a17/lava-logs.yaml 2026-04-06 00:48:36,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:36,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:36,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d301e613dd9a9509893a17/lava_callback.json.gz 2026-04-06 00:48:36,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:36,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e613dd9a9509893a17 HTTP/1.1" 200 None 2026-04-06 00:48:36,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:36,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:48:36,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:36,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301e613dd9a9509893a17 HTTP/1.1" 200 None 2026-04-06 00:48:36,917 - lava_callback - INFO - Completed processing callback for node 69d301e613dd9a9509893a17 2026-04-06 00:48:43,069 - lava_callback - INFO - Received callback for node 69d301ed13dd9a9509893a4f INFO: 172.21.0.1:39242 - "POST /node/69d301ed13dd9a9509893a4f HTTP/1.0" 202 Accepted 2026-04-06 00:48:43,080 - lava_callback - INFO - Starting async job submit for node 69d301ed13dd9a9509893a4f 2026-04-06 00:48:43,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:43,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ed13dd9a9509893a4f HTTP/1.1" 200 None 2026-04-06 00:48:43,159 - lava_callback - DEBUG - Processing node 69d301ed13dd9a9509893a4f: ltp-syscalls 2026-04-06 00:48:44,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:44,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:44,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d301ed13dd9a9509893a4f/log.txt.gz 2026-04-06 00:48:44,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:45,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:45,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d301ed13dd9a9509893a4f/lava-logs.yaml 2026-04-06 00:48:45,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:48:45,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:48:45,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d301ed13dd9a9509893a4f/lava_callback.json.gz 2026-04-06 00:48:45,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:45,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ed13dd9a9509893a4f HTTP/1.1" 200 None 2026-04-06 00:48:45,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:45,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:48:45,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:48:45,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ed13dd9a9509893a4f HTTP/1.1" 200 None 2026-04-06 00:48:45,773 - lava_callback - INFO - Completed processing callback for node 69d301ed13dd9a9509893a4f INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33736 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:49:02,883 - lava_callback - INFO - Received callback for node 69d301e713dd9a9509893a1a INFO: 172.21.0.1:52496 - "POST /node/69d301e713dd9a9509893a1a HTTP/1.0" 202 Accepted 2026-04-06 00:49:02,892 - lava_callback - INFO - Starting async job submit for node 69d301e713dd9a9509893a1a 2026-04-06 00:49:02,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:02,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e713dd9a9509893a1a HTTP/1.1" 200 None 2026-04-06 00:49:02,968 - lava_callback - DEBUG - Processing node 69d301e713dd9a9509893a1a: ltp-ipc 2026-04-06 00:49:03,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:49:03,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:49:03,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d301e713dd9a9509893a1a/log.txt.gz 2026-04-06 00:49:04,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:04,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:49:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:49:04,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:49:04,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d301e713dd9a9509893a1a/lava-logs.yaml 2026-04-06 00:49:04,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:49:04,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:49:04,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d301e713dd9a9509893a1a/lava_callback.json.gz 2026-04-06 00:49:04,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:04,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e713dd9a9509893a1a HTTP/1.1" 200 None 2026-04-06 00:49:04,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:04,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:49:04,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:04,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301e713dd9a9509893a1a HTTP/1.1" 200 None 2026-04-06 00:49:04,920 - lava_callback - INFO - Completed processing callback for node 69d301e713dd9a9509893a1a INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:49:34,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:34,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:49:48,969 - lava_callback - INFO - Received callback for node 69d06019d2be3e1cf2a5aef7 INFO: 172.21.0.1:59598 - "POST /node/69d06019d2be3e1cf2a5aef7 HTTP/1.0" 202 Accepted 2026-04-06 00:49:48,975 - lava_callback - INFO - Starting async job submit for node 69d06019d2be3e1cf2a5aef7 2026-04-06 00:49:48,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:48,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06019d2be3e1cf2a5aef7 HTTP/1.1" 200 None 2026-04-06 00:49:48,992 - lava_callback - DEBUG - Processing node 69d06019d2be3e1cf2a5aef7: baseline-arm-baylibre 2026-04-06 00:49:48,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06019d2be3e1cf2a5aef7 2026-04-06 00:49:48,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:49,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06019d2be3e1cf2a5aef7 HTTP/1.1" 200 None 2026-04-06 00:49:49,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:49,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 00:49:49,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:49:49,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06019d2be3e1cf2a5aef7 HTTP/1.1" 200 None 2026-04-06 00:49:49,049 - lava_callback - ERROR - Error processing callback for node 69d06019d2be3e1cf2a5aef7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:50:49,025 - lava_callback - INFO - Received callback for node 69d06064d2be3e1cf2a5af23 INFO: 172.21.0.1:60672 - "POST /node/69d06064d2be3e1cf2a5af23 HTTP/1.0" 202 Accepted 2026-04-06 00:50:49,033 - lava_callback - INFO - Starting async job submit for node 69d06064d2be3e1cf2a5af23 2026-04-06 00:50:49,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:50:49,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06064d2be3e1cf2a5af23 HTTP/1.1" 200 None 2026-04-06 00:50:49,060 - lava_callback - DEBUG - Processing node 69d06064d2be3e1cf2a5af23: baseline-arm-baylibre 2026-04-06 00:50:49,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06064d2be3e1cf2a5af23 2026-04-06 00:50:49,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:50:49,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06064d2be3e1cf2a5af23 HTTP/1.1" 200 None 2026-04-06 00:50:49,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:50:49,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 00:50:49,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:50:49,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06064d2be3e1cf2a5af23 HTTP/1.1" 200 None 2026-04-06 00:50:49,193 - lava_callback - ERROR - Error processing callback for node 69d06064d2be3e1cf2a5af23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:51:03,013 - lava_callback - INFO - Received callback for node 69d301e913dd9a9509893a1d INFO: 172.21.0.1:37562 - "POST /node/69d301e913dd9a9509893a1d HTTP/1.0" 202 Accepted 2026-04-06 00:51:03,028 - lava_callback - INFO - Starting async job submit for node 69d301e913dd9a9509893a1d 2026-04-06 00:51:03,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:03,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e913dd9a9509893a1d HTTP/1.1" 200 None 2026-04-06 00:51:03,126 - lava_callback - DEBUG - Processing node 69d301e913dd9a9509893a1d: ltp-pty 2026-04-06 00:51:03,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:51:04,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:04,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d301e913dd9a9509893a1d/log.txt.gz 2026-04-06 00:51:04,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:51:04,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:05,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d301e913dd9a9509893a1d/lava-logs.yaml 2026-04-06 00:51:05,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:51:05,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:05,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d301e913dd9a9509893a1d/lava_callback.json.gz 2026-04-06 00:51:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:05,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e913dd9a9509893a1d HTTP/1.1" 200 None 2026-04-06 00:51:05,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:05,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:51:05,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:05,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301e913dd9a9509893a1d HTTP/1.1" 200 None 2026-04-06 00:51:05,666 - lava_callback - INFO - Completed processing callback for node 69d301e913dd9a9509893a1d INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 00:51:15,375 - lava_callback - INFO - Received callback for node 69d2ff4c13dd9a95098938b2 INFO: 172.21.0.1:58892 - "POST /node/69d2ff4c13dd9a95098938b2 HTTP/1.0" 202 Accepted 2026-04-06 00:51:15,387 - lava_callback - INFO - Starting async job submit for node 69d2ff4c13dd9a95098938b2 2026-04-06 00:51:15,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:15,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2ff4c13dd9a95098938b2 HTTP/1.1" 200 None 2026-04-06 00:51:15,530 - lava_callback - DEBUG - Processing node 69d2ff4c13dd9a95098938b2: ltp-smoke 2026-04-06 00:51:16,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:51:16,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:16,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d2ff4c13dd9a95098938b2/log.txt.gz 2026-04-06 00:51:17,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:51:18,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:18,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d2ff4c13dd9a95098938b2/lava-logs.yaml 2026-04-06 00:51:18,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:51:19,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:51:19,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d2ff4c13dd9a95098938b2/lava_callback.json.gz 2026-04-06 00:51:19,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:19,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2ff4c13dd9a95098938b2 HTTP/1.1" 200 None 2026-04-06 00:51:19,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:19,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fba213dd9a95098934cf HTTP/1.1" 200 None 2026-04-06 00:51:19,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2ff4c13dd9a95098938b2 HTTP/1.1" 200 None 2026-04-06 00:51:19,849 - lava_callback - INFO - Completed processing callback for node 69d2ff4c13dd9a95098938b2 INFO: 172.21.0.1:59248 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:51:34,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:34,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:51:49,140 - lava_callback - INFO - Received callback for node 69d060a2d2be3e1cf2a5af68 INFO: 172.21.0.1:43088 - "POST /node/69d060a2d2be3e1cf2a5af68 HTTP/1.0" 202 Accepted 2026-04-06 00:51:49,150 - lava_callback - INFO - Starting async job submit for node 69d060a2d2be3e1cf2a5af68 2026-04-06 00:51:49,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:51:49,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060a2d2be3e1cf2a5af68 HTTP/1.1" 200 None 2026-04-06 00:51:49,186 - lava_callback - DEBUG - Processing node 69d060a2d2be3e1cf2a5af68: baseline-arm-baylibre 2026-04-06 00:51:49,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d060a2d2be3e1cf2a5af68 2026-04-06 00:51:49,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:49,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060a2d2be3e1cf2a5af68 HTTP/1.1" 200 None 2026-04-06 00:51:49,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:49,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:51:49,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:51:49,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d060a2d2be3e1cf2a5af68 HTTP/1.1" 200 None 2026-04-06 00:51:49,300 - lava_callback - ERROR - Error processing callback for node 69d060a2d2be3e1cf2a5af68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:52:23,024 - lava_callback - INFO - Received callback for node 69d301ec13dd9a9509893a26 INFO: 172.21.0.1:45840 - "POST /node/69d301ec13dd9a9509893a26 HTTP/1.0" 202 Accepted 2026-04-06 00:52:23,037 - lava_callback - INFO - Starting async job submit for node 69d301ec13dd9a9509893a26 2026-04-06 00:52:23,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:23,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ec13dd9a9509893a26 HTTP/1.1" 200 None 2026-04-06 00:52:23,128 - lava_callback - DEBUG - Processing node 69d301ec13dd9a9509893a26: ltp-smoke 2026-04-06 00:52:23,400 - lava_callback - INFO - Received callback for node 69d303b213dd9a9509893c90 INFO: 172.21.0.1:45848 - "POST /node/69d303b213dd9a9509893c90 HTTP/1.0" 202 Accepted 2026-04-06 00:52:23,421 - lava_callback - INFO - Starting async job submit for node 69d303b213dd9a9509893c90 2026-04-06 00:52:23,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:23,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b213dd9a9509893c90 HTTP/1.1" 200 None 2026-04-06 00:52:23,557 - lava_callback - DEBUG - Processing node 69d303b213dd9a9509893c90: baseline-arm64 2026-04-06 00:52:24,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:24,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:24,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d301ec13dd9a9509893a26/log.txt.gz 2026-04-06 00:52:24,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:24,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c90/log.txt.gz 2026-04-06 00:52:24,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:25,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:25,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:25,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c90/lava-logs.yaml 2026-04-06 00:52:25,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:26,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:26,152 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d301ec13dd9a9509893a26/lava-logs.yaml 2026-04-06 00:52:26,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:26,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:26,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c90/lava_callback.json.gz 2026-04-06 00:52:26,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b213dd9a9509893c90 HTTP/1.1" 200 None 2026-04-06 00:52:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:52:26,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b213dd9a9509893c90 HTTP/1.1" 200 None 2026-04-06 00:52:26,520 - lava_callback - INFO - Completed processing callback for node 69d303b213dd9a9509893c90 INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:52:26,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:26,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d301ec13dd9a9509893a26/lava_callback.json.gz 2026-04-06 00:52:26,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ec13dd9a9509893a26 HTTP/1.1" 200 None 2026-04-06 00:52:26,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:52:26,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:26,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ec13dd9a9509893a26 HTTP/1.1" 200 None 2026-04-06 00:52:26,785 - lava_callback - INFO - Completed processing callback for node 69d301ec13dd9a9509893a26 2026-04-06 00:52:29,096 - lava_callback - INFO - Received callback for node 69d060c5d2be3e1cf2a5af88 INFO: 172.21.0.1:45870 - "POST /node/69d060c5d2be3e1cf2a5af88 HTTP/1.0" 202 Accepted 2026-04-06 00:52:29,105 - lava_callback - INFO - Starting async job submit for node 69d060c5d2be3e1cf2a5af88 2026-04-06 00:52:29,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:29,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060c5d2be3e1cf2a5af88 HTTP/1.1" 200 None 2026-04-06 00:52:29,133 - lava_callback - DEBUG - Processing node 69d060c5d2be3e1cf2a5af88: baseline-arm-baylibre 2026-04-06 00:52:29,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d060c5d2be3e1cf2a5af88 2026-04-06 00:52:29,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:29,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060c5d2be3e1cf2a5af88 HTTP/1.1" 200 None 2026-04-06 00:52:29,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:29,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:52:29,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:29,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d060c5d2be3e1cf2a5af88 HTTP/1.1" 200 None 2026-04-06 00:52:29,232 - lava_callback - ERROR - Error processing callback for node 69d060c5d2be3e1cf2a5af88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:52:34,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:34,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:52:35,186 - lava_callback - INFO - Received callback for node 69d301ea13dd9a9509893a23 INFO: 172.21.0.1:33464 - "POST /node/69d301ea13dd9a9509893a23 HTTP/1.0" 202 Accepted 2026-04-06 00:52:35,196 - lava_callback - INFO - Starting async job submit for node 69d301ea13dd9a9509893a23 2026-04-06 00:52:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:35,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ea13dd9a9509893a23 HTTP/1.1" 200 None 2026-04-06 00:52:35,278 - lava_callback - DEBUG - Processing node 69d301ea13dd9a9509893a23: ltp-sched 2026-04-06 00:52:36,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:36,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:36,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d301ea13dd9a9509893a23/log.txt.gz INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:52:36,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:37,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:37,437 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d301ea13dd9a9509893a23/lava-logs.yaml 2026-04-06 00:52:37,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:37,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:37,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d301ea13dd9a9509893a23/lava_callback.json.gz 2026-04-06 00:52:37,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:37,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ea13dd9a9509893a23 HTTP/1.1" 200 None 2026-04-06 00:52:37,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:38,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:52:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:38,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ea13dd9a9509893a23 HTTP/1.1" 200 None 2026-04-06 00:52:38,081 - lava_callback - INFO - Completed processing callback for node 69d301ea13dd9a9509893a23 INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:52:55,238 - lava_callback - INFO - Received callback for node 69d2ff4e13dd9a95098938b5 INFO: 172.21.0.1:50676 - "POST /node/69d2ff4e13dd9a95098938b5 HTTP/1.0" 202 Accepted 2026-04-06 00:52:55,250 - lava_callback - INFO - Starting async job submit for node 69d2ff4e13dd9a95098938b5 2026-04-06 00:52:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:55,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2ff4e13dd9a95098938b5 HTTP/1.1" 200 None 2026-04-06 00:52:55,342 - lava_callback - DEBUG - Processing node 69d2ff4e13dd9a95098938b5: baseline-arm 2026-04-06 00:52:55,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:56,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:56,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d2ff4e13dd9a95098938b5/log.txt.gz 2026-04-06 00:52:56,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:52:56,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:56,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d2ff4e13dd9a95098938b5/lava-logs.yaml 2026-04-06 00:52:56,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:52:57,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:52:57,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d2ff4e13dd9a95098938b5/lava_callback.json.gz 2026-04-06 00:52:57,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:57,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2ff4e13dd9a95098938b5 HTTP/1.1" 200 None 2026-04-06 00:52:57,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:57,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fba213dd9a95098934cf HTTP/1.1" 200 None 2026-04-06 00:52:57,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:52:57,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2ff4e13dd9a95098938b5 HTTP/1.1" 200 None 2026-04-06 00:52:57,437 - lava_callback - INFO - Completed processing callback for node 69d2ff4e13dd9a95098938b5 2026-04-06 00:53:04,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:04,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:53:06,238 - lava_callback - INFO - Received callback for node 69d303d313dd9a9509893d29 INFO: 172.21.0.1:39054 - "POST /node/69d303d313dd9a9509893d29 HTTP/1.0" 202 Accepted 2026-04-06 00:53:06,244 - lava_callback - INFO - Starting async job submit for node 69d303d313dd9a9509893d29 2026-04-06 00:53:06,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:06,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d313dd9a9509893d29 HTTP/1.1" 200 None 2026-04-06 00:53:06,270 - lava_callback - DEBUG - Processing node 69d303d313dd9a9509893d29: baseline-nfs-arm64 2026-04-06 00:53:06,272 - lava_callback - WARNING - Failed to upload log 2026-04-06 00:53:06,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:06,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:06,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d313dd9a9509893d29/lava-logs.yaml 2026-04-06 00:53:06,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:06,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:06,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d313dd9a9509893d29/lava_callback.json.gz 2026-04-06 00:53:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:53:06,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d313dd9a9509893d29 HTTP/1.1" 200 None 2026-04-06 00:53:06,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:53:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:06,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d313dd9a9509893d29 HTTP/1.1" 200 None 2026-04-06 00:53:06,596 - lava_callback - INFO - Completed processing callback for node 69d303d313dd9a9509893d29 2026-04-06 00:53:07,371 - lava_callback - INFO - Received callback for node 69d303b313dd9a9509893c96 INFO: 172.21.0.1:39076 - "POST /node/69d303b313dd9a9509893c96 HTTP/1.0" 202 Accepted 2026-04-06 00:53:07,377 - lava_callback - INFO - Starting async job submit for node 69d303b313dd9a9509893c96 2026-04-06 00:53:07,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:07,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b313dd9a9509893c96 HTTP/1.1" 200 None 2026-04-06 00:53:07,415 - lava_callback - DEBUG - Processing node 69d303b313dd9a9509893c96: baseline-arm64 2026-04-06 00:53:07,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:07,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:07,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b313dd9a9509893c96/log.txt.gz 2026-04-06 00:53:08,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:08,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:08,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b313dd9a9509893c96/lava-logs.yaml 2026-04-06 00:53:08,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:08,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:08,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b313dd9a9509893c96/lava_callback.json.gz 2026-04-06 00:53:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:08,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b313dd9a9509893c96 HTTP/1.1" 200 None 2026-04-06 00:53:08,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:08,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:53:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:08,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b313dd9a9509893c96 HTTP/1.1" 200 None 2026-04-06 00:53:08,584 - lava_callback - INFO - Completed processing callback for node 69d303b313dd9a9509893c96 2026-04-06 00:53:09,186 - lava_callback - INFO - Received callback for node 69d060ead2be3e1cf2a5afc1 INFO: 172.21.0.1:39078 - "POST /node/69d060ead2be3e1cf2a5afc1 HTTP/1.0" 202 Accepted 2026-04-06 00:53:09,191 - lava_callback - INFO - Starting async job submit for node 69d060ead2be3e1cf2a5afc1 2026-04-06 00:53:09,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:09,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060ead2be3e1cf2a5afc1 HTTP/1.1" 200 None 2026-04-06 00:53:09,206 - lava_callback - DEBUG - Processing node 69d060ead2be3e1cf2a5afc1: baseline-arm-baylibre 2026-04-06 00:53:09,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d060ead2be3e1cf2a5afc1 2026-04-06 00:53:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:09,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d060ead2be3e1cf2a5afc1 HTTP/1.1" 200 None 2026-04-06 00:53:09,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:09,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:53:09,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:09,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d060ead2be3e1cf2a5afc1 HTTP/1.1" 200 None 2026-04-06 00:53:09,274 - lava_callback - ERROR - Error processing callback for node 69d060ead2be3e1cf2a5afc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:53:09,484 - lava_callback - INFO - Received callback for node 69d303c013dd9a9509893cb1 INFO: 172.21.0.1:39080 - "POST /node/69d303c013dd9a9509893cb1 HTTP/1.0" 202 Accepted 2026-04-06 00:53:09,490 - lava_callback - INFO - Starting async job submit for node 69d303c013dd9a9509893cb1 2026-04-06 00:53:09,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:09,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c013dd9a9509893cb1 HTTP/1.1" 200 None 2026-04-06 00:53:09,524 - lava_callback - DEBUG - Processing node 69d303c013dd9a9509893cb1: baseline-arm64 2026-04-06 00:53:09,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:09,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:09,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c013dd9a9509893cb1/log.txt.gz 2026-04-06 00:53:09,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:10,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:10,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c013dd9a9509893cb1/lava-logs.yaml 2026-04-06 00:53:10,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:10,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:10,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c013dd9a9509893cb1/lava_callback.json.gz 2026-04-06 00:53:10,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:10,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c013dd9a9509893cb1 HTTP/1.1" 200 None 2026-04-06 00:53:10,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:10,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:53:10,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:10,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c013dd9a9509893cb1 HTTP/1.1" 200 None 2026-04-06 00:53:10,365 - lava_callback - INFO - Completed processing callback for node 69d303c013dd9a9509893cb1 INFO: 172.21.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:53:24,093 - lava_callback - INFO - Received callback for node 69d301ef13dd9a9509893a52 INFO: 172.21.0.1:48040 - "POST /node/69d301ef13dd9a9509893a52 HTTP/1.0" 202 Accepted 2026-04-06 00:53:24,100 - lava_callback - INFO - Starting async job submit for node 69d301ef13dd9a9509893a52 2026-04-06 00:53:24,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:24,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ef13dd9a9509893a52 HTTP/1.1" 200 None 2026-04-06 00:53:24,141 - lava_callback - DEBUG - Processing node 69d301ef13dd9a9509893a52: ltp-syscalls-ipc 2026-04-06 00:53:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:24,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:24,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d301ef13dd9a9509893a52/log.txt.gz 2026-04-06 00:53:25,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:25,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:25,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d301ef13dd9a9509893a52/lava-logs.yaml 2026-04-06 00:53:25,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:25,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:25,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d301ef13dd9a9509893a52/lava_callback.json.gz 2026-04-06 00:53:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:25,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ef13dd9a9509893a52 HTTP/1.1" 200 None 2026-04-06 00:53:25,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:53:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:25,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ef13dd9a9509893a52 HTTP/1.1" 200 None 2026-04-06 00:53:25,648 - lava_callback - INFO - Completed processing callback for node 69d301ef13dd9a9509893a52 INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:53:34,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:34,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:53:49,158 - lava_callback - INFO - Received callback for node 69d0610cd2be3e1cf2a5afea INFO: 172.21.0.1:39086 - "POST /node/69d0610cd2be3e1cf2a5afea HTTP/1.0" 202 Accepted 2026-04-06 00:53:49,164 - lava_callback - INFO - Starting async job submit for node 69d0610cd2be3e1cf2a5afea 2026-04-06 00:53:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:49,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0610cd2be3e1cf2a5afea HTTP/1.1" 200 None 2026-04-06 00:53:49,179 - lava_callback - DEBUG - Processing node 69d0610cd2be3e1cf2a5afea: baseline-arm-baylibre 2026-04-06 00:53:49,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0610cd2be3e1cf2a5afea 2026-04-06 00:53:49,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:53:49,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0610cd2be3e1cf2a5afea HTTP/1.1" 200 None 2026-04-06 00:53:49,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:49,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:53:49,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:49,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0610cd2be3e1cf2a5afea HTTP/1.1" 200 None 2026-04-06 00:53:49,240 - lava_callback - ERROR - Error processing callback for node 69d0610cd2be3e1cf2a5afea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:53:50,454 - lava_callback - INFO - Received callback for node 69d303b213dd9a9509893c93 INFO: 172.21.0.1:57854 - "POST /node/69d303b213dd9a9509893c93 HTTP/1.0" 202 Accepted 2026-04-06 00:53:50,460 - lava_callback - INFO - Starting async job submit for node 69d303b213dd9a9509893c93 2026-04-06 00:53:50,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:50,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b213dd9a9509893c93 HTTP/1.1" 200 None 2026-04-06 00:53:50,503 - lava_callback - DEBUG - Processing node 69d303b213dd9a9509893c93: baseline-arm64 2026-04-06 00:53:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:50,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:50,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c93/log.txt.gz 2026-04-06 00:53:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:51,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:51,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c93/lava-logs.yaml 2026-04-06 00:53:51,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:53:51,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:53:51,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b213dd9a9509893c93/lava_callback.json.gz 2026-04-06 00:53:51,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:51,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b213dd9a9509893c93 HTTP/1.1" 200 None 2026-04-06 00:53:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:53:51,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:53:51,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b213dd9a9509893c93 HTTP/1.1" 200 None 2026-04-06 00:53:51,487 - lava_callback - INFO - Completed processing callback for node 69d303b213dd9a9509893c93 INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:54:04,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:04,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:54:19,368 - lava_callback - INFO - Received callback for node 69d3040513dd9a9509893e09 INFO: 172.21.0.1:40334 - "POST /node/69d3040513dd9a9509893e09 HTTP/1.0" 202 Accepted 2026-04-06 00:54:19,375 - lava_callback - INFO - Starting async job submit for node 69d3040513dd9a9509893e09 2026-04-06 00:54:19,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:19,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040513dd9a9509893e09 HTTP/1.1" 200 None 2026-04-06 00:54:19,416 - lava_callback - DEBUG - Processing node 69d3040513dd9a9509893e09: baseline-arm64-foundriesio 2026-04-06 00:54:19,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:19,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:19,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040513dd9a9509893e09/log.txt.gz 2026-04-06 00:54:19,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:20,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:20,162 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040513dd9a9509893e09/lava-logs.yaml 2026-04-06 00:54:20,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:20,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:20,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040513dd9a9509893e09/lava_callback.json.gz 2026-04-06 00:54:20,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:20,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040513dd9a9509893e09 HTTP/1.1" 200 None 2026-04-06 00:54:20,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:20,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:20,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:20,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040513dd9a9509893e09 HTTP/1.1" 200 None 2026-04-06 00:54:20,432 - lava_callback - INFO - Completed processing callback for node 69d3040513dd9a9509893e09 INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:54:29,185 - lava_callback - INFO - Received callback for node 69d06131d2be3e1cf2a5b012 INFO: 172.21.0.1:50236 - "POST /node/69d06131d2be3e1cf2a5b012 HTTP/1.0" 202 Accepted 2026-04-06 00:54:29,191 - lava_callback - INFO - Starting async job submit for node 69d06131d2be3e1cf2a5b012 2026-04-06 00:54:29,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:29,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06131d2be3e1cf2a5b012 HTTP/1.1" 200 None 2026-04-06 00:54:29,224 - lava_callback - DEBUG - Processing node 69d06131d2be3e1cf2a5b012: baseline-arm-baylibre 2026-04-06 00:54:29,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06131d2be3e1cf2a5b012 2026-04-06 00:54:29,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:29,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06131d2be3e1cf2a5b012 HTTP/1.1" 200 None 2026-04-06 00:54:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:29,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:54:29,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:29,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06131d2be3e1cf2a5b012 HTTP/1.1" 200 None 2026-04-06 00:54:29,291 - lava_callback - ERROR - Error processing callback for node 69d06131d2be3e1cf2a5b012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:54:32,561 - lava_callback - INFO - Received callback for node 69d3040213dd9a9509893e03 INFO: 172.21.0.1:34976 - "POST /node/69d3040213dd9a9509893e03 HTTP/1.0" 202 Accepted 2026-04-06 00:54:32,567 - lava_callback - INFO - Starting async job submit for node 69d3040213dd9a9509893e03 2026-04-06 00:54:32,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:32,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040213dd9a9509893e03 HTTP/1.1" 200 None 2026-04-06 00:54:32,603 - lava_callback - DEBUG - Processing node 69d3040213dd9a9509893e03: baseline-arm64-pengutronix 2026-04-06 00:54:32,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:32,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:32,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040213dd9a9509893e03/log.txt.gz 2026-04-06 00:54:33,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:33,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:33,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040213dd9a9509893e03/lava-logs.yaml 2026-04-06 00:54:33,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:33,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:33,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040213dd9a9509893e03/lava_callback.json.gz 2026-04-06 00:54:33,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:33,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040213dd9a9509893e03 HTTP/1.1" 200 None 2026-04-06 00:54:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:33,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:33,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:33,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040213dd9a9509893e03 HTTP/1.1" 200 None 2026-04-06 00:54:33,536 - lava_callback - INFO - Completed processing callback for node 69d3040213dd9a9509893e03 2026-04-06 00:54:34,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:34,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:54:35,489 - lava_callback - INFO - Received callback for node 69d3021f13dd9a9509893a8c INFO: 172.21.0.1:34984 - "POST /node/69d3021f13dd9a9509893a8c HTTP/1.0" 202 Accepted 2026-04-06 00:54:35,496 - lava_callback - INFO - Starting async job submit for node 69d3021f13dd9a9509893a8c 2026-04-06 00:54:35,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:35,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3021f13dd9a9509893a8c HTTP/1.1" 200 None 2026-04-06 00:54:35,536 - lava_callback - DEBUG - Processing node 69d3021f13dd9a9509893a8c: baseline-arm-broonie 2026-04-06 00:54:35,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:35,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:35,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3021f13dd9a9509893a8c/log.txt.gz 2026-04-06 00:54:36,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:36,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:36,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3021f13dd9a9509893a8c/lava-logs.yaml 2026-04-06 00:54:36,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:36,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:36,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3021f13dd9a9509893a8c/lava_callback.json.gz 2026-04-06 00:54:36,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:36,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3021f13dd9a9509893a8c HTTP/1.1" 200 None 2026-04-06 00:54:36,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:36,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:54:36,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:36,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3021f13dd9a9509893a8c HTTP/1.1" 200 None 2026-04-06 00:54:36,502 - lava_callback - INFO - Completed processing callback for node 69d3021f13dd9a9509893a8c INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:54:37,304 - lava_callback - INFO - Received callback for node 69d303ea13dd9a9509893d59 INFO: 172.21.0.1:35006 - "POST /node/69d303ea13dd9a9509893d59 HTTP/1.0" 202 Accepted 2026-04-06 00:54:37,310 - lava_callback - INFO - Starting async job submit for node 69d303ea13dd9a9509893d59 2026-04-06 00:54:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ea13dd9a9509893d59 HTTP/1.1" 200 None 2026-04-06 00:54:37,354 - lava_callback - DEBUG - Processing node 69d303ea13dd9a9509893d59: baseline-arm64-broonie 2026-04-06 00:54:37,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:37,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:37,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ea13dd9a9509893d59/log.txt.gz 2026-04-06 00:54:37,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:38,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:38,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ea13dd9a9509893d59/lava-logs.yaml 2026-04-06 00:54:38,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:38,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:38,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ea13dd9a9509893d59/lava_callback.json.gz 2026-04-06 00:54:38,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ea13dd9a9509893d59 HTTP/1.1" 200 None 2026-04-06 00:54:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:38,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:38,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:38,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ea13dd9a9509893d59 HTTP/1.1" 200 None 2026-04-06 00:54:38,264 - lava_callback - INFO - Completed processing callback for node 69d303ea13dd9a9509893d59 2026-04-06 00:54:41,854 - lava_callback - INFO - Received callback for node 69d3040313dd9a9509893e06 INFO: 172.21.0.1:48372 - "POST /node/69d3040313dd9a9509893e06 HTTP/1.0" 202 Accepted 2026-04-06 00:54:41,860 - lava_callback - INFO - Starting async job submit for node 69d3040313dd9a9509893e06 2026-04-06 00:54:41,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:41,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040313dd9a9509893e06 HTTP/1.1" 200 None 2026-04-06 00:54:41,895 - lava_callback - DEBUG - Processing node 69d3040313dd9a9509893e06: baseline-arm64-pengutronix 2026-04-06 00:54:42,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:42,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:42,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040313dd9a9509893e06/log.txt.gz 2026-04-06 00:54:42,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:42,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:42,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040313dd9a9509893e06/lava-logs.yaml 2026-04-06 00:54:42,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:42,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:42,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d3040313dd9a9509893e06/lava_callback.json.gz 2026-04-06 00:54:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:42,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040313dd9a9509893e06 HTTP/1.1" 200 None 2026-04-06 00:54:42,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:42,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:42,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:42,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040313dd9a9509893e06 HTTP/1.1" 200 None 2026-04-06 00:54:42,804 - lava_callback - INFO - Completed processing callback for node 69d3040313dd9a9509893e06 2026-04-06 00:54:44,420 - lava_callback - INFO - Received callback for node 69d303f613dd9a9509893dab INFO: 172.21.0.1:48386 - "POST /node/69d303f613dd9a9509893dab HTTP/1.0" 202 Accepted 2026-04-06 00:54:44,426 - lava_callback - INFO - Starting async job submit for node 69d303f613dd9a9509893dab 2026-04-06 00:54:44,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:44,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f613dd9a9509893dab HTTP/1.1" 200 None 2026-04-06 00:54:44,464 - lava_callback - DEBUG - Processing node 69d303f613dd9a9509893dab: baseline-arm64-broonie 2026-04-06 00:54:44,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:44,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:44,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f613dd9a9509893dab/log.txt.gz 2026-04-06 00:54:45,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:45,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:45,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f613dd9a9509893dab/lava-logs.yaml 2026-04-06 00:54:45,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:45,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:45,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f613dd9a9509893dab/lava_callback.json.gz 2026-04-06 00:54:45,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:45,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f613dd9a9509893dab HTTP/1.1" 200 None 2026-04-06 00:54:45,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:45,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:45,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:45,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303f613dd9a9509893dab HTTP/1.1" 200 None 2026-04-06 00:54:45,421 - lava_callback - INFO - Completed processing callback for node 69d303f613dd9a9509893dab INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:54:49,223 - lava_callback - INFO - Received callback for node 69d06155d2be3e1cf2a5b025 INFO: 172.21.0.1:48416 - "POST /node/69d06155d2be3e1cf2a5b025 HTTP/1.0" 202 Accepted 2026-04-06 00:54:49,229 - lava_callback - INFO - Starting async job submit for node 69d06155d2be3e1cf2a5b025 2026-04-06 00:54:49,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:49,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06155d2be3e1cf2a5b025 HTTP/1.1" 200 None 2026-04-06 00:54:49,256 - lava_callback - DEBUG - Processing node 69d06155d2be3e1cf2a5b025: baseline-arm-baylibre 2026-04-06 00:54:49,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06155d2be3e1cf2a5b025 2026-04-06 00:54:49,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:49,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06155d2be3e1cf2a5b025 HTTP/1.1" 200 None 2026-04-06 00:54:49,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:49,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:54:49,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:49,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06155d2be3e1cf2a5b025 HTTP/1.1" 200 None 2026-04-06 00:54:49,311 - lava_callback - ERROR - Error processing callback for node 69d06155d2be3e1cf2a5b025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:54:52,947 - lava_callback - INFO - Received callback for node 69d303ff13dd9a9509893dcb INFO: 172.21.0.1:45838 - "POST /node/69d303ff13dd9a9509893dcb HTTP/1.0" 202 Accepted 2026-04-06 00:54:52,953 - lava_callback - INFO - Starting async job submit for node 69d303ff13dd9a9509893dcb 2026-04-06 00:54:52,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:52,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ff13dd9a9509893dcb HTTP/1.1" 200 None 2026-04-06 00:54:52,992 - lava_callback - DEBUG - Processing node 69d303ff13dd9a9509893dcb: baseline-arm64-kontron 2026-04-06 00:54:53,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:53,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:53,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d303ff13dd9a9509893dcb/log.txt.gz 2026-04-06 00:54:53,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:53,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:53,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d303ff13dd9a9509893dcb/lava-logs.yaml 2026-04-06 00:54:53,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:53,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:53,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d303ff13dd9a9509893dcb/lava_callback.json.gz 2026-04-06 00:54:53,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:53,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ff13dd9a9509893dcb HTTP/1.1" 200 None 2026-04-06 00:54:53,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:53,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:53,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:53,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ff13dd9a9509893dcb HTTP/1.1" 200 None 2026-04-06 00:54:53,913 - lava_callback - INFO - Completed processing callback for node 69d303ff13dd9a9509893dcb 2026-04-06 00:54:54,192 - lava_callback - INFO - Received callback for node 69d3040113dd9a9509893e00 INFO: 172.21.0.1:45842 - "POST /node/69d3040113dd9a9509893e00 HTTP/1.0" 202 Accepted 2026-04-06 00:54:54,198 - lava_callback - INFO - Starting async job submit for node 69d3040113dd9a9509893e00 2026-04-06 00:54:54,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:54,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040113dd9a9509893e00 HTTP/1.1" 200 None 2026-04-06 00:54:54,256 - lava_callback - DEBUG - Processing node 69d3040113dd9a9509893e00: baseline-arm64-kontron 2026-04-06 00:54:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:54,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:54,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3040113dd9a9509893e00/log.txt.gz 2026-04-06 00:54:54,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:55,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:55,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3040113dd9a9509893e00/lava-logs.yaml 2026-04-06 00:54:55,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:54:55,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:54:55,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3040113dd9a9509893e00/lava_callback.json.gz 2026-04-06 00:54:55,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:55,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040113dd9a9509893e00 HTTP/1.1" 200 None 2026-04-06 00:54:55,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:55,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:54:55,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:54:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040113dd9a9509893e00 HTTP/1.1" 200 None 2026-04-06 00:54:55,295 - lava_callback - INFO - Completed processing callback for node 69d3040113dd9a9509893e00 INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:03,163 - lava_callback - INFO - Received callback for node 69d303ed13dd9a9509893d85 INFO: 172.21.0.1:55912 - "POST /node/69d303ed13dd9a9509893d85 HTTP/1.0" 202 Accepted 2026-04-06 00:55:03,169 - lava_callback - INFO - Starting async job submit for node 69d303ed13dd9a9509893d85 2026-04-06 00:55:03,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:03,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ed13dd9a9509893d85 HTTP/1.1" 200 None 2026-04-06 00:55:03,207 - lava_callback - DEBUG - Processing node 69d303ed13dd9a9509893d85: baseline-arm64-broonie 2026-04-06 00:55:03,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:03,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:03,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ed13dd9a9509893d85/log.txt.gz 2026-04-06 00:55:03,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:03,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:03,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ed13dd9a9509893d85/lava-logs.yaml 2026-04-06 00:55:03,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:04,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:04,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ed13dd9a9509893d85/lava_callback.json.gz 2026-04-06 00:55:04,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:04,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ed13dd9a9509893d85 HTTP/1.1" 200 None 2026-04-06 00:55:04,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:04,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:04,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ed13dd9a9509893d85 HTTP/1.1" 200 None 2026-04-06 00:55:04,214 - lava_callback - INFO - Completed processing callback for node 69d303ed13dd9a9509893d85 2026-04-06 00:55:04,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:04,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 00:55:04,588 - lava_callback - INFO - Received callback for node 69d303ef13dd9a9509893d88 INFO: 172.21.0.1:55922 - "POST /node/69d303ef13dd9a9509893d88 HTTP/1.0" 202 Accepted 2026-04-06 00:55:04,594 - lava_callback - INFO - Starting async job submit for node 69d303ef13dd9a9509893d88 2026-04-06 00:55:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:04,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ef13dd9a9509893d88 HTTP/1.1" 200 None 2026-04-06 00:55:04,633 - lava_callback - DEBUG - Processing node 69d303ef13dd9a9509893d88: baseline-arm64-broonie 2026-04-06 00:55:04,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:05,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:05,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ef13dd9a9509893d88/log.txt.gz 2026-04-06 00:55:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:05,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:05,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ef13dd9a9509893d88/lava-logs.yaml 2026-04-06 00:55:05,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:05,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:05,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303ef13dd9a9509893d88/lava_callback.json.gz 2026-04-06 00:55:05,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:05,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ef13dd9a9509893d88 HTTP/1.1" 200 None 2026-04-06 00:55:05,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:05,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:05,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:05,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ef13dd9a9509893d88 HTTP/1.1" 200 None 2026-04-06 00:55:05,815 - lava_callback - INFO - Completed processing callback for node 69d303ef13dd9a9509893d88 2026-04-06 00:55:06,045 - lava_callback - INFO - Received callback for node 69d303f413dd9a9509893da2 INFO: 172.21.0.1:55928 - "POST /node/69d303f413dd9a9509893da2 HTTP/1.0" 202 Accepted 2026-04-06 00:55:06,053 - lava_callback - INFO - Starting async job submit for node 69d303f413dd9a9509893da2 2026-04-06 00:55:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f413dd9a9509893da2 HTTP/1.1" 200 None 2026-04-06 00:55:06,105 - lava_callback - DEBUG - Processing node 69d303f413dd9a9509893da2: baseline-arm64-broonie 2026-04-06 00:55:06,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:06,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:06,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f413dd9a9509893da2/log.txt.gz INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:06,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:06,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:06,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f413dd9a9509893da2/lava-logs.yaml 2026-04-06 00:55:06,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:06,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:06,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f413dd9a9509893da2/lava_callback.json.gz 2026-04-06 00:55:06,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:06,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f413dd9a9509893da2 HTTP/1.1" 200 None 2026-04-06 00:55:07,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:07,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:07,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:07,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303f413dd9a9509893da2 HTTP/1.1" 200 None 2026-04-06 00:55:07,044 - lava_callback - INFO - Completed processing callback for node 69d303f413dd9a9509893da2 2026-04-06 00:55:10,433 - lava_callback - INFO - Received callback for node 69d301ae13dd9a95098938e7 INFO: 172.21.0.1:44390 - "POST /node/69d301ae13dd9a95098938e7 HTTP/1.0" 202 Accepted 2026-04-06 00:55:10,439 - lava_callback - INFO - Starting async job submit for node 69d301ae13dd9a95098938e7 2026-04-06 00:55:10,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:10,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ae13dd9a95098938e7 HTTP/1.1" 200 None 2026-04-06 00:55:10,476 - lava_callback - DEBUG - Processing node 69d301ae13dd9a95098938e7: baseline-arm 2026-04-06 00:55:10,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:10,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:10,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938e7/log.txt.gz 2026-04-06 00:55:10,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:11,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:11,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938e7/lava-logs.yaml 2026-04-06 00:55:11,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:11,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:11,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ae13dd9a95098938e7/lava_callback.json.gz 2026-04-06 00:55:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:11,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ae13dd9a95098938e7 HTTP/1.1" 200 None 2026-04-06 00:55:11,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:11,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:55:11,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:11,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ae13dd9a95098938e7 HTTP/1.1" 200 None 2026-04-06 00:55:11,369 - lava_callback - INFO - Completed processing callback for node 69d301ae13dd9a95098938e7 2026-04-06 00:55:12,761 - lava_callback - INFO - Received callback for node 69d303bc13dd9a9509893ca8 INFO: 172.21.0.1:44404 - "POST /node/69d303bc13dd9a9509893ca8 HTTP/1.0" 202 Accepted 2026-04-06 00:55:12,767 - lava_callback - INFO - Starting async job submit for node 69d303bc13dd9a9509893ca8 2026-04-06 00:55:12,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:12,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303bc13dd9a9509893ca8 HTTP/1.1" 200 None 2026-04-06 00:55:12,808 - lava_callback - DEBUG - Processing node 69d303bc13dd9a9509893ca8: baseline-arm64 2026-04-06 00:55:13,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:13,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:13,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bc13dd9a9509893ca8/log.txt.gz 2026-04-06 00:55:13,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:13,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:13,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bc13dd9a9509893ca8/lava-logs.yaml 2026-04-06 00:55:13,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:13,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:13,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bc13dd9a9509893ca8/lava_callback.json.gz 2026-04-06 00:55:13,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:13,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303bc13dd9a9509893ca8 HTTP/1.1" 200 None 2026-04-06 00:55:13,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:13,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:13,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:14,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303bc13dd9a9509893ca8 HTTP/1.1" 200 None 2026-04-06 00:55:14,020 - lava_callback - INFO - Completed processing callback for node 69d303bc13dd9a9509893ca8 INFO: 172.21.0.1:44414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:23,922 - lava_callback - INFO - Received callback for node 69d303c613dd9a9509893cef INFO: 172.21.0.1:35268 - "POST /node/69d303c613dd9a9509893cef HTTP/1.0" 202 Accepted 2026-04-06 00:55:23,928 - lava_callback - INFO - Starting async job submit for node 69d303c613dd9a9509893cef 2026-04-06 00:55:23,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:23,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c613dd9a9509893cef HTTP/1.1" 200 None 2026-04-06 00:55:23,977 - lava_callback - DEBUG - Processing node 69d303c613dd9a9509893cef: baseline-arm64 2026-04-06 00:55:24,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:24,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:24,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c613dd9a9509893cef/log.txt.gz 2026-04-06 00:55:24,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:24,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:24,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c613dd9a9509893cef/lava-logs.yaml 2026-04-06 00:55:24,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:24,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:24,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c613dd9a9509893cef/lava_callback.json.gz 2026-04-06 00:55:24,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:24,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c613dd9a9509893cef HTTP/1.1" 200 None 2026-04-06 00:55:24,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:24,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:24,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:25,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c613dd9a9509893cef HTTP/1.1" 200 None 2026-04-06 00:55:25,023 - lava_callback - INFO - Completed processing callback for node 69d303c613dd9a9509893cef INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:32,650 - lava_callback - INFO - Received callback for node 69d303bf13dd9a9509893cae INFO: 172.21.0.1:41398 - "POST /node/69d303bf13dd9a9509893cae HTTP/1.0" 202 Accepted 2026-04-06 00:55:32,656 - lava_callback - INFO - Starting async job submit for node 69d303bf13dd9a9509893cae 2026-04-06 00:55:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:32,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303bf13dd9a9509893cae HTTP/1.1" 200 None 2026-04-06 00:55:32,697 - lava_callback - DEBUG - Processing node 69d303bf13dd9a9509893cae: baseline-arm64 2026-04-06 00:55:32,934 - lava_callback - INFO - Received callback for node 69d303c813dd9a9509893cf2 INFO: 172.21.0.1:41410 - "POST /node/69d303c813dd9a9509893cf2 HTTP/1.0" 202 Accepted 2026-04-06 00:55:32,961 - lava_callback - INFO - Starting async job submit for node 69d303c813dd9a9509893cf2 2026-04-06 00:55:33,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:33,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c813dd9a9509893cf2 HTTP/1.1" 200 None 2026-04-06 00:55:33,113 - lava_callback - DEBUG - Processing node 69d303c813dd9a9509893cf2: baseline-arm64 2026-04-06 00:55:33,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:33,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:33,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:33,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bf13dd9a9509893cae/log.txt.gz 2026-04-06 00:55:33,564 - lava_callback - INFO - Received callback for node 69d301e213dd9a9509893a0d 2026-04-06 00:55:33,588 - lava_callback - INFO - Starting async job submit for node 69d301e213dd9a9509893a0d INFO: 172.21.0.1:41412 - "POST /node/69d301e213dd9a9509893a0d HTTP/1.0" 202 Accepted 2026-04-06 00:55:33,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:33,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c813dd9a9509893cf2/log.txt.gz 2026-04-06 00:55:33,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e213dd9a9509893a0d HTTP/1.1" 200 None 2026-04-06 00:55:33,737 - lava_callback - DEBUG - Processing node 69d301e213dd9a9509893a0d: ltp-dio 2026-04-06 00:55:34,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:34,223 - lava_callback - INFO - Received callback for node 69d303ba13dd9a9509893ca5 2026-04-06 00:55:34,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:34,250 - lava_callback - INFO - Starting async job submit for node 69d303ba13dd9a9509893ca5 INFO: 172.21.0.1:41414 - "POST /node/69d303ba13dd9a9509893ca5 HTTP/1.0" 202 Accepted 2026-04-06 00:55:34,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:34,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:34,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ba13dd9a9509893ca5 HTTP/1.1" 200 None 2026-04-06 00:55:34,387 - lava_callback - DEBUG - Processing node 69d303ba13dd9a9509893ca5: baseline-arm64 2026-04-06 00:55:34,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:34,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:34,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 00:55:34,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bf13dd9a9509893cae/lava-logs.yaml 2026-04-06 00:55:34,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c813dd9a9509893cf2/lava-logs.yaml 2026-04-06 00:55:34,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:34,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:34,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:34,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:35,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:35,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303ba13dd9a9509893ca5/log.txt.gz 2026-04-06 00:55:35,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:35,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:35,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:35,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d301e213dd9a9509893a0d/log.txt.gz 2026-04-06 00:55:35,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c813dd9a9509893cf2/lava_callback.json.gz 2026-04-06 00:55:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303bf13dd9a9509893cae/lava_callback.json.gz 2026-04-06 00:55:35,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:35,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c813dd9a9509893cf2 HTTP/1.1" 200 None 2026-04-06 00:55:35,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303bf13dd9a9509893cae HTTP/1.1" 200 None 2026-04-06 00:55:35,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:35,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:35,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:35,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:35,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c813dd9a9509893cf2 HTTP/1.1" 200 None 2026-04-06 00:55:35,630 - lava_callback - INFO - Completed processing callback for node 69d303c813dd9a9509893cf2 2026-04-06 00:55:35,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303bf13dd9a9509893cae HTTP/1.1" 200 None 2026-04-06 00:55:35,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:35,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303ba13dd9a9509893ca5/lava-logs.yaml 2026-04-06 00:55:35,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:35,810 - lava_callback - INFO - Completed processing callback for node 69d303bf13dd9a9509893cae 2026-04-06 00:55:36,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:36,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d301e213dd9a9509893a0d/lava-logs.yaml 2026-04-06 00:55:36,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:36,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:36,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303ba13dd9a9509893ca5/lava_callback.json.gz 2026-04-06 00:55:36,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ba13dd9a9509893ca5 HTTP/1.1" 200 None 2026-04-06 00:55:36,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:36,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ba13dd9a9509893ca5 HTTP/1.1" 200 None 2026-04-06 00:55:36,210 - lava_callback - INFO - Completed processing callback for node 69d303ba13dd9a9509893ca5 2026-04-06 00:55:36,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:36,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d301e213dd9a9509893a0d/lava_callback.json.gz 2026-04-06 00:55:36,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301e213dd9a9509893a0d HTTP/1.1" 200 None 2026-04-06 00:55:36,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:55:36,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:36,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301e213dd9a9509893a0d HTTP/1.1" 200 None 2026-04-06 00:55:36,365 - lava_callback - INFO - Completed processing callback for node 69d301e213dd9a9509893a0d INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:37,177 - lava_callback - INFO - Received callback for node 69d303be13dd9a9509893cab INFO: 172.21.0.1:41428 - "POST /node/69d303be13dd9a9509893cab HTTP/1.0" 202 Accepted 2026-04-06 00:55:37,183 - lava_callback - INFO - Starting async job submit for node 69d303be13dd9a9509893cab 2026-04-06 00:55:37,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:37,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303be13dd9a9509893cab HTTP/1.1" 200 None 2026-04-06 00:55:37,221 - lava_callback - DEBUG - Processing node 69d303be13dd9a9509893cab: baseline-arm64 2026-04-06 00:55:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:37,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:37,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303be13dd9a9509893cab/log.txt.gz 2026-04-06 00:55:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:38,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:38,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303be13dd9a9509893cab/lava-logs.yaml 2026-04-06 00:55:38,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:38,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:38,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303be13dd9a9509893cab/lava_callback.json.gz 2026-04-06 00:55:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:38,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303be13dd9a9509893cab HTTP/1.1" 200 None 2026-04-06 00:55:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:38,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:38,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303be13dd9a9509893cab HTTP/1.1" 200 None 2026-04-06 00:55:38,513 - lava_callback - INFO - Completed processing callback for node 69d303be13dd9a9509893cab 2026-04-06 00:55:38,971 - lava_callback - INFO - Received callback for node 69d303d113dd9a9509893d1d INFO: 172.21.0.1:41444 - "POST /node/69d303d113dd9a9509893d1d HTTP/1.0" 202 Accepted 2026-04-06 00:55:38,978 - lava_callback - INFO - Starting async job submit for node 69d303d113dd9a9509893d1d 2026-04-06 00:55:39,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:39,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d113dd9a9509893d1d HTTP/1.1" 200 None 2026-04-06 00:55:39,018 - lava_callback - DEBUG - Processing node 69d303d113dd9a9509893d1d: baseline-nfs-arm64 2026-04-06 00:55:39,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:39,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:39,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d113dd9a9509893d1d/log.txt.gz 2026-04-06 00:55:39,750 - lava_callback - INFO - Received callback for node 69d303d213dd9a9509893d26 INFO: 172.21.0.1:50258 - "POST /node/69d303d213dd9a9509893d26 HTTP/1.0" 202 Accepted 2026-04-06 00:55:39,771 - lava_callback - INFO - Starting async job submit for node 69d303d213dd9a9509893d26 2026-04-06 00:55:39,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:39,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d213dd9a9509893d26 HTTP/1.1" 200 None 2026-04-06 00:55:39,883 - lava_callback - DEBUG - Processing node 69d303d213dd9a9509893d26: baseline-nfs-arm64 2026-04-06 00:55:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:40,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:40,415 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d113dd9a9509893d1d/lava-logs.yaml 2026-04-06 00:55:40,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:40,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:40,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:40,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d213dd9a9509893d26/log.txt.gz 2026-04-06 00:55:40,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:40,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d113dd9a9509893d1d/lava_callback.json.gz 2026-04-06 00:55:40,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:40,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d113dd9a9509893d1d HTTP/1.1" 200 None 2026-04-06 00:55:40,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:40,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:41,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,058 - lava_callback - INFO - Received callback for node 69d06178d2be3e1cf2a5b04c INFO: 172.21.0.1:50274 - "POST /node/69d06178d2be3e1cf2a5b04c HTTP/1.0" 202 Accepted 2026-04-06 00:55:41,069 - lava_callback - INFO - Starting async job submit for node 69d06178d2be3e1cf2a5b04c 2026-04-06 00:55:41,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d113dd9a9509893d1d HTTP/1.1" 200 None 2026-04-06 00:55:41,130 - lava_callback - INFO - Completed processing callback for node 69d303d113dd9a9509893d1d 2026-04-06 00:55:41,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:41,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06178d2be3e1cf2a5b04c HTTP/1.1" 200 None 2026-04-06 00:55:41,182 - lava_callback - DEBUG - Processing node 69d06178d2be3e1cf2a5b04c: baseline-arm-clabbe 2026-04-06 00:55:41,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06178d2be3e1cf2a5b04c 2026-04-06 00:55:41,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06178d2be3e1cf2a5b04c HTTP/1.1" 200 None 2026-04-06 00:55:41,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:55:41,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06178d2be3e1cf2a5b04c HTTP/1.1" 200 None 2026-04-06 00:55:41,264 - lava_callback - ERROR - Error processing callback for node 69d06178d2be3e1cf2a5b04c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:55:41,441 - lava_callback - INFO - Received callback for node 69d303d913dd9a9509893d39 INFO: 172.21.0.1:50284 - "POST /node/69d303d913dd9a9509893d39 HTTP/1.0" 202 Accepted 2026-04-06 00:55:41,449 - lava_callback - INFO - Starting async job submit for node 69d303d913dd9a9509893d39 2026-04-06 00:55:41,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:41,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d213dd9a9509893d26/lava-logs.yaml 2026-04-06 00:55:41,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d913dd9a9509893d39 HTTP/1.1" 200 None 2026-04-06 00:55:41,496 - lava_callback - DEBUG - Processing node 69d303d913dd9a9509893d39: baseline-nfs-arm64 2026-04-06 00:55:41,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:41,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d213dd9a9509893d26/lava_callback.json.gz 2026-04-06 00:55:41,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d213dd9a9509893d26 HTTP/1.1" 200 None 2026-04-06 00:55:41,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:41,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:41,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:41,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d213dd9a9509893d26 HTTP/1.1" 200 None 2026-04-06 00:55:41,967 - lava_callback - INFO - Completed processing callback for node 69d303d213dd9a9509893d26 2026-04-06 00:55:42,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:42,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d913dd9a9509893d39/log.txt.gz 2026-04-06 00:55:42,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:42,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:42,555 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d913dd9a9509893d39/lava-logs.yaml 2026-04-06 00:55:42,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:42,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:42,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d913dd9a9509893d39/lava_callback.json.gz 2026-04-06 00:55:42,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:42,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d913dd9a9509893d39 HTTP/1.1" 200 None 2026-04-06 00:55:42,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:42,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:42,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d913dd9a9509893d39 HTTP/1.1" 200 None 2026-04-06 00:55:42,786 - lava_callback - INFO - Completed processing callback for node 69d303d913dd9a9509893d39 INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:48,521 - lava_callback - INFO - Received callback for node 69d303d813dd9a9509893d36 INFO: 172.21.0.1:50300 - "POST /node/69d303d813dd9a9509893d36 HTTP/1.0" 202 Accepted 2026-04-06 00:55:48,528 - lava_callback - INFO - Starting async job submit for node 69d303d813dd9a9509893d36 2026-04-06 00:55:48,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:48,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d813dd9a9509893d36 HTTP/1.1" 200 None 2026-04-06 00:55:48,566 - lava_callback - DEBUG - Processing node 69d303d813dd9a9509893d36: baseline-nfs-arm64 2026-04-06 00:55:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:49,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:49,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d813dd9a9509893d36/log.txt.gz INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:55:49,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:49,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:49,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d813dd9a9509893d36/lava-logs.yaml 2026-04-06 00:55:49,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:49,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:49,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d813dd9a9509893d36/lava_callback.json.gz 2026-04-06 00:55:49,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:49,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d813dd9a9509893d36 HTTP/1.1" 200 None 2026-04-06 00:55:49,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:49,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:49,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:49,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d813dd9a9509893d36 HTTP/1.1" 200 None 2026-04-06 00:55:49,683 - lava_callback - INFO - Completed processing callback for node 69d303d813dd9a9509893d36 2026-04-06 00:55:50,005 - lava_callback - INFO - Received callback for node 69d303da13dd9a9509893d3c INFO: 172.21.0.1:60652 - "POST /node/69d303da13dd9a9509893d3c HTTP/1.0" 202 Accepted 2026-04-06 00:55:50,013 - lava_callback - INFO - Starting async job submit for node 69d303da13dd9a9509893d3c 2026-04-06 00:55:50,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:50,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303da13dd9a9509893d3c HTTP/1.1" 200 None 2026-04-06 00:55:50,064 - lava_callback - DEBUG - Processing node 69d303da13dd9a9509893d3c: baseline-nfs-arm64 2026-04-06 00:55:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:50,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:50,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303da13dd9a9509893d3c/log.txt.gz 2026-04-06 00:55:50,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:51,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:51,060 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303da13dd9a9509893d3c/lava-logs.yaml 2026-04-06 00:55:51,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:51,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:51,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303da13dd9a9509893d3c/lava_callback.json.gz 2026-04-06 00:55:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:51,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303da13dd9a9509893d3c HTTP/1.1" 200 None 2026-04-06 00:55:51,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:51,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:51,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:51,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303da13dd9a9509893d3c HTTP/1.1" 200 None 2026-04-06 00:55:51,320 - lava_callback - INFO - Completed processing callback for node 69d303da13dd9a9509893d3c 2026-04-06 00:55:54,605 - lava_callback - INFO - Received callback for node 69d303d513dd9a9509893d2c INFO: 172.21.0.1:60664 - "POST /node/69d303d513dd9a9509893d2c HTTP/1.0" 202 Accepted 2026-04-06 00:55:54,612 - lava_callback - INFO - Starting async job submit for node 69d303d513dd9a9509893d2c 2026-04-06 00:55:54,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:54,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d513dd9a9509893d2c HTTP/1.1" 200 None 2026-04-06 00:55:54,650 - lava_callback - DEBUG - Processing node 69d303d513dd9a9509893d2c: baseline-nfs-arm64 2026-04-06 00:55:54,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:55,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:55,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d513dd9a9509893d2c/log.txt.gz 2026-04-06 00:55:55,162 - lava_callback - INFO - Received callback for node 69d303eb13dd9a9509893d80 INFO: 172.21.0.1:60674 - "POST /node/69d303eb13dd9a9509893d80 HTTP/1.0" 202 Accepted 2026-04-06 00:55:55,189 - lava_callback - INFO - Starting async job submit for node 69d303eb13dd9a9509893d80 2026-04-06 00:55:55,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:55,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303eb13dd9a9509893d80 HTTP/1.1" 200 None 2026-04-06 00:55:55,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:55,358 - lava_callback - DEBUG - Processing node 69d303eb13dd9a9509893d80: baseline-arm64-broonie 2026-04-06 00:55:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:55,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:55,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d513dd9a9509893d2c/lava-logs.yaml 2026-04-06 00:55:55,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:55,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:55,715 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303eb13dd9a9509893d80/log.txt.gz 2026-04-06 00:55:55,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:55,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d513dd9a9509893d2c/lava_callback.json.gz 2026-04-06 00:55:55,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:55,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:55,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d513dd9a9509893d2c HTTP/1.1" 200 None 2026-04-06 00:55:55,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:55,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:55,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:55,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d513dd9a9509893d2c HTTP/1.1" 200 None 2026-04-06 00:55:55,967 - lava_callback - INFO - Completed processing callback for node 69d303d513dd9a9509893d2c 2026-04-06 00:55:56,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:56,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303eb13dd9a9509893d80/lava-logs.yaml 2026-04-06 00:55:56,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:55:56,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:55:56,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303eb13dd9a9509893d80/lava_callback.json.gz 2026-04-06 00:55:56,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:56,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303eb13dd9a9509893d80 HTTP/1.1" 200 None 2026-04-06 00:55:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:55:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:55:56,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303eb13dd9a9509893d80 HTTP/1.1" 200 None 2026-04-06 00:55:56,442 - lava_callback - INFO - Completed processing callback for node 69d303eb13dd9a9509893d80 INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:01,026 - lava_callback - INFO - Received callback for node 69d0619bd2be3e1cf2a5b09b INFO: 172.21.0.1:45324 - "POST /node/69d0619bd2be3e1cf2a5b09b HTTP/1.0" 202 Accepted 2026-04-06 00:56:01,032 - lava_callback - INFO - Starting async job submit for node 69d0619bd2be3e1cf2a5b09b 2026-04-06 00:56:01,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:01,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0619bd2be3e1cf2a5b09b HTTP/1.1" 200 None 2026-04-06 00:56:01,047 - lava_callback - DEBUG - Processing node 69d0619bd2be3e1cf2a5b09b: baseline-arm-clabbe 2026-04-06 00:56:01,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0619bd2be3e1cf2a5b09b 2026-04-06 00:56:01,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:01,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0619bd2be3e1cf2a5b09b HTTP/1.1" 200 None 2026-04-06 00:56:01,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:01,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:56:01,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:01,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0619bd2be3e1cf2a5b09b HTTP/1.1" 200 None 2026-04-06 00:56:01,144 - lava_callback - ERROR - Error processing callback for node 69d0619bd2be3e1cf2a5b09b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:04,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:07,764 - lava_callback - INFO - Received callback for node 69d303cb13dd9a9509893d05 INFO: 172.21.0.1:45352 - "POST /node/69d303cb13dd9a9509893d05 HTTP/1.0" 202 Accepted 2026-04-06 00:56:07,771 - lava_callback - INFO - Starting async job submit for node 69d303cb13dd9a9509893d05 2026-04-06 00:56:07,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:07,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cb13dd9a9509893d05 HTTP/1.1" 200 None 2026-04-06 00:56:07,814 - lava_callback - DEBUG - Processing node 69d303cb13dd9a9509893d05: baseline-nfs-arm64 2026-04-06 00:56:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:08,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:08,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cb13dd9a9509893d05/log.txt.gz 2026-04-06 00:56:08,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:08,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:08,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cb13dd9a9509893d05/lava-logs.yaml 2026-04-06 00:56:08,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:08,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:08,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cb13dd9a9509893d05/lava_callback.json.gz 2026-04-06 00:56:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:08,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cb13dd9a9509893d05 HTTP/1.1" 200 None 2026-04-06 00:56:08,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:08,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:56:08,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:08,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303cb13dd9a9509893d05 HTTP/1.1" 200 None 2026-04-06 00:56:08,947 - lava_callback - INFO - Completed processing callback for node 69d303cb13dd9a9509893d05 INFO: 172.21.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 00:56:15,503 - lava_callback - INFO - Received callback for node 69d303c513dd9a9509893cec INFO: 172.21.0.1:50730 - "POST /node/69d303c513dd9a9509893cec HTTP/1.0" 202 Accepted 2026-04-06 00:56:15,510 - lava_callback - INFO - Starting async job submit for node 69d303c513dd9a9509893cec 2026-04-06 00:56:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:15,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c513dd9a9509893cec HTTP/1.1" 200 None 2026-04-06 00:56:15,547 - lava_callback - DEBUG - Processing node 69d303c513dd9a9509893cec: baseline-arm64 2026-04-06 00:56:15,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:15,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:15,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c513dd9a9509893cec/log.txt.gz 2026-04-06 00:56:16,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:16,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:16,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c513dd9a9509893cec/lava-logs.yaml 2026-04-06 00:56:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:16,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:16,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c513dd9a9509893cec/lava_callback.json.gz 2026-04-06 00:56:16,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:16,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c513dd9a9509893cec HTTP/1.1" 200 None 2026-04-06 00:56:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:16,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:56:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:16,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c513dd9a9509893cec HTTP/1.1" 200 None 2026-04-06 00:56:16,584 - lava_callback - INFO - Completed processing callback for node 69d303c513dd9a9509893cec INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:29,402 - lava_callback - INFO - Received callback for node 69d061afd2be3e1cf2a5b0f9 INFO: 172.21.0.1:39720 - "POST /node/69d061afd2be3e1cf2a5b0f9 HTTP/1.0" 202 Accepted 2026-04-06 00:56:29,408 - lava_callback - INFO - Starting async job submit for node 69d061afd2be3e1cf2a5b0f9 2026-04-06 00:56:29,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:29,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061afd2be3e1cf2a5b0f9 HTTP/1.1" 200 None 2026-04-06 00:56:29,425 - lava_callback - DEBUG - Processing node 69d061afd2be3e1cf2a5b0f9: baseline-arm64-baylibre 2026-04-06 00:56:29,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061afd2be3e1cf2a5b0f9 2026-04-06 00:56:29,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:29,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061afd2be3e1cf2a5b0f9 HTTP/1.1" 200 None 2026-04-06 00:56:29,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:29,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:29,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:29,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061afd2be3e1cf2a5b0f9 HTTP/1.1" 200 None 2026-04-06 00:56:29,520 - lava_callback - ERROR - Error processing callback for node 69d061afd2be3e1cf2a5b0f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:30,068 - lava_callback - INFO - Received callback for node 69d061b1d2be3e1cf2a5b0fc INFO: 172.21.0.1:34952 - "POST /node/69d061b1d2be3e1cf2a5b0fc HTTP/1.0" 202 Accepted 2026-04-06 00:56:30,073 - lava_callback - INFO - Starting async job submit for node 69d061b1d2be3e1cf2a5b0fc 2026-04-06 00:56:30,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b1d2be3e1cf2a5b0fc HTTP/1.1" 200 None 2026-04-06 00:56:30,089 - lava_callback - DEBUG - Processing node 69d061b1d2be3e1cf2a5b0fc: baseline-arm64-baylibre 2026-04-06 00:56:30,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061b1d2be3e1cf2a5b0fc 2026-04-06 00:56:30,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b1d2be3e1cf2a5b0fc HTTP/1.1" 200 None 2026-04-06 00:56:30,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:30,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061b1d2be3e1cf2a5b0fc HTTP/1.1" 200 None 2026-04-06 00:56:30,144 - lava_callback - ERROR - Error processing callback for node 69d061b1d2be3e1cf2a5b0fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:30,735 - lava_callback - INFO - Received callback for node 69d061b2d2be3e1cf2a5b103 INFO: 172.21.0.1:34954 - "POST /node/69d061b2d2be3e1cf2a5b103 HTTP/1.0" 202 Accepted 2026-04-06 00:56:30,740 - lava_callback - INFO - Starting async job submit for node 69d061b2d2be3e1cf2a5b103 2026-04-06 00:56:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b2d2be3e1cf2a5b103 HTTP/1.1" 200 None 2026-04-06 00:56:30,755 - lava_callback - DEBUG - Processing node 69d061b2d2be3e1cf2a5b103: baseline-arm64-baylibre 2026-04-06 00:56:30,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061b2d2be3e1cf2a5b103 2026-04-06 00:56:30,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b2d2be3e1cf2a5b103 HTTP/1.1" 200 None 2026-04-06 00:56:30,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:30,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:30,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061b2d2be3e1cf2a5b103 HTTP/1.1" 200 None 2026-04-06 00:56:30,814 - lava_callback - ERROR - Error processing callback for node 69d061b2d2be3e1cf2a5b103: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:31,401 - lava_callback - INFO - Received callback for node 69d061b5d2be3e1cf2a5b10e INFO: 172.21.0.1:34970 - "POST /node/69d061b5d2be3e1cf2a5b10e HTTP/1.0" 202 Accepted 2026-04-06 00:56:31,406 - lava_callback - INFO - Starting async job submit for node 69d061b5d2be3e1cf2a5b10e 2026-04-06 00:56:31,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:31,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b5d2be3e1cf2a5b10e HTTP/1.1" 200 None 2026-04-06 00:56:31,429 - lava_callback - DEBUG - Processing node 69d061b5d2be3e1cf2a5b10e: baseline-arm64-baylibre 2026-04-06 00:56:31,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061b5d2be3e1cf2a5b10e 2026-04-06 00:56:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:31,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b5d2be3e1cf2a5b10e HTTP/1.1" 200 None 2026-04-06 00:56:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:31,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:31,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:31,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061b5d2be3e1cf2a5b10e HTTP/1.1" 200 None 2026-04-06 00:56:31,480 - lava_callback - ERROR - Error processing callback for node 69d061b5d2be3e1cf2a5b10e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:32,065 - lava_callback - INFO - Received callback for node 69d061b7d2be3e1cf2a5b111 INFO: 172.21.0.1:34978 - "POST /node/69d061b7d2be3e1cf2a5b111 HTTP/1.0" 202 Accepted 2026-04-06 00:56:32,070 - lava_callback - INFO - Starting async job submit for node 69d061b7d2be3e1cf2a5b111 2026-04-06 00:56:32,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:32,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b7d2be3e1cf2a5b111 HTTP/1.1" 200 None 2026-04-06 00:56:32,090 - lava_callback - DEBUG - Processing node 69d061b7d2be3e1cf2a5b111: baseline-arm64-baylibre 2026-04-06 00:56:32,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061b7d2be3e1cf2a5b111 2026-04-06 00:56:32,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:32,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061b7d2be3e1cf2a5b111 HTTP/1.1" 200 None 2026-04-06 00:56:32,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:32,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:32,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:32,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061b7d2be3e1cf2a5b111 HTTP/1.1" 200 None 2026-04-06 00:56:32,143 - lava_callback - ERROR - Error processing callback for node 69d061b7d2be3e1cf2a5b111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:34,402 - lava_callback - INFO - Received callback for node 69d303c213dd9a9509893cb4 INFO: 172.21.0.1:34990 - "POST /node/69d303c213dd9a9509893cb4 HTTP/1.0" 202 Accepted 2026-04-06 00:56:34,411 - lava_callback - INFO - Starting async job submit for node 69d303c213dd9a9509893cb4 2026-04-06 00:56:34,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c213dd9a9509893cb4 HTTP/1.1" 200 None 2026-04-06 00:56:34,447 - lava_callback - DEBUG - Processing node 69d303c213dd9a9509893cb4: baseline-arm64 2026-04-06 00:56:34,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:34,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:34,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 00:56:34,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:34,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c213dd9a9509893cb4/log.txt.gz 2026-04-06 00:56:34,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:35,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:35,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c213dd9a9509893cb4/lava-logs.yaml 2026-04-06 00:56:35,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:35,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:35,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c213dd9a9509893cb4/lava_callback.json.gz 2026-04-06 00:56:35,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:35,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c213dd9a9509893cb4 HTTP/1.1" 200 None 2026-04-06 00:56:35,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:35,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:56:35,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:35,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c213dd9a9509893cb4 HTTP/1.1" 200 None 2026-04-06 00:56:35,383 - lava_callback - INFO - Completed processing callback for node 69d303c213dd9a9509893cb4 INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:41,107 - lava_callback - INFO - Received callback for node 69d061c6d2be3e1cf2a5b16e INFO: 172.21.0.1:46464 - "POST /node/69d061c6d2be3e1cf2a5b16e HTTP/1.0" 202 Accepted 2026-04-06 00:56:41,113 - lava_callback - INFO - Starting async job submit for node 69d061c6d2be3e1cf2a5b16e 2026-04-06 00:56:41,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c6d2be3e1cf2a5b16e HTTP/1.1" 200 None 2026-04-06 00:56:41,148 - lava_callback - DEBUG - Processing node 69d061c6d2be3e1cf2a5b16e: baseline-arm64-clabbe 2026-04-06 00:56:41,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061c6d2be3e1cf2a5b16e 2026-04-06 00:56:41,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c6d2be3e1cf2a5b16e HTTP/1.1" 200 None 2026-04-06 00:56:41,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061c6d2be3e1cf2a5b16e HTTP/1.1" 200 None 2026-04-06 00:56:41,208 - lava_callback - ERROR - Error processing callback for node 69d061c6d2be3e1cf2a5b16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:41,799 - lava_callback - INFO - Received callback for node 69d061c7d2be3e1cf2a5b171 INFO: 172.21.0.1:46470 - "POST /node/69d061c7d2be3e1cf2a5b171 HTTP/1.0" 202 Accepted 2026-04-06 00:56:41,807 - lava_callback - INFO - Starting async job submit for node 69d061c7d2be3e1cf2a5b171 2026-04-06 00:56:41,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c7d2be3e1cf2a5b171 HTTP/1.1" 200 None 2026-04-06 00:56:41,823 - lava_callback - DEBUG - Processing node 69d061c7d2be3e1cf2a5b171: baseline-arm64-clabbe 2026-04-06 00:56:41,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061c7d2be3e1cf2a5b171 2026-04-06 00:56:41,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c7d2be3e1cf2a5b171 HTTP/1.1" 200 None 2026-04-06 00:56:41,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:56:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:41,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061c7d2be3e1cf2a5b171 HTTP/1.1" 200 None 2026-04-06 00:56:41,885 - lava_callback - ERROR - Error processing callback for node 69d061c7d2be3e1cf2a5b171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:56:42,468 - lava_callback - INFO - Received callback for node 69d061bed2be3e1cf2a5b14d INFO: 172.21.0.1:46482 - "POST /node/69d061bed2be3e1cf2a5b14d HTTP/1.0" 202 Accepted 2026-04-06 00:56:42,473 - lava_callback - INFO - Starting async job submit for node 69d061bed2be3e1cf2a5b14d 2026-04-06 00:56:42,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:42,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061bed2be3e1cf2a5b14d HTTP/1.1" 200 None 2026-04-06 00:56:42,489 - lava_callback - DEBUG - Processing node 69d061bed2be3e1cf2a5b14d: baseline-arm-clabbe 2026-04-06 00:56:42,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061bed2be3e1cf2a5b14d 2026-04-06 00:56:42,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061bed2be3e1cf2a5b14d HTTP/1.1" 200 None 2026-04-06 00:56:42,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:42,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:56:42,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:42,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061bed2be3e1cf2a5b14d HTTP/1.1" 200 None 2026-04-06 00:56:42,548 - lava_callback - ERROR - Error processing callback for node 69d061bed2be3e1cf2a5b14d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:49,172 - lava_callback - INFO - Received callback for node 69d3023813dd9a9509893ad2 INFO: 172.21.0.1:46502 - "POST /node/69d3023813dd9a9509893ad2 HTTP/1.0" 202 Accepted 2026-04-06 00:56:49,178 - lava_callback - INFO - Starting async job submit for node 69d3023813dd9a9509893ad2 2026-04-06 00:56:49,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:49,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023813dd9a9509893ad2 HTTP/1.1" 200 None 2026-04-06 00:56:49,215 - lava_callback - DEBUG - Processing node 69d3023813dd9a9509893ad2: baseline-x86 INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:49,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:49,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:49,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023813dd9a9509893ad2/log.txt.gz 2026-04-06 00:56:49,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:50,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:50,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023813dd9a9509893ad2/lava-logs.yaml 2026-04-06 00:56:50,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:50,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:50,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d3023813dd9a9509893ad2/lava_callback.json.gz 2026-04-06 00:56:50,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:50,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3023813dd9a9509893ad2 HTTP/1.1" 200 None 2026-04-06 00:56:50,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:50,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbbb13dd9a95098934f5 HTTP/1.1" 200 None 2026-04-06 00:56:50,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:50,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3023813dd9a9509893ad2 HTTP/1.1" 200 None 2026-04-06 00:56:50,295 - lava_callback - INFO - Completed processing callback for node 69d3023813dd9a9509893ad2 2026-04-06 00:56:55,131 - lava_callback - INFO - Received callback for node 69d303b513dd9a9509893c99 INFO: 172.21.0.1:42420 - "POST /node/69d303b513dd9a9509893c99 HTTP/1.0" 202 Accepted 2026-04-06 00:56:55,137 - lava_callback - INFO - Starting async job submit for node 69d303b513dd9a9509893c99 2026-04-06 00:56:55,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:55,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b513dd9a9509893c99 HTTP/1.1" 200 None 2026-04-06 00:56:55,173 - lava_callback - DEBUG - Processing node 69d303b513dd9a9509893c99: baseline-arm64 2026-04-06 00:56:55,300 - lava_callback - INFO - Received callback for node 69d303f013dd9a9509893d91 INFO: 172.21.0.1:42422 - "POST /node/69d303f013dd9a9509893d91 HTTP/1.0" 202 Accepted 2026-04-06 00:56:55,322 - lava_callback - INFO - Starting async job submit for node 69d303f013dd9a9509893d91 2026-04-06 00:56:55,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:55,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:55,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f013dd9a9509893d91 HTTP/1.1" 200 None 2026-04-06 00:56:55,435 - lava_callback - DEBUG - Processing node 69d303f013dd9a9509893d91: baseline-arm64-broonie 2026-04-06 00:56:55,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:55,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b513dd9a9509893c99/log.txt.gz 2026-04-06 00:56:55,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:55,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:55,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:55,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f013dd9a9509893d91/log.txt.gz 2026-04-06 00:56:56,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:56,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b513dd9a9509893c99/lava-logs.yaml 2026-04-06 00:56:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:56,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:56,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b513dd9a9509893c99/lava_callback.json.gz 2026-04-06 00:56:56,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:56,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f013dd9a9509893d91/lava-logs.yaml 2026-04-06 00:56:56,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:56:56,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b513dd9a9509893c99 HTTP/1.1" 200 None 2026-04-06 00:56:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:56:56,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b513dd9a9509893c99 HTTP/1.1" 200 None 2026-04-06 00:56:56,542 - lava_callback - INFO - Completed processing callback for node 69d303b513dd9a9509893c99 INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:56:56,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:56:56,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d303f013dd9a9509893d91/lava_callback.json.gz 2026-04-06 00:56:56,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f013dd9a9509893d91 HTTP/1.1" 200 None 2026-04-06 00:56:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:56:56,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:56:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303f013dd9a9509893d91 HTTP/1.1" 200 None 2026-04-06 00:56:56,875 - lava_callback - INFO - Completed processing callback for node 69d303f013dd9a9509893d91 2026-04-06 00:57:01,060 - lava_callback - INFO - Received callback for node 69d061c7d2be3e1cf2a5b174 INFO: 172.21.0.1:49964 - "POST /node/69d061c7d2be3e1cf2a5b174 HTTP/1.0" 202 Accepted 2026-04-06 00:57:01,066 - lava_callback - INFO - Starting async job submit for node 69d061c7d2be3e1cf2a5b174 2026-04-06 00:57:01,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c7d2be3e1cf2a5b174 HTTP/1.1" 200 None 2026-04-06 00:57:01,085 - lava_callback - DEBUG - Processing node 69d061c7d2be3e1cf2a5b174: baseline-arm64-clabbe 2026-04-06 00:57:01,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061c7d2be3e1cf2a5b174 2026-04-06 00:57:01,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c7d2be3e1cf2a5b174 HTTP/1.1" 200 None 2026-04-06 00:57:01,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:57:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061c7d2be3e1cf2a5b174 HTTP/1.1" 200 None 2026-04-06 00:57:01,145 - lava_callback - ERROR - Error processing callback for node 69d061c7d2be3e1cf2a5b174: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:57:01,715 - lava_callback - INFO - Received callback for node 69d061c8d2be3e1cf2a5b17b INFO: 172.21.0.1:49968 - "POST /node/69d061c8d2be3e1cf2a5b17b HTTP/1.0" 202 Accepted 2026-04-06 00:57:01,721 - lava_callback - INFO - Starting async job submit for node 69d061c8d2be3e1cf2a5b17b 2026-04-06 00:57:01,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c8d2be3e1cf2a5b17b HTTP/1.1" 200 None 2026-04-06 00:57:01,739 - lava_callback - DEBUG - Processing node 69d061c8d2be3e1cf2a5b17b: baseline-arm64-clabbe 2026-04-06 00:57:01,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061c8d2be3e1cf2a5b17b 2026-04-06 00:57:01,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061c8d2be3e1cf2a5b17b HTTP/1.1" 200 None 2026-04-06 00:57:01,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:57:01,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:01,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061c8d2be3e1cf2a5b17b HTTP/1.1" 200 None 2026-04-06 00:57:01,791 - lava_callback - ERROR - Error processing callback for node 69d061c8d2be3e1cf2a5b17b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:57:02,395 - lava_callback - INFO - Received callback for node 69d061cbd2be3e1cf2a5b184 INFO: 172.21.0.1:49976 - "POST /node/69d061cbd2be3e1cf2a5b184 HTTP/1.0" 202 Accepted 2026-04-06 00:57:02,403 - lava_callback - INFO - Starting async job submit for node 69d061cbd2be3e1cf2a5b184 2026-04-06 00:57:02,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:02,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061cbd2be3e1cf2a5b184 HTTP/1.1" 200 None 2026-04-06 00:57:02,419 - lava_callback - DEBUG - Processing node 69d061cbd2be3e1cf2a5b184: baseline-arm64-clabbe 2026-04-06 00:57:02,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061cbd2be3e1cf2a5b184 2026-04-06 00:57:02,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:02,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061cbd2be3e1cf2a5b184 HTTP/1.1" 200 None 2026-04-06 00:57:02,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:02,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:57:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:02,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061cbd2be3e1cf2a5b184 HTTP/1.1" 200 None 2026-04-06 00:57:02,477 - lava_callback - ERROR - Error processing callback for node 69d061cbd2be3e1cf2a5b184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:57:03,078 - lava_callback - INFO - Received callback for node 69d061cad2be3e1cf2a5b181 INFO: 172.21.0.1:49978 - "POST /node/69d061cad2be3e1cf2a5b181 HTTP/1.0" 202 Accepted 2026-04-06 00:57:03,085 - lava_callback - INFO - Starting async job submit for node 69d061cad2be3e1cf2a5b181 2026-04-06 00:57:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:03,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061cad2be3e1cf2a5b181 HTTP/1.1" 200 None 2026-04-06 00:57:03,106 - lava_callback - DEBUG - Processing node 69d061cad2be3e1cf2a5b181: baseline-arm64-clabbe 2026-04-06 00:57:03,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061cad2be3e1cf2a5b181 2026-04-06 00:57:03,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:03,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061cad2be3e1cf2a5b181 HTTP/1.1" 200 None 2026-04-06 00:57:03,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:03,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 00:57:03,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:03,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061cad2be3e1cf2a5b181 HTTP/1.1" 200 None 2026-04-06 00:57:03,169 - lava_callback - ERROR - Error processing callback for node 69d061cad2be3e1cf2a5b181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:57:04,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:04,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:57:07,350 - lava_callback - INFO - Received callback for node 69d303ce13dd9a9509893d17 INFO: 172.21.0.1:49994 - "POST /node/69d303ce13dd9a9509893d17 HTTP/1.0" 202 Accepted 2026-04-06 00:57:07,356 - lava_callback - INFO - Starting async job submit for node 69d303ce13dd9a9509893d17 2026-04-06 00:57:07,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:07,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ce13dd9a9509893d17 HTTP/1.1" 200 None 2026-04-06 00:57:07,393 - lava_callback - DEBUG - Processing node 69d303ce13dd9a9509893d17: baseline-nfs-arm64 2026-04-06 00:57:07,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:57:07,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:57:07,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303ce13dd9a9509893d17/log.txt.gz 2026-04-06 00:57:08,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:57:08,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:57:08,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303ce13dd9a9509893d17/lava-logs.yaml 2026-04-06 00:57:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:57:08,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:57:08,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303ce13dd9a9509893d17/lava_callback.json.gz 2026-04-06 00:57:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:08,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303ce13dd9a9509893d17 HTTP/1.1" 200 None 2026-04-06 00:57:08,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:08,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:57:08,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303ce13dd9a9509893d17 HTTP/1.1" 200 None 2026-04-06 00:57:08,549 - lava_callback - INFO - Completed processing callback for node 69d303ce13dd9a9509893d17 INFO: 172.21.0.1:33464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:57:21,086 - lava_callback - INFO - Received callback for node 69d061e3d2be3e1cf2a5b1c1 INFO: 172.21.0.1:41444 - "POST /node/69d061e3d2be3e1cf2a5b1c1 HTTP/1.0" 202 Accepted 2026-04-06 00:57:21,091 - lava_callback - INFO - Starting async job submit for node 69d061e3d2be3e1cf2a5b1c1 2026-04-06 00:57:21,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:21,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061e3d2be3e1cf2a5b1c1 HTTP/1.1" 200 None 2026-04-06 00:57:21,110 - lava_callback - DEBUG - Processing node 69d061e3d2be3e1cf2a5b1c1: baseline-arm-clabbe 2026-04-06 00:57:21,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061e3d2be3e1cf2a5b1c1 2026-04-06 00:57:21,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:21,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061e3d2be3e1cf2a5b1c1 HTTP/1.1" 200 None 2026-04-06 00:57:21,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:21,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:57:21,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:21,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061e3d2be3e1cf2a5b1c1 HTTP/1.1" 200 None 2026-04-06 00:57:21,163 - lava_callback - ERROR - Error processing callback for node 69d061e3d2be3e1cf2a5b1c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:57:34,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:34,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:57:41,132 - lava_callback - INFO - Received callback for node 69d061fed2be3e1cf2a5b242 INFO: 172.21.0.1:45994 - "POST /node/69d061fed2be3e1cf2a5b242 HTTP/1.0" 202 Accepted 2026-04-06 00:57:41,138 - lava_callback - INFO - Starting async job submit for node 69d061fed2be3e1cf2a5b242 2026-04-06 00:57:41,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061fed2be3e1cf2a5b242 HTTP/1.1" 200 None 2026-04-06 00:57:41,153 - lava_callback - DEBUG - Processing node 69d061fed2be3e1cf2a5b242: baseline-arm-clabbe 2026-04-06 00:57:41,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d061fed2be3e1cf2a5b242 2026-04-06 00:57:41,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:41,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d061fed2be3e1cf2a5b242 HTTP/1.1" 200 None 2026-04-06 00:57:41,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:41,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:57:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:57:41,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d061fed2be3e1cf2a5b242 HTTP/1.1" 200 None 2026-04-06 00:57:41,207 - lava_callback - ERROR - Error processing callback for node 69d061fed2be3e1cf2a5b242: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:58:13,620 - lava_callback - INFO - Received callback for node 69d303b913dd9a9509893ca2 INFO: 172.21.0.1:37452 - "POST /node/69d303b913dd9a9509893ca2 HTTP/1.0" 202 Accepted 2026-04-06 00:58:13,626 - lava_callback - INFO - Starting async job submit for node 69d303b913dd9a9509893ca2 2026-04-06 00:58:13,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:13,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b913dd9a9509893ca2 HTTP/1.1" 200 None 2026-04-06 00:58:13,661 - lava_callback - DEBUG - Processing node 69d303b913dd9a9509893ca2: baseline-arm64 2026-04-06 00:58:14,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:14,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:14,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b913dd9a9509893ca2/log.txt.gz 2026-04-06 00:58:14,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:14,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:14,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b913dd9a9509893ca2/lava-logs.yaml 2026-04-06 00:58:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:14,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:14,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b913dd9a9509893ca2/lava_callback.json.gz 2026-04-06 00:58:14,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:14,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b913dd9a9509893ca2 HTTP/1.1" 200 None 2026-04-06 00:58:14,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:14,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:58:14,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:14,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b913dd9a9509893ca2 HTTP/1.1" 200 None 2026-04-06 00:58:14,866 - lava_callback - INFO - Completed processing callback for node 69d303b913dd9a9509893ca2 INFO: 172.21.0.1:37464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37470 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:58:21,140 - lava_callback - INFO - Received callback for node 69d0621bd2be3e1cf2a5b2b8 INFO: 172.21.0.1:60444 - "POST /node/69d0621bd2be3e1cf2a5b2b8 HTTP/1.0" 202 Accepted 2026-04-06 00:58:21,146 - lava_callback - INFO - Starting async job submit for node 69d0621bd2be3e1cf2a5b2b8 2026-04-06 00:58:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:21,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0621bd2be3e1cf2a5b2b8 HTTP/1.1" 200 None 2026-04-06 00:58:21,166 - lava_callback - DEBUG - Processing node 69d0621bd2be3e1cf2a5b2b8: baseline-arm-clabbe 2026-04-06 00:58:21,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0621bd2be3e1cf2a5b2b8 2026-04-06 00:58:21,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:21,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0621bd2be3e1cf2a5b2b8 HTTP/1.1" 200 None 2026-04-06 00:58:21,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:21,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 00:58:21,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:21,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0621bd2be3e1cf2a5b2b8 HTTP/1.1" 200 None 2026-04-06 00:58:21,221 - lava_callback - ERROR - Error processing callback for node 69d0621bd2be3e1cf2a5b2b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 00:58:23,368 - lava_callback - INFO - Received callback for node 69d301f013dd9a9509893a55 INFO: 172.21.0.1:60446 - "POST /node/69d301f013dd9a9509893a55 HTTP/1.0" 202 Accepted 2026-04-06 00:58:23,374 - lava_callback - INFO - Starting async job submit for node 69d301f013dd9a9509893a55 2026-04-06 00:58:23,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:23,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301f013dd9a9509893a55 HTTP/1.1" 200 None 2026-04-06 00:58:23,424 - lava_callback - DEBUG - Processing node 69d301f013dd9a9509893a55: ltp-timers 2026-04-06 00:58:23,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:23,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:23,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d301f013dd9a9509893a55/log.txt.gz 2026-04-06 00:58:24,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:24,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:24,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d301f013dd9a9509893a55/lava-logs.yaml 2026-04-06 00:58:24,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:24,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:24,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d301f013dd9a9509893a55/lava_callback.json.gz 2026-04-06 00:58:24,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:24,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301f013dd9a9509893a55 HTTP/1.1" 200 None 2026-04-06 00:58:24,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:24,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 00:58:24,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301f013dd9a9509893a55 HTTP/1.1" 200 None 2026-04-06 00:58:24,706 - lava_callback - INFO - Completed processing callback for node 69d301f013dd9a9509893a55 INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:58:28,622 - lava_callback - INFO - Received callback for node 69d303cc13dd9a9509893d12 INFO: 172.21.0.1:60464 - "POST /node/69d303cc13dd9a9509893d12 HTTP/1.0" 202 Accepted 2026-04-06 00:58:28,628 - lava_callback - INFO - Starting async job submit for node 69d303cc13dd9a9509893d12 2026-04-06 00:58:28,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:28,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cc13dd9a9509893d12 HTTP/1.1" 200 None 2026-04-06 00:58:28,662 - lava_callback - DEBUG - Processing node 69d303cc13dd9a9509893d12: baseline-nfs-arm64 2026-04-06 00:58:29,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:29,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:29,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cc13dd9a9509893d12/log.txt.gz 2026-04-06 00:58:29,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:29,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:29,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cc13dd9a9509893d12/lava-logs.yaml 2026-04-06 00:58:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:58:29,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:58:29,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cc13dd9a9509893d12/lava_callback.json.gz 2026-04-06 00:58:29,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:29,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cc13dd9a9509893d12 HTTP/1.1" 200 None 2026-04-06 00:58:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:29,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:58:29,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:29,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303cc13dd9a9509893d12 HTTP/1.1" 200 None 2026-04-06 00:58:29,917 - lava_callback - INFO - Completed processing callback for node 69d303cc13dd9a9509893d12 2026-04-06 00:58:34,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:58:34,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:59:10,189 - lava_callback - INFO - Received callback for node 69d3040613dd9a9509893e13 INFO: 172.21.0.1:34576 - "POST /node/69d3040613dd9a9509893e13 HTTP/1.0" 202 Accepted 2026-04-06 00:59:10,200 - lava_callback - INFO - Starting async job submit for node 69d3040613dd9a9509893e13 2026-04-06 00:59:10,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:59:10,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040613dd9a9509893e13 HTTP/1.1" 200 None 2026-04-06 00:59:10,277 - lava_callback - DEBUG - Processing node 69d3040613dd9a9509893e13: baseline-arm64-foundriesio 2026-04-06 00:59:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:59:11,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:59:11,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040613dd9a9509893e13/log.txt.gz 2026-04-06 00:59:12,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:59:13,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:59:13,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040613dd9a9509893e13/lava-logs.yaml 2026-04-06 00:59:13,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 00:59:13,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 00:59:13,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d3040613dd9a9509893e13/lava_callback.json.gz DEBUG: Setup failed for 69d3040613dd9a9509893e13. Transitting job node result: incomplete -> fail 2026-04-06 00:59:13,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:59:13,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040613dd9a9509893e13 HTTP/1.1" 200 None 2026-04-06 00:59:13,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:59:13,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 00:59:13,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:59:13,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040613dd9a9509893e13 HTTP/1.1" 200 None 2026-04-06 00:59:13,626 - lava_callback - INFO - Completed processing callback for node 69d3040613dd9a9509893e13 INFO: 172.21.0.1:34582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK 2026-04-06 00:59:34,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 00:59:34,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:01:03,416 - lava_callback - INFO - Received callback for node 69d304e213dd9a950989402f INFO: 172.21.0.1:34320 - "POST /node/69d304e213dd9a950989402f HTTP/1.0" 202 Accepted 2026-04-06 01:01:03,427 - lava_callback - INFO - Starting async job submit for node 69d304e213dd9a950989402f 2026-04-06 01:01:03,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:03,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d304e213dd9a950989402f HTTP/1.1" 200 None 2026-04-06 01:01:03,503 - lava_callback - DEBUG - Processing node 69d304e213dd9a950989402f: ltp-cap_bounds 2026-04-06 01:01:03,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:04,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:04,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d304e213dd9a950989402f/log.txt.gz 2026-04-06 01:01:04,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:04,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:04,617 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d304e213dd9a950989402f/lava-logs.yaml 2026-04-06 01:01:04,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:04,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:04,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d304e213dd9a950989402f/lava_callback.json.gz 2026-04-06 01:01:04,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:04,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d304e213dd9a950989402f HTTP/1.1" 200 None 2026-04-06 01:01:04,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:04,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:01:04,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:04,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d304e213dd9a950989402f HTTP/1.1" 200 None 2026-04-06 01:01:04,972 - lava_callback - INFO - Completed processing callback for node 69d304e213dd9a950989402f INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:01:07,878 - lava_callback - INFO - Received callback for node 69d301ac13dd9a95098938e4 INFO: 172.21.0.1:34332 - "POST /node/69d301ac13dd9a95098938e4 HTTP/1.0" 202 Accepted 2026-04-06 01:01:07,885 - lava_callback - INFO - Starting async job submit for node 69d301ac13dd9a95098938e4 2026-04-06 01:01:07,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:07,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ac13dd9a95098938e4 HTTP/1.1" 200 None 2026-04-06 01:01:07,963 - lava_callback - DEBUG - Processing node 69d301ac13dd9a95098938e4: baseline-arm 2026-04-06 01:01:08,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:08,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:08,848 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ac13dd9a95098938e4/log.txt.gz 2026-04-06 01:01:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:09,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:09,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ac13dd9a95098938e4/lava-logs.yaml 2026-04-06 01:01:09,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:09,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:09,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d301ac13dd9a95098938e4/lava_callback.json.gz DEBUG: Setup failed for 69d301ac13dd9a95098938e4. Transitting job node result: incomplete -> fail 2026-04-06 01:01:09,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:09,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301ac13dd9a95098938e4 HTTP/1.1" 200 None 2026-04-06 01:01:09,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:09,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:01:09,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:09,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301ac13dd9a95098938e4 HTTP/1.1" 200 None 2026-04-06 01:01:10,113 - lava_callback - INFO - Completed processing callback for node 69d301ac13dd9a95098938e4 INFO: 172.21.0.1:49472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:01:34,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:34,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:01:41,519 - lava_callback - INFO - Received callback for node 69d303c913dd9a9509893cf9 INFO: 172.21.0.1:50870 - "POST /node/69d303c913dd9a9509893cf9 HTTP/1.0" 202 Accepted 2026-04-06 01:01:41,526 - lava_callback - INFO - Starting async job submit for node 69d303c913dd9a9509893cf9 2026-04-06 01:01:41,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:41,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c913dd9a9509893cf9 HTTP/1.1" 200 None 2026-04-06 01:01:41,588 - lava_callback - DEBUG - Processing node 69d303c913dd9a9509893cf9: baseline-arm64 2026-04-06 01:01:41,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:42,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:42,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c913dd9a9509893cf9/log.txt.gz 2026-04-06 01:01:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:42,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:42,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c913dd9a9509893cf9/lava-logs.yaml 2026-04-06 01:01:42,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:01:43,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:01:43,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c913dd9a9509893cf9/lava_callback.json.gz DEBUG: Setup failed for 69d303c913dd9a9509893cf9. Transitting job node result: incomplete -> fail 2026-04-06 01:01:43,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:43,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c913dd9a9509893cf9 HTTP/1.1" 200 None 2026-04-06 01:01:43,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:43,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:01:43,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:01:43,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c913dd9a9509893cf9 HTTP/1.1" 200 None 2026-04-06 01:01:43,336 - lava_callback - INFO - Completed processing callback for node 69d303c913dd9a9509893cf9 INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:02:04,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:04,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:02:21,323 - lava_callback - INFO - Received callback for node 69d06317d2be3e1cf2a5b41a INFO: 172.21.0.1:56112 - "POST /node/69d06317d2be3e1cf2a5b41a HTTP/1.0" 202 Accepted 2026-04-06 01:02:21,328 - lava_callback - INFO - Starting async job submit for node 69d06317d2be3e1cf2a5b41a 2026-04-06 01:02:21,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:21,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06317d2be3e1cf2a5b41a HTTP/1.1" 200 None 2026-04-06 01:02:21,345 - lava_callback - DEBUG - Processing node 69d06317d2be3e1cf2a5b41a: baseline-arm-clabbe 2026-04-06 01:02:21,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06317d2be3e1cf2a5b41a 2026-04-06 01:02:21,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:21,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06317d2be3e1cf2a5b41a HTTP/1.1" 200 None 2026-04-06 01:02:21,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:21,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 01:02:21,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06317d2be3e1cf2a5b41a HTTP/1.1" 200 None 2026-04-06 01:02:21,401 - lava_callback - ERROR - Error processing callback for node 69d06317d2be3e1cf2a5b41a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 01:02:23,427 - lava_callback - INFO - Received callback for node 69d3050513dd9a9509894047 INFO: 172.21.0.1:56118 - "POST /node/69d3050513dd9a9509894047 HTTP/1.0" 202 Accepted 2026-04-06 01:02:23,434 - lava_callback - INFO - Starting async job submit for node 69d3050513dd9a9509894047 2026-04-06 01:02:23,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:23,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3050513dd9a9509894047 HTTP/1.1" 200 None 2026-04-06 01:02:23,481 - lava_callback - DEBUG - Processing node 69d3050513dd9a9509894047: ltp-containers 2026-04-06 01:02:23,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:24,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:24,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d3050513dd9a9509894047/log.txt.gz 2026-04-06 01:02:24,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:24,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:24,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d3050513dd9a9509894047/lava-logs.yaml 2026-04-06 01:02:24,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:24,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:24,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d3050513dd9a9509894047/lava_callback.json.gz 2026-04-06 01:02:24,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:24,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3050513dd9a9509894047 HTTP/1.1" 200 None 2026-04-06 01:02:24,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:24,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:02:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:24,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3050513dd9a9509894047 HTTP/1.1" 200 None 2026-04-06 01:02:24,844 - lava_callback - INFO - Completed processing callback for node 69d3050513dd9a9509894047 INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:02:34,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:34,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:02:37,309 - lava_callback - INFO - Received callback for node 69d3061213dd9a9509894162 INFO: 172.21.0.1:57054 - "POST /node/69d3061213dd9a9509894162 HTTP/1.0" 202 Accepted 2026-04-06 01:02:37,315 - lava_callback - INFO - Starting async job submit for node 69d3061213dd9a9509894162 2026-04-06 01:02:37,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:37,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3061213dd9a9509894162 HTTP/1.1" 200 None 2026-04-06 01:02:37,336 - lava_callback - DEBUG - Processing node 69d3061213dd9a9509894162: baseline-arm 2026-04-06 01:02:37,341 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:02:37,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:37,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:37,465 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d3061213dd9a9509894162/lava-logs.yaml 2026-04-06 01:02:37,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:37,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:37,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d3061213dd9a9509894162/lava_callback.json.gz 2026-04-06 01:02:37,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:37,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3061213dd9a9509894162 HTTP/1.1" 200 None 2026-04-06 01:02:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:37,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:02:37,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:37,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3061213dd9a9509894162 HTTP/1.1" 200 None 2026-04-06 01:02:37,654 - lava_callback - INFO - Completed processing callback for node 69d3061213dd9a9509894162 INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:02:53,722 - lava_callback - INFO - Received callback for node 69d303b613dd9a9509893c9c INFO: 172.21.0.1:54056 - "POST /node/69d303b613dd9a9509893c9c HTTP/1.0" 202 Accepted 2026-04-06 01:02:53,729 - lava_callback - INFO - Starting async job submit for node 69d303b613dd9a9509893c9c 2026-04-06 01:02:53,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:53,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b613dd9a9509893c9c HTTP/1.1" 200 None 2026-04-06 01:02:53,778 - lava_callback - DEBUG - Processing node 69d303b613dd9a9509893c9c: baseline-arm64 2026-04-06 01:02:53,907 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:02:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:54,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:54,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b613dd9a9509893c9c/lava-logs.yaml 2026-04-06 01:02:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:02:54,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:02:54,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b613dd9a9509893c9c/lava_callback.json.gz 2026-04-06 01:02:54,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:54,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b613dd9a9509893c9c HTTP/1.1" 200 None 2026-04-06 01:02:54,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:54,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:02:54,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:02:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b613dd9a9509893c9c HTTP/1.1" 200 None 2026-04-06 01:02:54,715 - lava_callback - INFO - Completed processing callback for node 69d303b613dd9a9509893c9c INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:03:01,292 - lava_callback - INFO - Received callback for node 69d06338d2be3e1cf2a5b45e INFO: 172.21.0.1:50054 - "POST /node/69d06338d2be3e1cf2a5b45e HTTP/1.0" 202 Accepted 2026-04-06 01:03:01,301 - lava_callback - INFO - Starting async job submit for node 69d06338d2be3e1cf2a5b45e 2026-04-06 01:03:01,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:01,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06338d2be3e1cf2a5b45e HTTP/1.1" 200 None 2026-04-06 01:03:01,318 - lava_callback - DEBUG - Processing node 69d06338d2be3e1cf2a5b45e: baseline-arm-clabbe 2026-04-06 01:03:01,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06338d2be3e1cf2a5b45e 2026-04-06 01:03:01,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:01,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06338d2be3e1cf2a5b45e HTTP/1.1" 200 None 2026-04-06 01:03:01,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:01,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 01:03:01,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:01,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06338d2be3e1cf2a5b45e HTTP/1.1" 200 None 2026-04-06 01:03:01,378 - lava_callback - ERROR - Error processing callback for node 69d06338d2be3e1cf2a5b45e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 01:03:03,479 - lava_callback - INFO - Received callback for node 69d3055b13dd9a95098940fc INFO: 172.21.0.1:50068 - "POST /node/69d3055b13dd9a95098940fc HTTP/1.0" 202 Accepted 2026-04-06 01:03:03,486 - lava_callback - INFO - Starting async job submit for node 69d3055b13dd9a95098940fc 2026-04-06 01:03:03,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:03,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3055b13dd9a95098940fc HTTP/1.1" 200 None 2026-04-06 01:03:03,527 - lava_callback - DEBUG - Processing node 69d3055b13dd9a95098940fc: ltp-fsx 2026-04-06 01:03:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:03:03,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:03:03,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d3055b13dd9a95098940fc/log.txt.gz 2026-04-06 01:03:04,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:03:04,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:03:04,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d3055b13dd9a95098940fc/lava-logs.yaml 2026-04-06 01:03:04,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:03:04,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:03:04,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d3055b13dd9a95098940fc/lava_callback.json.gz 2026-04-06 01:03:04,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:04,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3055b13dd9a95098940fc HTTP/1.1" 200 None 2026-04-06 01:03:04,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:04,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:03:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:04,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3055b13dd9a95098940fc HTTP/1.1" 200 None 2026-04-06 01:03:04,649 - lava_callback - INFO - Completed processing callback for node 69d3055b13dd9a95098940fc 2026-04-06 01:03:04,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:04,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:03:41,331 - lava_callback - INFO - Received callback for node 69d0635ed2be3e1cf2a5b498 INFO: 172.21.0.1:51238 - "POST /node/69d0635ed2be3e1cf2a5b498 HTTP/1.0" 202 Accepted 2026-04-06 01:03:41,337 - lava_callback - INFO - Starting async job submit for node 69d0635ed2be3e1cf2a5b498 2026-04-06 01:03:41,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:41,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0635ed2be3e1cf2a5b498 HTTP/1.1" 200 None 2026-04-06 01:03:41,354 - lava_callback - DEBUG - Processing node 69d0635ed2be3e1cf2a5b498: baseline-arm-clabbe 2026-04-06 01:03:41,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0635ed2be3e1cf2a5b498 2026-04-06 01:03:41,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:41,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0635ed2be3e1cf2a5b498 HTTP/1.1" 200 None 2026-04-06 01:03:41,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:41,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 01:03:41,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:03:41,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0635ed2be3e1cf2a5b498 HTTP/1.1" 200 None 2026-04-06 01:03:41,416 - lava_callback - ERROR - Error processing callback for node 69d0635ed2be3e1cf2a5b498: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:04:21,330 - lava_callback - INFO - Received callback for node 69d06384d2be3e1cf2a5b50a INFO: 172.21.0.1:34962 - "POST /node/69d06384d2be3e1cf2a5b50a HTTP/1.0" 202 Accepted 2026-04-06 01:04:21,336 - lava_callback - INFO - Starting async job submit for node 69d06384d2be3e1cf2a5b50a 2026-04-06 01:04:21,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:04:21,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06384d2be3e1cf2a5b50a HTTP/1.1" 200 None 2026-04-06 01:04:21,353 - lava_callback - DEBUG - Processing node 69d06384d2be3e1cf2a5b50a: baseline-arm-clabbe 2026-04-06 01:04:21,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06384d2be3e1cf2a5b50a 2026-04-06 01:04:21,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:04:21,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06384d2be3e1cf2a5b50a HTTP/1.1" 200 None 2026-04-06 01:04:21,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:04:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 01:04:21,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:04:21,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06384d2be3e1cf2a5b50a HTTP/1.1" 200 None 2026-04-06 01:04:21,407 - lava_callback - ERROR - Error processing callback for node 69d06384d2be3e1cf2a5b50a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:05:03,602 - lava_callback - INFO - Received callback for node 69d3058313dd9a9509894111 INFO: 172.21.0.1:51840 - "POST /node/69d3058313dd9a9509894111 HTTP/1.0" 202 Accepted 2026-04-06 01:05:03,609 - lava_callback - INFO - Starting async job submit for node 69d3058313dd9a9509894111 2026-04-06 01:05:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:03,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3058313dd9a9509894111 HTTP/1.1" 200 None 2026-04-06 01:05:03,649 - lava_callback - DEBUG - Processing node 69d3058313dd9a9509894111: ltp-watchqueue 2026-04-06 01:05:04,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:04,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:04,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d3058313dd9a9509894111/log.txt.gz 2026-04-06 01:05:04,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:04,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:04,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d3058313dd9a9509894111/lava-logs.yaml 2026-04-06 01:05:04,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:04,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:04,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d3058313dd9a9509894111/lava_callback.json.gz 2026-04-06 01:05:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:04,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3058313dd9a9509894111 HTTP/1.1" 200 None 2026-04-06 01:05:05,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:05,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:05:05,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:05,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3058313dd9a9509894111 HTTP/1.1" 200 None 2026-04-06 01:05:05,048 - lava_callback - INFO - Completed processing callback for node 69d3058313dd9a9509894111 INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:05:25,990 - lava_callback - INFO - Received callback for node 69d303b813dd9a9509893c9f INFO: 172.21.0.1:53168 - "POST /node/69d303b813dd9a9509893c9f HTTP/1.0" 202 Accepted 2026-04-06 01:05:25,997 - lava_callback - INFO - Starting async job submit for node 69d303b813dd9a9509893c9f 2026-04-06 01:05:26,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:26,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b813dd9a9509893c9f HTTP/1.1" 200 None 2026-04-06 01:05:26,042 - lava_callback - DEBUG - Processing node 69d303b813dd9a9509893c9f: baseline-arm64 2026-04-06 01:05:26,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:26,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:26,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b813dd9a9509893c9f/log.txt.gz 2026-04-06 01:05:26,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:05:26,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:26,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b813dd9a9509893c9f/lava-logs.yaml 2026-04-06 01:05:26,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:26,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:26,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303b813dd9a9509893c9f/lava_callback.json.gz 2026-04-06 01:05:26,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:26,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303b813dd9a9509893c9f HTTP/1.1" 200 None 2026-04-06 01:05:26,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:26,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:05:26,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:26,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303b813dd9a9509893c9f HTTP/1.1" 200 None 2026-04-06 01:05:27,009 - lava_callback - INFO - Completed processing callback for node 69d303b813dd9a9509893c9f 2026-04-06 01:05:34,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:34,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 01:05:35,715 - lava_callback - INFO - Received callback for node 69d3052013dd9a9509894063 INFO: 172.21.0.1:48664 - "POST /node/69d3052013dd9a9509894063 HTTP/1.0" 202 Accepted 2026-04-06 01:05:35,721 - lava_callback - INFO - Starting async job submit for node 69d3052013dd9a9509894063 2026-04-06 01:05:35,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:35,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3052013dd9a9509894063 HTTP/1.1" 200 None 2026-04-06 01:05:35,773 - lava_callback - DEBUG - Processing node 69d3052013dd9a9509894063: ltp-controllers 2026-04-06 01:05:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:36,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:36,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d3052013dd9a9509894063/log.txt.gz INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:05:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:36,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:36,931 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d3052013dd9a9509894063/lava-logs.yaml 2026-04-06 01:05:36,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:05:37,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:05:37,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d3052013dd9a9509894063/lava_callback.json.gz 2026-04-06 01:05:37,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:37,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3052013dd9a9509894063 HTTP/1.1" 200 None 2026-04-06 01:05:37,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:37,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:05:37,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:05:37,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3052013dd9a9509894063 HTTP/1.1" 200 None 2026-04-06 01:05:37,245 - lava_callback - INFO - Completed processing callback for node 69d3052013dd9a9509894063 INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:06:04,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:06:04,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:07:01,492 - lava_callback - INFO - Received callback for node 69d06430d2be3e1cf2a5b5a6 INFO: 172.21.0.1:35342 - "POST /node/69d06430d2be3e1cf2a5b5a6 HTTP/1.0" 202 Accepted 2026-04-06 01:07:01,503 - lava_callback - INFO - Starting async job submit for node 69d06430d2be3e1cf2a5b5a6 2026-04-06 01:07:01,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:01,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06430d2be3e1cf2a5b5a6 HTTP/1.1" 200 None 2026-04-06 01:07:01,566 - lava_callback - DEBUG - Processing node 69d06430d2be3e1cf2a5b5a6: baseline-arm-clabbe 2026-04-06 01:07:01,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06430d2be3e1cf2a5b5a6 2026-04-06 01:07:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:01,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06430d2be3e1cf2a5b5a6 HTTP/1.1" 200 None 2026-04-06 01:07:01,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:01,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-06 01:07:01,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:01,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06430d2be3e1cf2a5b5a6 HTTP/1.1" 200 None 2026-04-06 01:07:01,688 - lava_callback - ERROR - Error processing callback for node 69d06430d2be3e1cf2a5b5a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:07:16,614 - lava_callback - INFO - Received callback for node 69d3072813dd9a9509894257 INFO: 172.21.0.1:47058 - "POST /node/69d3072813dd9a9509894257 HTTP/1.0" 202 Accepted 2026-04-06 01:07:16,621 - lava_callback - INFO - Starting async job submit for node 69d3072813dd9a9509894257 2026-04-06 01:07:16,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:16,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3072813dd9a9509894257 HTTP/1.1" 200 None 2026-04-06 01:07:16,640 - lava_callback - DEBUG - Processing node 69d3072813dd9a9509894257: baseline-nfs-arm64 2026-04-06 01:07:16,641 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:07:16,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:07:16,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:07:16,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3072813dd9a9509894257/lava-logs.yaml 2026-04-06 01:07:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:07:17,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:07:17,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3072813dd9a9509894257/lava_callback.json.gz 2026-04-06 01:07:17,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:17,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3072813dd9a9509894257 HTTP/1.1" 200 None 2026-04-06 01:07:17,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:17,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:07:17,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:17,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3072813dd9a9509894257 HTTP/1.1" 200 None 2026-04-06 01:07:17,547 - lava_callback - INFO - Completed processing callback for node 69d3072813dd9a9509894257 INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:07:34,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:07:34,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:09:35,712 - lava_callback - INFO - Received callback for node 69d3077313dd9a95098942b2 INFO: 172.21.0.1:40268 - "POST /node/69d3077313dd9a95098942b2 HTTP/1.0" 202 Accepted 2026-04-06 01:09:35,719 - lava_callback - INFO - Starting async job submit for node 69d3077313dd9a95098942b2 2026-04-06 01:09:35,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:09:35,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3077313dd9a95098942b2 HTTP/1.1" 200 None 2026-04-06 01:09:35,760 - lava_callback - DEBUG - Processing node 69d3077313dd9a95098942b2: baseline-arm64-broonie 2026-04-06 01:09:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:09:36,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:09:36,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3077313dd9a95098942b2/log.txt.gz 2026-04-06 01:09:36,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:09:36,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:09:36,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3077313dd9a95098942b2/lava-logs.yaml 2026-04-06 01:09:36,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40270 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:09:36,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:09:36,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3077313dd9a95098942b2/lava_callback.json.gz 2026-04-06 01:09:36,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:09:36,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3077313dd9a95098942b2 HTTP/1.1" 200 None 2026-04-06 01:09:36,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:09:36,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:09:36,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:09:36,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3077313dd9a95098942b2 HTTP/1.1" 200 None 2026-04-06 01:09:36,729 - lava_callback - INFO - Completed processing callback for node 69d3077313dd9a95098942b2 INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:10:04,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:10:04,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:11:29,232 - lava_callback - INFO - Received callback for node 69d303d613dd9a9509893d33 INFO: 172.21.0.1:36000 - "POST /node/69d303d613dd9a9509893d33 HTTP/1.0" 202 Accepted 2026-04-06 01:11:29,239 - lava_callback - INFO - Starting async job submit for node 69d303d613dd9a9509893d33 2026-04-06 01:11:29,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:29,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d613dd9a9509893d33 HTTP/1.1" 200 None 2026-04-06 01:11:29,279 - lava_callback - DEBUG - Processing node 69d303d613dd9a9509893d33: baseline-nfs-arm64 2026-04-06 01:11:29,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:29,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:29,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d613dd9a9509893d33/log.txt.gz 2026-04-06 01:11:30,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:30,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:30,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d613dd9a9509893d33/lava-logs.yaml 2026-04-06 01:11:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:30,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:30,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303d613dd9a9509893d33/lava_callback.json.gz 2026-04-06 01:11:30,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:30,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303d613dd9a9509893d33 HTTP/1.1" 200 None 2026-04-06 01:11:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:30,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:11:30,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:30,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303d613dd9a9509893d33 HTTP/1.1" 200 None 2026-04-06 01:11:30,799 - lava_callback - INFO - Completed processing callback for node 69d303d613dd9a9509893d33 2026-04-06 01:11:34,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:35,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:11:50,684 - lava_callback - INFO - Received callback for node 69d303c313dd9a9509893cb7 INFO: 172.21.0.1:40758 - "POST /node/69d303c313dd9a9509893cb7 HTTP/1.0" 202 Accepted 2026-04-06 01:11:50,691 - lava_callback - INFO - Starting async job submit for node 69d303c313dd9a9509893cb7 2026-04-06 01:11:50,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:50,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c313dd9a9509893cb7 HTTP/1.1" 200 None 2026-04-06 01:11:50,739 - lava_callback - DEBUG - Processing node 69d303c313dd9a9509893cb7: baseline-arm64 2026-04-06 01:11:51,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:51,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:51,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c313dd9a9509893cb7/log.txt.gz 2026-04-06 01:11:51,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:51,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:51,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c313dd9a9509893cb7/lava-logs.yaml 2026-04-06 01:11:51,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:11:52,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:11:52,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d303c313dd9a9509893cb7/lava_callback.json.gz 2026-04-06 01:11:52,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:52,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c313dd9a9509893cb7 HTTP/1.1" 200 None 2026-04-06 01:11:52,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:52,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:11:52,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:11:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c313dd9a9509893cb7 HTTP/1.1" 200 None 2026-04-06 01:11:52,159 - lava_callback - INFO - Completed processing callback for node 69d303c313dd9a9509893cb7 INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:12:05,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:12:05,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:12:50,258 - lava_callback - INFO - Received callback for node 69d0658dd2be3e1cf2a5b728 INFO: 172.21.0.1:52940 - "POST /node/69d0658dd2be3e1cf2a5b728 HTTP/1.0" 202 Accepted 2026-04-06 01:12:50,265 - lava_callback - INFO - Starting async job submit for node 69d0658dd2be3e1cf2a5b728 2026-04-06 01:12:50,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:12:50,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0658dd2be3e1cf2a5b728 HTTP/1.1" 200 None 2026-04-06 01:12:50,281 - lava_callback - DEBUG - Processing node 69d0658dd2be3e1cf2a5b728: baseline-arm-baylibre 2026-04-06 01:12:50,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0658dd2be3e1cf2a5b728 2026-04-06 01:12:50,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:12:50,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0658dd2be3e1cf2a5b728 HTTP/1.1" 200 None 2026-04-06 01:12:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:12:50,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:12:50,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:12:50,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0658dd2be3e1cf2a5b728 HTTP/1.1" 200 None 2026-04-06 01:12:50,356 - lava_callback - ERROR - Error processing callback for node 69d0658dd2be3e1cf2a5b728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:14:14,229 - lava_callback - INFO - Received callback for node 69d303cf13dd9a9509893d1a INFO: 172.21.0.1:48166 - "POST /node/69d303cf13dd9a9509893d1a HTTP/1.0" 202 Accepted 2026-04-06 01:14:14,241 - lava_callback - INFO - Starting async job submit for node 69d303cf13dd9a9509893d1a 2026-04-06 01:14:14,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:14:14,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cf13dd9a9509893d1a HTTP/1.1" 200 None 2026-04-06 01:14:14,320 - lava_callback - DEBUG - Processing node 69d303cf13dd9a9509893d1a: baseline-nfs-arm64 INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 01:14:15,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:14:15,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:14:15,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cf13dd9a9509893d1a/log.txt.gz 2026-04-06 01:14:16,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:14:16,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:14:16,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cf13dd9a9509893d1a/lava-logs.yaml 2026-04-06 01:14:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:14:16,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:14:16,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d303cf13dd9a9509893d1a/lava_callback.json.gz DEBUG: Setup failed for 69d303cf13dd9a9509893d1a. Transitting job node result: incomplete -> fail 2026-04-06 01:14:16,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:14:17,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303cf13dd9a9509893d1a HTTP/1.1" 200 None 2026-04-06 01:14:17,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:14:17,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:14:17,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:14:17,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303cf13dd9a9509893d1a HTTP/1.1" 200 None 2026-04-06 01:14:17,149 - lava_callback - INFO - Completed processing callback for node 69d303cf13dd9a9509893d1a INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:14:35,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:14:35,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:15:43,898 - lava_callback - INFO - Received callback for node 69d308bd13dd9a950989437d INFO: 172.21.0.1:38404 - "POST /node/69d308bd13dd9a950989437d HTTP/1.0" 202 Accepted 2026-04-06 01:15:43,904 - lava_callback - INFO - Starting async job submit for node 69d308bd13dd9a950989437d 2026-04-06 01:15:43,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:15:43,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d308bd13dd9a950989437d HTTP/1.1" 200 None 2026-04-06 01:15:43,947 - lava_callback - DEBUG - Processing node 69d308bd13dd9a950989437d: baseline-arm64 2026-04-06 01:15:44,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:15:44,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:15:44,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d308bd13dd9a950989437d/log.txt.gz 2026-04-06 01:15:44,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:15:45,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:15:45,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d308bd13dd9a950989437d/lava-logs.yaml 2026-04-06 01:15:45,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:15:45,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:15:45,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d308bd13dd9a950989437d/lava_callback.json.gz 2026-04-06 01:15:45,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:15:45,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d308bd13dd9a950989437d HTTP/1.1" 200 None 2026-04-06 01:15:45,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:15:45,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:15:45,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:15:45,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d308bd13dd9a950989437d HTTP/1.1" 200 None 2026-04-06 01:15:45,415 - lava_callback - INFO - Completed processing callback for node 69d308bd13dd9a950989437d INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:16:05,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:16:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:17:30,516 - lava_callback - INFO - Received callback for node 69d0669dd2be3e1cf2a5b81b INFO: 172.21.0.1:54970 - "POST /node/69d0669dd2be3e1cf2a5b81b HTTP/1.0" 202 Accepted 2026-04-06 01:17:30,522 - lava_callback - INFO - Starting async job submit for node 69d0669dd2be3e1cf2a5b81b 2026-04-06 01:17:30,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:17:30,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0669dd2be3e1cf2a5b81b HTTP/1.1" 200 None 2026-04-06 01:17:30,537 - lava_callback - DEBUG - Processing node 69d0669dd2be3e1cf2a5b81b: baseline-arm-baylibre 2026-04-06 01:17:30,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0669dd2be3e1cf2a5b81b 2026-04-06 01:17:30,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:17:30,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0669dd2be3e1cf2a5b81b HTTP/1.1" 200 None 2026-04-06 01:17:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:17:30,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:17:30,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:17:30,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0669dd2be3e1cf2a5b81b HTTP/1.1" 200 None 2026-04-06 01:17:30,597 - lava_callback - ERROR - Error processing callback for node 69d0669dd2be3e1cf2a5b81b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:19:10,705 - lava_callback - INFO - Received callback for node 69d06700d2be3e1cf2a5b872 INFO: 172.21.0.1:36168 - "POST /node/69d06700d2be3e1cf2a5b872 HTTP/1.0" 202 Accepted 2026-04-06 01:19:10,711 - lava_callback - INFO - Starting async job submit for node 69d06700d2be3e1cf2a5b872 2026-04-06 01:19:10,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:19:10,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06700d2be3e1cf2a5b872 HTTP/1.1" 200 None 2026-04-06 01:19:10,726 - lava_callback - DEBUG - Processing node 69d06700d2be3e1cf2a5b872: baseline-arm-baylibre 2026-04-06 01:19:10,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06700d2be3e1cf2a5b872 2026-04-06 01:19:10,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:19:10,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06700d2be3e1cf2a5b872 HTTP/1.1" 200 None 2026-04-06 01:19:10,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:19:10,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:19:10,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:19:10,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06700d2be3e1cf2a5b872 HTTP/1.1" 200 None 2026-04-06 01:19:10,777 - lava_callback - ERROR - Error processing callback for node 69d06700d2be3e1cf2a5b872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:20:50,688 - lava_callback - INFO - Received callback for node 69d06764d2be3e1cf2a5b8ff INFO: 172.21.0.1:40504 - "POST /node/69d06764d2be3e1cf2a5b8ff HTTP/1.0" 202 Accepted 2026-04-06 01:20:50,694 - lava_callback - INFO - Starting async job submit for node 69d06764d2be3e1cf2a5b8ff 2026-04-06 01:20:50,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:20:50,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06764d2be3e1cf2a5b8ff HTTP/1.1" 200 None 2026-04-06 01:20:50,710 - lava_callback - DEBUG - Processing node 69d06764d2be3e1cf2a5b8ff: baseline-arm-baylibre 2026-04-06 01:20:50,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06764d2be3e1cf2a5b8ff 2026-04-06 01:20:50,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:20:50,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06764d2be3e1cf2a5b8ff HTTP/1.1" 200 None 2026-04-06 01:20:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:20:50,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:20:50,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:20:50,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06764d2be3e1cf2a5b8ff HTTP/1.1" 200 None 2026-04-06 01:20:50,768 - lava_callback - ERROR - Error processing callback for node 69d06764d2be3e1cf2a5b8ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:22:42,353 - lava_callback - INFO - Received callback for node 69d067d0d2be3e1cf2a5b934 INFO: 172.21.0.1:43494 - "POST /node/69d067d0d2be3e1cf2a5b934 HTTP/1.0" 202 Accepted 2026-04-06 01:22:42,359 - lava_callback - INFO - Starting async job submit for node 69d067d0d2be3e1cf2a5b934 2026-04-06 01:22:42,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:22:42,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d067d0d2be3e1cf2a5b934 HTTP/1.1" 200 None 2026-04-06 01:22:42,378 - lava_callback - DEBUG - Processing node 69d067d0d2be3e1cf2a5b934: baseline-arm-clabbe 2026-04-06 01:22:42,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d067d0d2be3e1cf2a5b934 2026-04-06 01:22:42,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:22:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d067d0d2be3e1cf2a5b934 HTTP/1.1" 200 None 2026-04-06 01:22:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:22:42,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:22:42,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:22:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d067d0d2be3e1cf2a5b934 HTTP/1.1" 200 None 2026-04-06 01:22:42,441 - lava_callback - ERROR - Error processing callback for node 69d067d0d2be3e1cf2a5b934: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:23:10,821 - lava_callback - INFO - Received callback for node 69d067f3d2be3e1cf2a5b957 INFO: 172.21.0.1:51548 - "POST /node/69d067f3d2be3e1cf2a5b957 HTTP/1.0" 202 Accepted 2026-04-06 01:23:10,827 - lava_callback - INFO - Starting async job submit for node 69d067f3d2be3e1cf2a5b957 2026-04-06 01:23:10,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:10,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d067f3d2be3e1cf2a5b957 HTTP/1.1" 200 None 2026-04-06 01:23:10,844 - lava_callback - DEBUG - Processing node 69d067f3d2be3e1cf2a5b957: baseline-arm-baylibre 2026-04-06 01:23:10,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d067f3d2be3e1cf2a5b957 2026-04-06 01:23:10,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:10,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d067f3d2be3e1cf2a5b957 HTTP/1.1" 200 None 2026-04-06 01:23:10,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:10,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:23:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:10,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d067f3d2be3e1cf2a5b957 HTTP/1.1" 200 None 2026-04-06 01:23:10,898 - lava_callback - ERROR - Error processing callback for node 69d067f3d2be3e1cf2a5b957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:23:50,824 - lava_callback - INFO - Received callback for node 69d06816d2be3e1cf2a5b971 INFO: 172.21.0.1:54792 - "POST /node/69d06816d2be3e1cf2a5b971 HTTP/1.0" 202 Accepted 2026-04-06 01:23:50,830 - lava_callback - INFO - Starting async job submit for node 69d06816d2be3e1cf2a5b971 2026-04-06 01:23:50,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:50,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06816d2be3e1cf2a5b971 HTTP/1.1" 200 None 2026-04-06 01:23:50,850 - lava_callback - DEBUG - Processing node 69d06816d2be3e1cf2a5b971: baseline-arm-baylibre 2026-04-06 01:23:50,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06816d2be3e1cf2a5b971 2026-04-06 01:23:50,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:50,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06816d2be3e1cf2a5b971 HTTP/1.1" 200 None 2026-04-06 01:23:50,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:50,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:23:50,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:23:50,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06816d2be3e1cf2a5b971 HTTP/1.1" 200 None 2026-04-06 01:23:50,907 - lava_callback - ERROR - Error processing callback for node 69d06816d2be3e1cf2a5b971: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:24:31,016 - lava_callback - INFO - Received callback for node 69d0683ed2be3e1cf2a5b98c INFO: 172.21.0.1:42148 - "POST /node/69d0683ed2be3e1cf2a5b98c HTTP/1.0" 202 Accepted 2026-04-06 01:24:31,022 - lava_callback - INFO - Starting async job submit for node 69d0683ed2be3e1cf2a5b98c 2026-04-06 01:24:31,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:24:31,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0683ed2be3e1cf2a5b98c HTTP/1.1" 200 None 2026-04-06 01:24:31,038 - lava_callback - DEBUG - Processing node 69d0683ed2be3e1cf2a5b98c: baseline-arm64-baylibre 2026-04-06 01:24:31,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0683ed2be3e1cf2a5b98c 2026-04-06 01:24:31,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:24:31,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0683ed2be3e1cf2a5b98c HTTP/1.1" 200 None 2026-04-06 01:24:31,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:24:31,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:24:31,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:24:31,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0683ed2be3e1cf2a5b98c HTTP/1.1" 200 None 2026-04-06 01:24:31,100 - lava_callback - ERROR - Error processing callback for node 69d0683ed2be3e1cf2a5b98c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:25:30,918 - lava_callback - INFO - Received callback for node 69d06885d2be3e1cf2a5b9ab INFO: 172.21.0.1:51368 - "POST /node/69d06885d2be3e1cf2a5b9ab HTTP/1.0" 202 Accepted 2026-04-06 01:25:30,924 - lava_callback - INFO - Starting async job submit for node 69d06885d2be3e1cf2a5b9ab 2026-04-06 01:25:30,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:25:30,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06885d2be3e1cf2a5b9ab HTTP/1.1" 200 None 2026-04-06 01:25:30,943 - lava_callback - DEBUG - Processing node 69d06885d2be3e1cf2a5b9ab: baseline-arm64-baylibre 2026-04-06 01:25:30,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06885d2be3e1cf2a5b9ab 2026-04-06 01:25:30,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:25:30,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06885d2be3e1cf2a5b9ab HTTP/1.1" 200 None 2026-04-06 01:25:30,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:25:30,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:25:30,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:25:30,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06885d2be3e1cf2a5b9ab HTTP/1.1" 200 None 2026-04-06 01:25:31,004 - lava_callback - ERROR - Error processing callback for node 69d06885d2be3e1cf2a5b9ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:26:07,851 - lava_callback - INFO - Received callback for node 69d30b5e13dd9a9509894593 INFO: 172.21.0.1:44292 - "POST /node/69d30b5e13dd9a9509894593 HTTP/1.0" 202 Accepted 2026-04-06 01:26:07,857 - lava_callback - INFO - Starting async job submit for node 69d30b5e13dd9a9509894593 2026-04-06 01:26:07,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:07,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b5e13dd9a9509894593 HTTP/1.1" 200 None 2026-04-06 01:26:07,908 - lava_callback - DEBUG - Processing node 69d30b5e13dd9a9509894593: baseline-arm64 2026-04-06 01:26:08,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:26:08,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:26:08,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30b5e13dd9a9509894593/log.txt.gz 2026-04-06 01:26:08,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:26:08,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:26:08,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30b5e13dd9a9509894593/lava-logs.yaml 2026-04-06 01:26:08,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:26:08,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:26:08,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30b5e13dd9a9509894593/lava_callback.json.gz 2026-04-06 01:26:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:08,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b5e13dd9a9509894593 HTTP/1.1" 200 None 2026-04-06 01:26:08,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:08,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:26:08,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:08,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30b5e13dd9a9509894593 HTTP/1.1" 200 None 2026-04-06 01:26:08,947 - lava_callback - INFO - Completed processing callback for node 69d30b5e13dd9a9509894593 INFO: 172.21.0.1:59184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54096 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:26:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:35,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:26:51,004 - lava_callback - INFO - Received callback for node 69d068ccd2be3e1cf2a5b9cc INFO: 172.21.0.1:54840 - "POST /node/69d068ccd2be3e1cf2a5b9cc HTTP/1.0" 202 Accepted 2026-04-06 01:26:51,010 - lava_callback - INFO - Starting async job submit for node 69d068ccd2be3e1cf2a5b9cc 2026-04-06 01:26:51,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:51,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d068ccd2be3e1cf2a5b9cc HTTP/1.1" 200 None 2026-04-06 01:26:51,045 - lava_callback - DEBUG - Processing node 69d068ccd2be3e1cf2a5b9cc: baseline-arm64-baylibre 2026-04-06 01:26:51,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d068ccd2be3e1cf2a5b9cc 2026-04-06 01:26:51,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:51,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d068ccd2be3e1cf2a5b9cc HTTP/1.1" 200 None 2026-04-06 01:26:51,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:51,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:26:51,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:26:51,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d068ccd2be3e1cf2a5b9cc HTTP/1.1" 200 None 2026-04-06 01:26:51,138 - lava_callback - ERROR - Error processing callback for node 69d068ccd2be3e1cf2a5b9cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:27:51,032 - lava_callback - INFO - Received callback for node 69d06910d2be3e1cf2a5b9f5 INFO: 172.21.0.1:51950 - "POST /node/69d06910d2be3e1cf2a5b9f5 HTTP/1.0" 202 Accepted 2026-04-06 01:27:51,037 - lava_callback - INFO - Starting async job submit for node 69d06910d2be3e1cf2a5b9f5 2026-04-06 01:27:51,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:27:51,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06910d2be3e1cf2a5b9f5 HTTP/1.1" 200 None 2026-04-06 01:27:51,053 - lava_callback - DEBUG - Processing node 69d06910d2be3e1cf2a5b9f5: baseline-arm64-baylibre 2026-04-06 01:27:51,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06910d2be3e1cf2a5b9f5 2026-04-06 01:27:51,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:27:51,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06910d2be3e1cf2a5b9f5 HTTP/1.1" 200 None 2026-04-06 01:27:51,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:27:51,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:27:51,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:27:51,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06910d2be3e1cf2a5b9f5 HTTP/1.1" 200 None 2026-04-06 01:27:51,125 - lava_callback - ERROR - Error processing callback for node 69d06910d2be3e1cf2a5b9f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:29:11,175 - lava_callback - INFO - Received callback for node 69d06953d2be3e1cf2a5ba37 INFO: 172.21.0.1:46344 - "POST /node/69d06953d2be3e1cf2a5ba37 HTTP/1.0" 202 Accepted 2026-04-06 01:29:11,182 - lava_callback - INFO - Starting async job submit for node 69d06953d2be3e1cf2a5ba37 2026-04-06 01:29:11,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:29:11,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06953d2be3e1cf2a5ba37 HTTP/1.1" 200 None 2026-04-06 01:29:11,197 - lava_callback - DEBUG - Processing node 69d06953d2be3e1cf2a5ba37: baseline-arm64-baylibre 2026-04-06 01:29:11,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06953d2be3e1cf2a5ba37 2026-04-06 01:29:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:29:11,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06953d2be3e1cf2a5ba37 HTTP/1.1" 200 None 2026-04-06 01:29:11,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:29:11,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:29:11,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:29:11,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06953d2be3e1cf2a5ba37 HTTP/1.1" 200 None 2026-04-06 01:29:11,249 - lava_callback - ERROR - Error processing callback for node 69d06953d2be3e1cf2a5ba37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:30:11,198 - lava_callback - INFO - Received callback for node 69d0699ad2be3e1cf2a5ba5b INFO: 172.21.0.1:43732 - "POST /node/69d0699ad2be3e1cf2a5ba5b HTTP/1.0" 202 Accepted 2026-04-06 01:30:11,204 - lava_callback - INFO - Starting async job submit for node 69d0699ad2be3e1cf2a5ba5b 2026-04-06 01:30:11,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:30:11,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0699ad2be3e1cf2a5ba5b HTTP/1.1" 200 None 2026-04-06 01:30:11,219 - lava_callback - DEBUG - Processing node 69d0699ad2be3e1cf2a5ba5b: baseline-arm64-baylibre 2026-04-06 01:30:11,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0699ad2be3e1cf2a5ba5b 2026-04-06 01:30:11,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:30:11,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0699ad2be3e1cf2a5ba5b HTTP/1.1" 200 None 2026-04-06 01:30:11,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:30:11,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:30:11,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:30:11,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0699ad2be3e1cf2a5ba5b HTTP/1.1" 200 None 2026-04-06 01:30:11,275 - lava_callback - ERROR - Error processing callback for node 69d0699ad2be3e1cf2a5ba5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:31:22,705 - lava_callback - INFO - Received callback for node 69d069e2d2be3e1cf2a5ba8f INFO: 172.21.0.1:48906 - "POST /node/69d069e2d2be3e1cf2a5ba8f HTTP/1.0" 202 Accepted 2026-04-06 01:31:22,710 - lava_callback - INFO - Starting async job submit for node 69d069e2d2be3e1cf2a5ba8f 2026-04-06 01:31:22,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:31:22,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d069e2d2be3e1cf2a5ba8f HTTP/1.1" 200 None 2026-04-06 01:31:22,726 - lava_callback - DEBUG - Processing node 69d069e2d2be3e1cf2a5ba8f: baseline-arm64-clabbe 2026-04-06 01:31:22,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d069e2d2be3e1cf2a5ba8f 2026-04-06 01:31:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:31:22,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d069e2d2be3e1cf2a5ba8f HTTP/1.1" 200 None 2026-04-06 01:31:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:31:22,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:31:22,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:31:22,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d069e2d2be3e1cf2a5ba8f HTTP/1.1" 200 None 2026-04-06 01:31:22,794 - lava_callback - ERROR - Error processing callback for node 69d069e2d2be3e1cf2a5ba8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:32:42,777 - lava_callback - INFO - Received callback for node 69d06a27d2be3e1cf2a5bac1 INFO: 172.21.0.1:34484 - "POST /node/69d06a27d2be3e1cf2a5bac1 HTTP/1.0" 202 Accepted 2026-04-06 01:32:42,783 - lava_callback - INFO - Starting async job submit for node 69d06a27d2be3e1cf2a5bac1 2026-04-06 01:32:42,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:32:42,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06a27d2be3e1cf2a5bac1 HTTP/1.1" 200 None 2026-04-06 01:32:42,799 - lava_callback - DEBUG - Processing node 69d06a27d2be3e1cf2a5bac1: baseline-arm64-clabbe 2026-04-06 01:32:42,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06a27d2be3e1cf2a5bac1 2026-04-06 01:32:42,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:32:42,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06a27d2be3e1cf2a5bac1 HTTP/1.1" 200 None 2026-04-06 01:32:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:32:42,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:32:42,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:32:42,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06a27d2be3e1cf2a5bac1 HTTP/1.1" 200 None 2026-04-06 01:32:42,852 - lava_callback - ERROR - Error processing callback for node 69d06a27d2be3e1cf2a5bac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:33:42,796 - lava_callback - INFO - Received callback for node 69d06a66d2be3e1cf2a5bb22 INFO: 172.21.0.1:52926 - "POST /node/69d06a66d2be3e1cf2a5bb22 HTTP/1.0" 202 Accepted 2026-04-06 01:33:42,802 - lava_callback - INFO - Starting async job submit for node 69d06a66d2be3e1cf2a5bb22 2026-04-06 01:33:42,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:33:42,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06a66d2be3e1cf2a5bb22 HTTP/1.1" 200 None 2026-04-06 01:33:42,817 - lava_callback - DEBUG - Processing node 69d06a66d2be3e1cf2a5bb22: baseline-arm64-clabbe 2026-04-06 01:33:42,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06a66d2be3e1cf2a5bb22 2026-04-06 01:33:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:33:42,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06a66d2be3e1cf2a5bb22 HTTP/1.1" 200 None 2026-04-06 01:33:42,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:33:42,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:33:42,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:33:42,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06a66d2be3e1cf2a5bb22 HTTP/1.1" 200 None 2026-04-06 01:33:42,893 - lava_callback - ERROR - Error processing callback for node 69d06a66d2be3e1cf2a5bb22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:34:19,621 - lava_callback - INFO - Received callback for node 69d30d4f13dd9a9509894706 INFO: 172.21.0.1:45392 - "POST /node/69d30d4f13dd9a9509894706 HTTP/1.0" 202 Accepted 2026-04-06 01:34:19,628 - lava_callback - INFO - Starting async job submit for node 69d30d4f13dd9a9509894706 2026-04-06 01:34:19,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:19,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d4f13dd9a9509894706 HTTP/1.1" 200 None 2026-04-06 01:34:19,673 - lava_callback - DEBUG - Processing node 69d30d4f13dd9a9509894706: baseline-arm64-foundriesio 2026-04-06 01:34:20,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:34:20,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:34:20,430 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d30d4f13dd9a9509894706/log.txt.gz 2026-04-06 01:34:20,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:34:20,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:34:20,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d30d4f13dd9a9509894706/lava-logs.yaml 2026-04-06 01:34:20,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:34:21,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:34:21,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d30d4f13dd9a9509894706/lava_callback.json.gz 2026-04-06 01:34:21,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:21,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d4f13dd9a9509894706 HTTP/1.1" 200 None 2026-04-06 01:34:21,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:21,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:34:21,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:21,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30d4f13dd9a9509894706 HTTP/1.1" 200 None 2026-04-06 01:34:21,221 - lava_callback - INFO - Completed processing callback for node 69d30d4f13dd9a9509894706 INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:34:35,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:35,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:34:42,882 - lava_callback - INFO - Received callback for node 69d06aacd2be3e1cf2a5bb56 INFO: 172.21.0.1:43984 - "POST /node/69d06aacd2be3e1cf2a5bb56 HTTP/1.0" 202 Accepted 2026-04-06 01:34:42,888 - lava_callback - INFO - Starting async job submit for node 69d06aacd2be3e1cf2a5bb56 2026-04-06 01:34:42,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:42,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06aacd2be3e1cf2a5bb56 HTTP/1.1" 200 None 2026-04-06 01:34:42,903 - lava_callback - DEBUG - Processing node 69d06aacd2be3e1cf2a5bb56: baseline-arm64-clabbe 2026-04-06 01:34:42,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06aacd2be3e1cf2a5bb56 2026-04-06 01:34:42,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:42,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06aacd2be3e1cf2a5bb56 HTTP/1.1" 200 None 2026-04-06 01:34:42,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:42,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:34:42,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:34:42,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06aacd2be3e1cf2a5bb56 HTTP/1.1" 200 None 2026-04-06 01:34:42,976 - lava_callback - ERROR - Error processing callback for node 69d06aacd2be3e1cf2a5bb56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:36:02,959 - lava_callback - INFO - Received callback for node 69d06af4d2be3e1cf2a5bb79 INFO: 172.21.0.1:56258 - "POST /node/69d06af4d2be3e1cf2a5bb79 HTTP/1.0" 202 Accepted 2026-04-06 01:36:02,965 - lava_callback - INFO - Starting async job submit for node 69d06af4d2be3e1cf2a5bb79 2026-04-06 01:36:02,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:02,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06af4d2be3e1cf2a5bb79 HTTP/1.1" 200 None 2026-04-06 01:36:02,981 - lava_callback - DEBUG - Processing node 69d06af4d2be3e1cf2a5bb79: baseline-arm64-clabbe 2026-04-06 01:36:02,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06af4d2be3e1cf2a5bb79 2026-04-06 01:36:02,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:02,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06af4d2be3e1cf2a5bb79 HTTP/1.1" 200 None 2026-04-06 01:36:02,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:03,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:36:03,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:03,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06af4d2be3e1cf2a5bb79 HTTP/1.1" 200 None 2026-04-06 01:36:03,037 - lava_callback - ERROR - Error processing callback for node 69d06af4d2be3e1cf2a5bb79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:36:25,121 - lava_callback - INFO - Received callback for node 69d30d3113dd9a95098946f5 INFO: 172.21.0.1:42372 - "POST /node/69d30d3113dd9a95098946f5 HTTP/1.0" 202 Accepted 2026-04-06 01:36:25,127 - lava_callback - INFO - Starting async job submit for node 69d30d3113dd9a95098946f5 2026-04-06 01:36:25,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:25,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d3113dd9a95098946f5 HTTP/1.1" 200 None 2026-04-06 01:36:25,171 - lava_callback - DEBUG - Processing node 69d30d3113dd9a95098946f5: ltp-cve 2026-04-06 01:36:25,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:36:25,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:36:25,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d30d3113dd9a95098946f5/log.txt.gz 2026-04-06 01:36:26,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:36:26,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:36:26,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d30d3113dd9a95098946f5/lava-logs.yaml 2026-04-06 01:36:26,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:36:26,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:36:26,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d30d3113dd9a95098946f5/lava_callback.json.gz 2026-04-06 01:36:26,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42382 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:36:26,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d3113dd9a95098946f5 HTTP/1.1" 200 None 2026-04-06 01:36:26,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:26,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:36:26,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:26,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30d3113dd9a95098946f5 HTTP/1.1" 200 None 2026-04-06 01:36:26,607 - lava_callback - INFO - Completed processing callback for node 69d30d3113dd9a95098946f5 2026-04-06 01:36:35,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:36:35,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:37:03,009 - lava_callback - INFO - Received callback for node 69d06b38d2be3e1cf2a5bbb0 INFO: 172.21.0.1:46578 - "POST /node/69d06b38d2be3e1cf2a5bbb0 HTTP/1.0" 202 Accepted 2026-04-06 01:37:03,014 - lava_callback - INFO - Starting async job submit for node 69d06b38d2be3e1cf2a5bbb0 2026-04-06 01:37:03,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:37:03,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b38d2be3e1cf2a5bbb0 HTTP/1.1" 200 None 2026-04-06 01:37:03,030 - lava_callback - DEBUG - Processing node 69d06b38d2be3e1cf2a5bbb0: baseline-arm64-clabbe 2026-04-06 01:37:03,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06b38d2be3e1cf2a5bbb0 2026-04-06 01:37:03,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:37:03,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b38d2be3e1cf2a5bbb0 HTTP/1.1" 200 None 2026-04-06 01:37:03,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:37:03,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 01:37:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:37:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06b38d2be3e1cf2a5bbb0 HTTP/1.1" 200 None 2026-04-06 01:37:03,090 - lava_callback - ERROR - Error processing callback for node 69d06b38d2be3e1cf2a5bbb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:38:03,061 - lava_callback - INFO - Received callback for node 69d06b6fd2be3e1cf2a5bbdc INFO: 172.21.0.1:51994 - "POST /node/69d06b6fd2be3e1cf2a5bbdc HTTP/1.0" 202 Accepted 2026-04-06 01:38:03,066 - lava_callback - INFO - Starting async job submit for node 69d06b6fd2be3e1cf2a5bbdc 2026-04-06 01:38:03,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:03,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b6fd2be3e1cf2a5bbdc HTTP/1.1" 200 None 2026-04-06 01:38:03,083 - lava_callback - DEBUG - Processing node 69d06b6fd2be3e1cf2a5bbdc: baseline-arm-clabbe 2026-04-06 01:38:03,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06b6fd2be3e1cf2a5bbdc 2026-04-06 01:38:03,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:03,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b6fd2be3e1cf2a5bbdc HTTP/1.1" 200 None 2026-04-06 01:38:03,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:03,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:38:03,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:03,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06b6fd2be3e1cf2a5bbdc HTTP/1.1" 200 None 2026-04-06 01:38:03,135 - lava_callback - ERROR - Error processing callback for node 69d06b6fd2be3e1cf2a5bbdc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:38:43,052 - lava_callback - INFO - Received callback for node 69d06b8dd2be3e1cf2a5bc05 INFO: 172.21.0.1:38104 - "POST /node/69d06b8dd2be3e1cf2a5bc05 HTTP/1.0" 202 Accepted 2026-04-06 01:38:43,057 - lava_callback - INFO - Starting async job submit for node 69d06b8dd2be3e1cf2a5bc05 2026-04-06 01:38:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:43,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b8dd2be3e1cf2a5bc05 HTTP/1.1" 200 None 2026-04-06 01:38:43,073 - lava_callback - DEBUG - Processing node 69d06b8dd2be3e1cf2a5bc05: baseline-arm-clabbe 2026-04-06 01:38:43,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06b8dd2be3e1cf2a5bc05 2026-04-06 01:38:43,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:43,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06b8dd2be3e1cf2a5bc05 HTTP/1.1" 200 None 2026-04-06 01:38:43,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:43,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:38:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:38:43,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06b8dd2be3e1cf2a5bc05 HTTP/1.1" 200 None 2026-04-06 01:38:43,130 - lava_callback - ERROR - Error processing callback for node 69d06b8dd2be3e1cf2a5bc05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:39:03,108 - lava_callback - INFO - Received callback for node 69d06bb1d2be3e1cf2a5bc32 INFO: 172.21.0.1:41758 - "POST /node/69d06bb1d2be3e1cf2a5bc32 HTTP/1.0" 202 Accepted 2026-04-06 01:39:03,113 - lava_callback - INFO - Starting async job submit for node 69d06bb1d2be3e1cf2a5bc32 2026-04-06 01:39:03,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:03,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06bb1d2be3e1cf2a5bc32 HTTP/1.1" 200 None 2026-04-06 01:39:03,130 - lava_callback - DEBUG - Processing node 69d06bb1d2be3e1cf2a5bc32: baseline-arm-clabbe 2026-04-06 01:39:03,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06bb1d2be3e1cf2a5bc32 2026-04-06 01:39:03,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:03,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06bb1d2be3e1cf2a5bc32 HTTP/1.1" 200 None 2026-04-06 01:39:03,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:03,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:39:03,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:03,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06bb1d2be3e1cf2a5bc32 HTTP/1.1" 200 None 2026-04-06 01:39:03,182 - lava_callback - ERROR - Error processing callback for node 69d06bb1d2be3e1cf2a5bc32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:39:23,589 - lava_callback - INFO - Received callback for node 69d30e8313dd9a95098947c8 INFO: 172.21.0.1:53794 - "POST /node/69d30e8313dd9a95098947c8 HTTP/1.0" 202 Accepted 2026-04-06 01:39:23,595 - lava_callback - INFO - Starting async job submit for node 69d30e8313dd9a95098947c8 2026-04-06 01:39:23,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:23,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30e8313dd9a95098947c8 HTTP/1.1" 200 None 2026-04-06 01:39:23,639 - lava_callback - DEBUG - Processing node 69d30e8313dd9a95098947c8: baseline-arm64 2026-04-06 01:39:23,769 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:39:23,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:39:24,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:39:24,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30e8313dd9a95098947c8/lava-logs.yaml 2026-04-06 01:39:24,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:39:24,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:39:24,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30e8313dd9a95098947c8/lava_callback.json.gz 2026-04-06 01:39:24,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:24,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30e8313dd9a95098947c8 HTTP/1.1" 200 None 2026-04-06 01:39:24,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:24,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:39:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:24,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30e8313dd9a95098947c8 HTTP/1.1" 200 None 2026-04-06 01:39:24,355 - lava_callback - INFO - Completed processing callback for node 69d30e8313dd9a95098947c8 INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:39:35,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:35,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:39:43,117 - lava_callback - INFO - Received callback for node 69d06bcdd2be3e1cf2a5bc75 INFO: 172.21.0.1:55062 - "POST /node/69d06bcdd2be3e1cf2a5bc75 HTTP/1.0" 202 Accepted 2026-04-06 01:39:43,125 - lava_callback - INFO - Starting async job submit for node 69d06bcdd2be3e1cf2a5bc75 2026-04-06 01:39:43,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:43,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06bcdd2be3e1cf2a5bc75 HTTP/1.1" 200 None 2026-04-06 01:39:43,142 - lava_callback - DEBUG - Processing node 69d06bcdd2be3e1cf2a5bc75: baseline-arm-clabbe 2026-04-06 01:39:43,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06bcdd2be3e1cf2a5bc75 2026-04-06 01:39:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:43,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06bcdd2be3e1cf2a5bc75 HTTP/1.1" 200 None 2026-04-06 01:39:43,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:43,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 01:39:43,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:39:43,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06bcdd2be3e1cf2a5bc75 HTTP/1.1" 200 None 2026-04-06 01:39:43,198 - lava_callback - ERROR - Error processing callback for node 69d06bcdd2be3e1cf2a5bc75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:42:13,108 - lava_callback - INFO - Received callback for node 69d30f3713dd9a9509894811 INFO: 172.21.0.1:54582 - "POST /node/69d30f3713dd9a9509894811 HTTP/1.0" 202 Accepted 2026-04-06 01:42:13,117 - lava_callback - INFO - Starting async job submit for node 69d30f3713dd9a9509894811 2026-04-06 01:42:13,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:42:13,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30f3713dd9a9509894811 HTTP/1.1" 200 None 2026-04-06 01:42:13,193 - lava_callback - DEBUG - Processing node 69d30f3713dd9a9509894811: baseline-arm64 2026-04-06 01:42:13,386 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:42:13,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:42:13,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:42:13,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30f3713dd9a9509894811/lava-logs.yaml 2026-04-06 01:42:13,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:42:13,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:42:13,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30f3713dd9a9509894811/lava_callback.json.gz 2026-04-06 01:42:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:42:13,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30f3713dd9a9509894811 HTTP/1.1" 200 None 2026-04-06 01:42:13,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:42:13,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:42:13,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:42:13,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30f3713dd9a9509894811 HTTP/1.1" 200 None 2026-04-06 01:42:14,040 - lava_callback - INFO - Completed processing callback for node 69d30f3713dd9a9509894811 INFO: 172.21.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:42:35,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:42:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:43:18,471 - lava_callback - INFO - Received callback for node 69d30fa413dd9a9509894841 INFO: 172.21.0.1:58876 - "POST /node/69d30fa413dd9a9509894841 HTTP/1.0" 202 Accepted 2026-04-06 01:43:18,481 - lava_callback - INFO - Starting async job submit for node 69d30fa413dd9a9509894841 2026-04-06 01:43:18,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:43:18,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30fa413dd9a9509894841 HTTP/1.1" 200 None 2026-04-06 01:43:18,514 - lava_callback - DEBUG - Processing node 69d30fa413dd9a9509894841: baseline-nfs-arm64 2026-04-06 01:43:18,516 - lava_callback - WARNING - Failed to upload log 2026-04-06 01:43:18,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:43:18,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:43:18,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d30fa413dd9a9509894841/lava-logs.yaml 2026-04-06 01:43:18,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:43:18,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:43:18,904 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d30fa413dd9a9509894841/lava_callback.json.gz 2026-04-06 01:43:18,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:43:18,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30fa413dd9a9509894841 HTTP/1.1" 200 None 2026-04-06 01:43:18,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:43:18,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:43:18,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:43:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30fa413dd9a9509894841 HTTP/1.1" 200 None 2026-04-06 01:43:18,982 - lava_callback - INFO - Completed processing callback for node 69d30fa413dd9a9509894841 INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:43:35,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:43:35,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:44:15,076 - lava_callback - INFO - Received callback for node 69d30e2313dd9a950989478f INFO: 172.21.0.1:46644 - "POST /node/69d30e2313dd9a950989478f HTTP/1.0" 202 Accepted 2026-04-06 01:44:15,092 - lava_callback - INFO - Starting async job submit for node 69d30e2313dd9a950989478f INFO: 172.21.0.1:46656 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 01:44:15,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:44:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30e2313dd9a950989478f HTTP/1.1" 200 None 2026-04-06 01:44:15,209 - lava_callback - DEBUG - Processing node 69d30e2313dd9a950989478f: baseline-arm64 2026-04-06 01:44:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:44:15,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:44:15,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30e2313dd9a950989478f/log.txt.gz 2026-04-06 01:44:16,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:44:16,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:44:16,508 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30e2313dd9a950989478f/lava-logs.yaml 2026-04-06 01:44:16,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:44:16,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:44:16,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d30e2313dd9a950989478f/lava_callback.json.gz DEBUG: Setup failed for 69d30e2313dd9a950989478f. Transitting job node result: incomplete -> fail 2026-04-06 01:44:16,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:44:16,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30e2313dd9a950989478f HTTP/1.1" 200 None 2026-04-06 01:44:16,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:44:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:44:16,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:44:16,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30e2313dd9a950989478f HTTP/1.1" 200 None 2026-04-06 01:44:16,944 - lava_callback - INFO - Completed processing callback for node 69d30e2313dd9a950989478f INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:44:35,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:44:35,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:46:17,120 - lava_callback - INFO - Received callback for node 69d30ff913dd9a9509894895 INFO: 172.21.0.1:40030 - "POST /node/69d30ff913dd9a9509894895 HTTP/1.0" 202 Accepted 2026-04-06 01:46:17,129 - lava_callback - INFO - Starting async job submit for node 69d30ff913dd9a9509894895 2026-04-06 01:46:17,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:46:17,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30ff913dd9a9509894895 HTTP/1.1" 200 None 2026-04-06 01:46:17,169 - lava_callback - DEBUG - Processing node 69d30ff913dd9a9509894895: baseline-arm64-broonie 2026-04-06 01:46:17,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:46:17,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:46:17,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d30ff913dd9a9509894895/log.txt.gz 2026-04-06 01:46:17,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:46:18,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:46:18,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d30ff913dd9a9509894895/lava-logs.yaml 2026-04-06 01:46:18,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:46:18,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:46:18,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d30ff913dd9a9509894895/lava_callback.json.gz 2026-04-06 01:46:18,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:46:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30ff913dd9a9509894895 HTTP/1.1" 200 None 2026-04-06 01:46:18,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:46:18,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:46:18,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:46:18,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30ff913dd9a9509894895 HTTP/1.1" 200 None 2026-04-06 01:46:18,357 - lava_callback - INFO - Completed processing callback for node 69d30ff913dd9a9509894895 INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:46:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:46:35,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:49:32,331 - lava_callback - INFO - Received callback for node 69d06e22d2be3e1cf2a5bec0 INFO: 172.21.0.1:57542 - "POST /node/69d06e22d2be3e1cf2a5bec0 HTTP/1.0" 202 Accepted 2026-04-06 01:49:32,337 - lava_callback - INFO - Starting async job submit for node 69d06e22d2be3e1cf2a5bec0 2026-04-06 01:49:32,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:49:32,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06e22d2be3e1cf2a5bec0 HTTP/1.1" 200 None 2026-04-06 01:49:32,358 - lava_callback - DEBUG - Processing node 69d06e22d2be3e1cf2a5bec0: baseline-arm64-baylibre 2026-04-06 01:49:32,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06e22d2be3e1cf2a5bec0 2026-04-06 01:49:32,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:49:32,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06e22d2be3e1cf2a5bec0 HTTP/1.1" 200 None 2026-04-06 01:49:32,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:49:32,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:49:32,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:49:32,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06e22d2be3e1cf2a5bec0 HTTP/1.1" 200 None 2026-04-06 01:49:32,424 - lava_callback - ERROR - Error processing callback for node 69d06e22d2be3e1cf2a5bec0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:50:36,423 - lava_callback - INFO - Received callback for node 69d3111b13dd9a9509894962 INFO: 172.21.0.1:36354 - "POST /node/69d3111b13dd9a9509894962 HTTP/1.0" 202 Accepted 2026-04-06 01:50:36,429 - lava_callback - INFO - Starting async job submit for node 69d3111b13dd9a9509894962 2026-04-06 01:50:36,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:36,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3111b13dd9a9509894962 HTTP/1.1" 200 None 2026-04-06 01:50:36,484 - lava_callback - DEBUG - Processing node 69d3111b13dd9a9509894962: baseline-arm64 INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:50:37,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:37,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:37,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3111b13dd9a9509894962/log.txt.gz 2026-04-06 01:50:37,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:37,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:37,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3111b13dd9a9509894962/lava-logs.yaml 2026-04-06 01:50:37,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:37,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:37,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3111b13dd9a9509894962/lava_callback.json.gz 2026-04-06 01:50:38,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:38,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3111b13dd9a9509894962 HTTP/1.1" 200 None 2026-04-06 01:50:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:38,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:50:38,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:38,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3111b13dd9a9509894962 HTTP/1.1" 200 None 2026-04-06 01:50:38,167 - lava_callback - INFO - Completed processing callback for node 69d3111b13dd9a9509894962 INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:50:49,352 - lava_callback - INFO - Received callback for node 69d30d9613dd9a950989475b INFO: 172.21.0.1:36300 - "POST /node/69d30d9613dd9a950989475b HTTP/1.0" 202 Accepted 2026-04-06 01:50:49,359 - lava_callback - INFO - Starting async job submit for node 69d30d9613dd9a950989475b 2026-04-06 01:50:49,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:49,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d9613dd9a950989475b HTTP/1.1" 200 None 2026-04-06 01:50:49,453 - lava_callback - DEBUG - Processing node 69d30d9613dd9a950989475b: baseline-arm INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:50:50,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:50,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:50,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d30d9613dd9a950989475b/log.txt.gz 2026-04-06 01:50:50,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:50,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:50,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d30d9613dd9a950989475b/lava-logs.yaml 2026-04-06 01:50:50,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:50:51,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:50:51,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d30d9613dd9a950989475b/lava_callback.json.gz DEBUG: Setup failed for 69d30d9613dd9a950989475b. Transitting job node result: incomplete -> fail 2026-04-06 01:50:51,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:51,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30d9613dd9a950989475b HTTP/1.1" 200 None 2026-04-06 01:50:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:51,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 01:50:51,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:50:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30d9613dd9a950989475b HTTP/1.1" 200 None 2026-04-06 01:50:51,405 - lava_callback - INFO - Completed processing callback for node 69d30d9613dd9a950989475b INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:51:05,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:51:05,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:51:52,277 - lava_callback - INFO - Received callback for node 69d06ea9d2be3e1cf2a5bf43 INFO: 172.21.0.1:55846 - "POST /node/69d06ea9d2be3e1cf2a5bf43 HTTP/1.0" 202 Accepted 2026-04-06 01:51:52,286 - lava_callback - INFO - Starting async job submit for node 69d06ea9d2be3e1cf2a5bf43 2026-04-06 01:51:52,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:51:52,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06ea9d2be3e1cf2a5bf43 HTTP/1.1" 200 None 2026-04-06 01:51:52,306 - lava_callback - DEBUG - Processing node 69d06ea9d2be3e1cf2a5bf43: baseline-arm64-baylibre 2026-04-06 01:51:52,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06ea9d2be3e1cf2a5bf43 2026-04-06 01:51:52,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:51:52,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06ea9d2be3e1cf2a5bf43 HTTP/1.1" 200 None 2026-04-06 01:51:52,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:51:52,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:51:52,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:51:52,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06ea9d2be3e1cf2a5bf43 HTTP/1.1" 200 None 2026-04-06 01:51:52,383 - lava_callback - ERROR - Error processing callback for node 69d06ea9d2be3e1cf2a5bf43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:53:32,334 - lava_callback - INFO - Received callback for node 69d06f0ed2be3e1cf2a5bfad INFO: 172.21.0.1:56330 - "POST /node/69d06f0ed2be3e1cf2a5bfad HTTP/1.0" 202 Accepted 2026-04-06 01:53:32,343 - lava_callback - INFO - Starting async job submit for node 69d06f0ed2be3e1cf2a5bfad 2026-04-06 01:53:32,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:53:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06f0ed2be3e1cf2a5bfad HTTP/1.1" 200 None 2026-04-06 01:53:32,366 - lava_callback - DEBUG - Processing node 69d06f0ed2be3e1cf2a5bfad: baseline-arm64-baylibre 2026-04-06 01:53:32,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06f0ed2be3e1cf2a5bfad 2026-04-06 01:53:32,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:53:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06f0ed2be3e1cf2a5bfad HTTP/1.1" 200 None 2026-04-06 01:53:32,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:53:32,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:53:32,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:53:32,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06f0ed2be3e1cf2a5bfad HTTP/1.1" 200 None 2026-04-06 01:53:32,442 - lava_callback - ERROR - Error processing callback for node 69d06f0ed2be3e1cf2a5bfad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:54:32,414 - lava_callback - INFO - Received callback for node 69d06f55d2be3e1cf2a5bfd4 INFO: 172.21.0.1:44044 - "POST /node/69d06f55d2be3e1cf2a5bfd4 HTTP/1.0" 202 Accepted 2026-04-06 01:54:32,420 - lava_callback - INFO - Starting async job submit for node 69d06f55d2be3e1cf2a5bfd4 2026-04-06 01:54:32,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:54:32,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06f55d2be3e1cf2a5bfd4 HTTP/1.1" 200 None 2026-04-06 01:54:32,435 - lava_callback - DEBUG - Processing node 69d06f55d2be3e1cf2a5bfd4: baseline-arm64-baylibre 2026-04-06 01:54:32,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06f55d2be3e1cf2a5bfd4 2026-04-06 01:54:32,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:54:32,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06f55d2be3e1cf2a5bfd4 HTTP/1.1" 200 None 2026-04-06 01:54:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:54:32,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:54:32,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:54:32,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06f55d2be3e1cf2a5bfd4 HTTP/1.1" 200 None 2026-04-06 01:54:32,492 - lava_callback - ERROR - Error processing callback for node 69d06f55d2be3e1cf2a5bfd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40164 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:56:03,967 - lava_callback - INFO - Received callback for node 69d06fa6d2be3e1cf2a5c010 INFO: 172.21.0.1:46498 - "POST /node/69d06fa6d2be3e1cf2a5c010 HTTP/1.0" 202 Accepted 2026-04-06 01:56:03,973 - lava_callback - INFO - Starting async job submit for node 69d06fa6d2be3e1cf2a5c010 2026-04-06 01:56:03,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06fa6d2be3e1cf2a5c010 HTTP/1.1" 200 None 2026-04-06 01:56:03,998 - lava_callback - DEBUG - Processing node 69d06fa6d2be3e1cf2a5c010: baseline-arm64-clabbe 2026-04-06 01:56:03,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06fa6d2be3e1cf2a5c010 2026-04-06 01:56:04,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:04,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06fa6d2be3e1cf2a5c010 HTTP/1.1" 200 None 2026-04-06 01:56:04,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:04,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:56:04,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:04,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06fa6d2be3e1cf2a5c010 HTTP/1.1" 200 None 2026-04-06 01:56:04,072 - lava_callback - ERROR - Error processing callback for node 69d06fa6d2be3e1cf2a5c010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:56:23,814 - lava_callback - INFO - Received callback for node 69d3103613dd9a95098948a4 INFO: 172.21.0.1:44870 - "POST /node/69d3103613dd9a95098948a4 HTTP/1.0" 202 Accepted 2026-04-06 01:56:23,821 - lava_callback - INFO - Starting async job submit for node 69d3103613dd9a95098948a4 2026-04-06 01:56:23,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:23,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3103613dd9a95098948a4 HTTP/1.1" 200 None 2026-04-06 01:56:23,875 - lava_callback - DEBUG - Processing node 69d3103613dd9a95098948a4: baseline-nfs-arm64 2026-04-06 01:56:24,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:56:24,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:56:24,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3103613dd9a95098948a4/log.txt.gz 2026-04-06 01:56:24,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:56:25,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:56:25,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3103613dd9a95098948a4/lava-logs.yaml 2026-04-06 01:56:25,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:56:25,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:56:25,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3103613dd9a95098948a4/lava_callback.json.gz 2026-04-06 01:56:25,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:25,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3103613dd9a95098948a4 HTTP/1.1" 200 None 2026-04-06 01:56:25,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:25,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:56:25,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:25,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3103613dd9a95098948a4 HTTP/1.1" 200 None 2026-04-06 01:56:25,415 - lava_callback - INFO - Completed processing callback for node 69d3103613dd9a95098948a4 INFO: 172.21.0.1:44878 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:56:35,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:56:35,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:57:03,212 - lava_callback - INFO - Received callback for node 69d3106e13dd9a95098948e2 INFO: 172.21.0.1:41322 - "POST /node/69d3106e13dd9a95098948e2 HTTP/1.0" 202 Accepted 2026-04-06 01:57:03,219 - lava_callback - INFO - Starting async job submit for node 69d3106e13dd9a95098948e2 2026-04-06 01:57:03,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:03,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3106e13dd9a95098948e2 HTTP/1.1" 200 None 2026-04-06 01:57:03,263 - lava_callback - DEBUG - Processing node 69d3106e13dd9a95098948e2: baseline-arm64 2026-04-06 01:57:03,911 - lava_callback - INFO - Received callback for node 69d06febd2be3e1cf2a5c02e INFO: 172.21.0.1:41330 - "POST /node/69d06febd2be3e1cf2a5c02e HTTP/1.0" 202 Accepted 2026-04-06 01:57:03,917 - lava_callback - INFO - Starting async job submit for node 69d06febd2be3e1cf2a5c02e 2026-04-06 01:57:03,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:03,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:57:03,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06febd2be3e1cf2a5c02e HTTP/1.1" 200 None 2026-04-06 01:57:03,947 - lava_callback - DEBUG - Processing node 69d06febd2be3e1cf2a5c02e: baseline-arm64-clabbe 2026-04-06 01:57:03,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d06febd2be3e1cf2a5c02e 2026-04-06 01:57:03,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:03,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d06febd2be3e1cf2a5c02e HTTP/1.1" 200 None 2026-04-06 01:57:03,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:03,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:57:03,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:04,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d06febd2be3e1cf2a5c02e HTTP/1.1" 200 None 2026-04-06 01:57:04,033 - lava_callback - ERROR - Error processing callback for node 69d06febd2be3e1cf2a5c02e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 01:57:04,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:57:04,173 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3106e13dd9a95098948e2/log.txt.gz 2026-04-06 01:57:04,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:57:04,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:57:04,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3106e13dd9a95098948e2/lava-logs.yaml 2026-04-06 01:57:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 01:57:04,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 01:57:04,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3106e13dd9a95098948e2/lava_callback.json.gz 2026-04-06 01:57:04,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:04,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3106e13dd9a95098948e2 HTTP/1.1" 200 None 2026-04-06 01:57:04,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:04,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 01:57:04,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:04,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3106e13dd9a95098948e2 HTTP/1.1" 200 None 2026-04-06 01:57:04,977 - lava_callback - INFO - Completed processing callback for node 69d3106e13dd9a95098948e2 2026-04-06 01:57:05,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:57:05,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:58:23,976 - lava_callback - INFO - Received callback for node 69d0702bd2be3e1cf2a5c08f INFO: 172.21.0.1:59016 - "POST /node/69d0702bd2be3e1cf2a5c08f HTTP/1.0" 202 Accepted 2026-04-06 01:58:23,982 - lava_callback - INFO - Starting async job submit for node 69d0702bd2be3e1cf2a5c08f 2026-04-06 01:58:23,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:58:23,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0702bd2be3e1cf2a5c08f HTTP/1.1" 200 None 2026-04-06 01:58:23,999 - lava_callback - DEBUG - Processing node 69d0702bd2be3e1cf2a5c08f: baseline-arm64-clabbe 2026-04-06 01:58:24,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0702bd2be3e1cf2a5c08f 2026-04-06 01:58:24,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:58:24,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0702bd2be3e1cf2a5c08f HTTP/1.1" 200 None 2026-04-06 01:58:24,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:58:24,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:58:24,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:58:24,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0702bd2be3e1cf2a5c08f HTTP/1.1" 200 None 2026-04-06 01:58:24,053 - lava_callback - ERROR - Error processing callback for node 69d0702bd2be3e1cf2a5c08f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK 2026-04-06 01:59:24,013 - lava_callback - INFO - Received callback for node 69d07075d2be3e1cf2a5c099 INFO: 172.21.0.1:51478 - "POST /node/69d07075d2be3e1cf2a5c099 HTTP/1.0" 202 Accepted 2026-04-06 01:59:24,019 - lava_callback - INFO - Starting async job submit for node 69d07075d2be3e1cf2a5c099 2026-04-06 01:59:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:59:24,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07075d2be3e1cf2a5c099 HTTP/1.1" 200 None 2026-04-06 01:59:24,041 - lava_callback - DEBUG - Processing node 69d07075d2be3e1cf2a5c099: baseline-arm64-clabbe 2026-04-06 01:59:24,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07075d2be3e1cf2a5c099 2026-04-06 01:59:24,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:59:24,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07075d2be3e1cf2a5c099 HTTP/1.1" 200 None 2026-04-06 01:59:24,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:59:24,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 01:59:24,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 01:59:24,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07075d2be3e1cf2a5c099 HTTP/1.1" 200 None 2026-04-06 01:59:24,111 - lava_callback - ERROR - Error processing callback for node 69d07075d2be3e1cf2a5c099: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:00:24,116 - lava_callback - INFO - Received callback for node 69d070b5d2be3e1cf2a5c0e9 INFO: 172.21.0.1:43908 - "POST /node/69d070b5d2be3e1cf2a5c0e9 HTTP/1.0" 202 Accepted 2026-04-06 02:00:24,121 - lava_callback - INFO - Starting async job submit for node 69d070b5d2be3e1cf2a5c0e9 2026-04-06 02:00:24,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:00:24,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d070b5d2be3e1cf2a5c0e9 HTTP/1.1" 200 None 2026-04-06 02:00:24,142 - lava_callback - DEBUG - Processing node 69d070b5d2be3e1cf2a5c0e9: baseline-arm64-clabbe 2026-04-06 02:00:24,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d070b5d2be3e1cf2a5c0e9 2026-04-06 02:00:24,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:00:24,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d070b5d2be3e1cf2a5c0e9 HTTP/1.1" 200 None 2026-04-06 02:00:24,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:00:24,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 02:00:24,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:00:24,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d070b5d2be3e1cf2a5c0e9 HTTP/1.1" 200 None 2026-04-06 02:00:24,197 - lava_callback - ERROR - Error processing callback for node 69d070b5d2be3e1cf2a5c0e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:02:04,099 - lava_callback - INFO - Received callback for node 69d07118d2be3e1cf2a5c139 INFO: 172.21.0.1:49024 - "POST /node/69d07118d2be3e1cf2a5c139 HTTP/1.0" 202 Accepted 2026-04-06 02:02:04,106 - lava_callback - INFO - Starting async job submit for node 69d07118d2be3e1cf2a5c139 2026-04-06 02:02:04,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:02:04,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07118d2be3e1cf2a5c139 HTTP/1.1" 200 None 2026-04-06 02:02:04,123 - lava_callback - DEBUG - Processing node 69d07118d2be3e1cf2a5c139: baseline-arm64-clabbe 2026-04-06 02:02:04,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07118d2be3e1cf2a5c139 2026-04-06 02:02:04,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:02:04,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07118d2be3e1cf2a5c139 HTTP/1.1" 200 None 2026-04-06 02:02:04,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:02:04,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 02:02:04,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:02:04,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07118d2be3e1cf2a5c139 HTTP/1.1" 200 None 2026-04-06 02:02:04,178 - lava_callback - ERROR - Error processing callback for node 69d07118d2be3e1cf2a5c139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET /node/6910c02c699dbc4cda8e132c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET /node/6955671afbdac0e1a7b16f6c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:07:59,126 - lava_callback - INFO - Received callback for node 69d310d913dd9a9509894943 INFO: 172.21.0.1:34968 - "POST /node/69d310d913dd9a9509894943 HTTP/1.0" 202 Accepted 2026-04-06 02:07:59,134 - lava_callback - INFO - Starting async job submit for node 69d310d913dd9a9509894943 2026-04-06 02:07:59,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:07:59,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d310d913dd9a9509894943 HTTP/1.1" 200 None 2026-04-06 02:07:59,196 - lava_callback - DEBUG - Processing node 69d310d913dd9a9509894943: baseline-nfs-arm64 2026-04-06 02:08:00,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:08:00,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:08:00,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d310d913dd9a9509894943/log.txt.gz 2026-04-06 02:08:01,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:08:01,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:08:01,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d310d913dd9a9509894943/lava-logs.yaml 2026-04-06 02:08:01,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:08:01,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:08:01,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d310d913dd9a9509894943/lava_callback.json.gz DEBUG: Setup failed for 69d310d913dd9a9509894943. Transitting job node result: incomplete -> fail 2026-04-06 02:08:01,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:08:02,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d310d913dd9a9509894943 HTTP/1.1" 200 None 2026-04-06 02:08:02,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:08:02,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:08:02,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:08:02,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d310d913dd9a9509894943 HTTP/1.1" 200 None 2026-04-06 02:08:02,138 - lava_callback - INFO - Completed processing callback for node 69d310d913dd9a9509894943 2026-04-06 02:08:05,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:08:05,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:10:48,105 - lava_callback - INFO - Received callback for node 69d315f913dd9a9509894d4e INFO: 172.21.0.1:39130 - "POST /node/69d315f913dd9a9509894d4e HTTP/1.0" 202 Accepted 2026-04-06 02:10:48,112 - lava_callback - INFO - Starting async job submit for node 69d315f913dd9a9509894d4e 2026-04-06 02:10:48,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:10:48,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315f913dd9a9509894d4e HTTP/1.1" 200 None 2026-04-06 02:10:48,161 - lava_callback - DEBUG - Processing node 69d315f913dd9a9509894d4e: baseline-arm64 2026-04-06 02:10:48,292 - lava_callback - WARNING - Failed to upload log 2026-04-06 02:10:48,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:10:48,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:10:48,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d315f913dd9a9509894d4e/lava-logs.yaml 2026-04-06 02:10:48,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:10:48,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:10:48,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d315f913dd9a9509894d4e/lava_callback.json.gz 2026-04-06 02:10:48,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:10:48,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315f913dd9a9509894d4e HTTP/1.1" 200 None 2026-04-06 02:10:48,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:10:48,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:10:48,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:10:48,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d315f913dd9a9509894d4e HTTP/1.1" 200 None 2026-04-06 02:10:48,836 - lava_callback - INFO - Completed processing callback for node 69d315f913dd9a9509894d4e INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:11:05,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:11:05,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:11:13,252 - lava_callback - INFO - Received callback for node 69d0733ed2be3e1cf2a5c2c8 INFO: 172.21.0.1:60894 - "POST /node/69d0733ed2be3e1cf2a5c2c8 HTTP/1.0" 202 Accepted 2026-04-06 02:11:13,261 - lava_callback - INFO - Starting async job submit for node 69d0733ed2be3e1cf2a5c2c8 2026-04-06 02:11:13,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:11:13,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0733ed2be3e1cf2a5c2c8 HTTP/1.1" 200 None 2026-04-06 02:11:13,283 - lava_callback - DEBUG - Processing node 69d0733ed2be3e1cf2a5c2c8: baseline-arm64-baylibre 2026-04-06 02:11:13,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0733ed2be3e1cf2a5c2c8 2026-04-06 02:11:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:11:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0733ed2be3e1cf2a5c2c8 HTTP/1.1" 200 None 2026-04-06 02:11:13,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:11:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:11:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:11:13,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0733ed2be3e1cf2a5c2c8 HTTP/1.1" 200 None 2026-04-06 02:11:13,349 - lava_callback - ERROR - Error processing callback for node 69d0733ed2be3e1cf2a5c2c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:13:04,691 - lava_callback - INFO - Received callback for node 69d073aad2be3e1cf2a5c31b INFO: 172.21.0.1:46936 - "POST /node/69d073aad2be3e1cf2a5c31b HTTP/1.0" 202 Accepted 2026-04-06 02:13:04,699 - lava_callback - INFO - Starting async job submit for node 69d073aad2be3e1cf2a5c31b 2026-04-06 02:13:04,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:13:04,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d073aad2be3e1cf2a5c31b HTTP/1.1" 200 None 2026-04-06 02:13:04,718 - lava_callback - DEBUG - Processing node 69d073aad2be3e1cf2a5c31b: baseline-arm64-clabbe 2026-04-06 02:13:04,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d073aad2be3e1cf2a5c31b 2026-04-06 02:13:04,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:13:04,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d073aad2be3e1cf2a5c31b HTTP/1.1" 200 None 2026-04-06 02:13:04,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:13:04,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:13:04,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:13:04,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d073aad2be3e1cf2a5c31b HTTP/1.1" 200 None 2026-04-06 02:13:04,792 - lava_callback - ERROR - Error processing callback for node 69d073aad2be3e1cf2a5c31b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET /node/6992671398a8bdb31c391f99%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 02:14:03,020 - lava_callback - INFO - Received callback for node 69d316a513dd9a9509894dbe INFO: 172.21.0.1:50590 - "POST /node/69d316a513dd9a9509894dbe HTTP/1.0" 202 Accepted 2026-04-06 02:14:03,026 - lava_callback - INFO - Starting async job submit for node 69d316a513dd9a9509894dbe 2026-04-06 02:14:03,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:03,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d316a513dd9a9509894dbe HTTP/1.1" 200 None 2026-04-06 02:14:03,072 - lava_callback - DEBUG - Processing node 69d316a513dd9a9509894dbe: baseline-arm64 2026-04-06 02:14:03,270 - lava_callback - WARNING - Failed to upload log 2026-04-06 02:14:03,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:14:03,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:14:03,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d316a513dd9a9509894dbe/lava-logs.yaml 2026-04-06 02:14:03,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:14:03,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:14:03,746 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d316a513dd9a9509894dbe/lava_callback.json.gz 2026-04-06 02:14:03,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:03,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d316a513dd9a9509894dbe HTTP/1.1" 200 None 2026-04-06 02:14:03,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:03,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:14:03,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:03,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d316a513dd9a9509894dbe HTTP/1.1" 200 None 2026-04-06 02:14:03,902 - lava_callback - INFO - Completed processing callback for node 69d316a513dd9a9509894dbe 2026-04-06 02:14:05,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:05,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:14:19,187 - lava_callback - INFO - Received callback for node 69d316ef13dd9a9509894e11 INFO: 172.21.0.1:34918 - "POST /node/69d316ef13dd9a9509894e11 HTTP/1.0" 202 Accepted 2026-04-06 02:14:19,193 - lava_callback - INFO - Starting async job submit for node 69d316ef13dd9a9509894e11 2026-04-06 02:14:19,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:19,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d316ef13dd9a9509894e11 HTTP/1.1" 200 None 2026-04-06 02:14:19,211 - lava_callback - DEBUG - Processing node 69d316ef13dd9a9509894e11: baseline-nfs-arm64 2026-04-06 02:14:19,212 - lava_callback - WARNING - Failed to upload log 2026-04-06 02:14:19,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:14:19,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:14:19,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d316ef13dd9a9509894e11/lava-logs.yaml 2026-04-06 02:14:19,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:14:19,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:14:19,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d316ef13dd9a9509894e11/lava_callback.json.gz 2026-04-06 02:14:19,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:19,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d316ef13dd9a9509894e11 HTTP/1.1" 200 None 2026-04-06 02:14:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:19,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:14:19,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:19,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d316ef13dd9a9509894e11 HTTP/1.1" 200 None 2026-04-06 02:14:19,583 - lava_callback - INFO - Completed processing callback for node 69d316ef13dd9a9509894e11 INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:14:35,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:14:35,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /node/69936730cebe99dd8e065b4f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:15:24,787 - lava_callback - INFO - Received callback for node 69d07437d2be3e1cf2a5c37f INFO: 172.21.0.1:33206 - "POST /node/69d07437d2be3e1cf2a5c37f HTTP/1.0" 202 Accepted 2026-04-06 02:15:24,793 - lava_callback - INFO - Starting async job submit for node 69d07437d2be3e1cf2a5c37f 2026-04-06 02:15:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:15:24,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07437d2be3e1cf2a5c37f HTTP/1.1" 200 None 2026-04-06 02:15:24,817 - lava_callback - DEBUG - Processing node 69d07437d2be3e1cf2a5c37f: baseline-arm64-clabbe 2026-04-06 02:15:24,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07437d2be3e1cf2a5c37f 2026-04-06 02:15:24,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:15:24,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07437d2be3e1cf2a5c37f HTTP/1.1" 200 None 2026-04-06 02:15:24,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:15:24,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:15:24,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:15:24,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07437d2be3e1cf2a5c37f HTTP/1.1" 200 None 2026-04-06 02:15:24,881 - lava_callback - ERROR - Error processing callback for node 69d07437d2be3e1cf2a5c37f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET /node/698a8296d9a1cfa777a2383e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 02:16:44,868 - lava_callback - INFO - Received callback for node 69d0747ad2be3e1cf2a5c3d5 INFO: 172.21.0.1:46470 - "POST /node/69d0747ad2be3e1cf2a5c3d5 HTTP/1.0" 202 Accepted 2026-04-06 02:16:44,874 - lava_callback - INFO - Starting async job submit for node 69d0747ad2be3e1cf2a5c3d5 2026-04-06 02:16:44,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:16:44,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0747ad2be3e1cf2a5c3d5 HTTP/1.1" 200 None 2026-04-06 02:16:44,899 - lava_callback - DEBUG - Processing node 69d0747ad2be3e1cf2a5c3d5: baseline-arm64-clabbe 2026-04-06 02:16:44,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0747ad2be3e1cf2a5c3d5 2026-04-06 02:16:44,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:16:44,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0747ad2be3e1cf2a5c3d5 HTTP/1.1" 200 None 2026-04-06 02:16:44,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:16:44,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:16:44,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:16:44,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0747ad2be3e1cf2a5c3d5 HTTP/1.1" 200 None 2026-04-06 02:16:44,967 - lava_callback - ERROR - Error processing callback for node 69d0747ad2be3e1cf2a5c3d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:17:44,928 - lava_callback - INFO - Received callback for node 69d074c2d2be3e1cf2a5c400 INFO: 172.21.0.1:35622 - "POST /node/69d074c2d2be3e1cf2a5c400 HTTP/1.0" 202 Accepted 2026-04-06 02:17:44,933 - lava_callback - INFO - Starting async job submit for node 69d074c2d2be3e1cf2a5c400 2026-04-06 02:17:44,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:17:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d074c2d2be3e1cf2a5c400 HTTP/1.1" 200 None 2026-04-06 02:17:44,948 - lava_callback - DEBUG - Processing node 69d074c2d2be3e1cf2a5c400: baseline-arm64-clabbe 2026-04-06 02:17:44,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d074c2d2be3e1cf2a5c400 2026-04-06 02:17:44,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:17:44,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d074c2d2be3e1cf2a5c400 HTTP/1.1" 200 None 2026-04-06 02:17:44,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:17:44,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:17:44,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:17:45,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d074c2d2be3e1cf2a5c400 HTTP/1.1" 200 None 2026-04-06 02:17:45,010 - lava_callback - ERROR - Error processing callback for node 69d074c2d2be3e1cf2a5c400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET /node/695305e19912bd6bbcea6dbe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:18:38,921 - lava_callback - INFO - Received callback for node 69d317b213dd9a9509894eb4 INFO: 172.21.0.1:52274 - "POST /node/69d317b213dd9a9509894eb4 HTTP/1.0" 202 Accepted 2026-04-06 02:18:38,928 - lava_callback - INFO - Starting async job submit for node 69d317b213dd9a9509894eb4 2026-04-06 02:18:38,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:18:38,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d317b213dd9a9509894eb4 HTTP/1.1" 200 None 2026-04-06 02:18:38,966 - lava_callback - DEBUG - Processing node 69d317b213dd9a9509894eb4: baseline-arm64 2026-04-06 02:18:39,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:18:39,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:18:39,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d317b213dd9a9509894eb4/log.txt.gz 2026-04-06 02:18:39,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:18:40,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:18:40,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d317b213dd9a9509894eb4/lava-logs.yaml 2026-04-06 02:18:40,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:18:40,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:18:40,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d317b213dd9a9509894eb4/lava_callback.json.gz 2026-04-06 02:18:40,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:18:40,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d317b213dd9a9509894eb4 HTTP/1.1" 200 None 2026-04-06 02:18:40,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:18:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:18:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:18:40,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d317b213dd9a9509894eb4 HTTP/1.1" 200 None 2026-04-06 02:18:40,503 - lava_callback - INFO - Completed processing callback for node 69d317b213dd9a9509894eb4 INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:19:04,981 - lava_callback - INFO - Received callback for node 69d0750dd2be3e1cf2a5c409 INFO: 172.21.0.1:34496 - "POST /node/69d0750dd2be3e1cf2a5c409 HTTP/1.0" 202 Accepted 2026-04-06 02:19:04,986 - lava_callback - INFO - Starting async job submit for node 69d0750dd2be3e1cf2a5c409 2026-04-06 02:19:04,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:19:05,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0750dd2be3e1cf2a5c409 HTTP/1.1" 200 None 2026-04-06 02:19:05,004 - lava_callback - DEBUG - Processing node 69d0750dd2be3e1cf2a5c409: baseline-arm64-clabbe 2026-04-06 02:19:05,004 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0750dd2be3e1cf2a5c409 2026-04-06 02:19:05,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:19:05,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0750dd2be3e1cf2a5c409 HTTP/1.1" 200 None 2026-04-06 02:19:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:19:05,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:19:05,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:19:05,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0750dd2be3e1cf2a5c409 HTTP/1.1" 200 None 2026-04-06 02:19:05,064 - lava_callback - ERROR - Error processing callback for node 69d0750dd2be3e1cf2a5c409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 02:19:05,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:19:05,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET /node/693e1cc2407f32424eb57207%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:21:25,116 - lava_callback - INFO - Received callback for node 69d0759ed2be3e1cf2a5c44d INFO: 172.21.0.1:40240 - "POST /node/69d0759ed2be3e1cf2a5c44d HTTP/1.0" 202 Accepted 2026-04-06 02:21:25,123 - lava_callback - INFO - Starting async job submit for node 69d0759ed2be3e1cf2a5c44d 2026-04-06 02:21:25,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:21:25,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0759ed2be3e1cf2a5c44d HTTP/1.1" 200 None 2026-04-06 02:21:25,140 - lava_callback - DEBUG - Processing node 69d0759ed2be3e1cf2a5c44d: baseline-arm64-clabbe 2026-04-06 02:21:25,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0759ed2be3e1cf2a5c44d 2026-04-06 02:21:25,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:21:25,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0759ed2be3e1cf2a5c44d HTTP/1.1" 200 None 2026-04-06 02:21:25,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:21:25,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-06 02:21:25,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:21:25,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0759ed2be3e1cf2a5c44d HTTP/1.1" 200 None 2026-04-06 02:21:25,193 - lava_callback - ERROR - Error processing callback for node 69d0759ed2be3e1cf2a5c44d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:22:30,097 - lava_callback - INFO - Received callback for node 69d3172613dd9a9509894e7a INFO: 172.21.0.1:35668 - "POST /node/69d3172613dd9a9509894e7a HTTP/1.0" 202 Accepted 2026-04-06 02:22:30,104 - lava_callback - INFO - Starting async job submit for node 69d3172613dd9a9509894e7a 2026-04-06 02:22:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:22:30,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3172613dd9a9509894e7a HTTP/1.1" 200 None 2026-04-06 02:22:30,153 - lava_callback - DEBUG - Processing node 69d3172613dd9a9509894e7a: baseline-arm64 2026-04-06 02:22:30,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:22:30,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:22:30,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3172613dd9a9509894e7a/log.txt.gz 2026-04-06 02:22:30,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:22:31,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:22:31,192 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3172613dd9a9509894e7a/lava-logs.yaml 2026-04-06 02:22:31,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:22:31,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:22:31,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3172613dd9a9509894e7a/lava_callback.json.gz DEBUG: Setup failed for 69d3172613dd9a9509894e7a. Transitting job node result: incomplete -> fail 2026-04-06 02:22:31,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:22:31,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3172613dd9a9509894e7a HTTP/1.1" 200 None 2026-04-06 02:22:31,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:22:32,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:22:32,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:22:32,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3172613dd9a9509894e7a HTTP/1.1" 200 None 2026-04-06 02:22:32,617 - lava_callback - INFO - Completed processing callback for node 69d3172613dd9a9509894e7a 2026-04-06 02:22:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:22:35,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET /node/693f3a6224745582e399e67c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET /node/69869a412de8e2dea366681e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET /node/69830f39409235c29c0de6f4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET /node/698af6733b3beb19e76171a6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET /node/699448525ae459b9df3dad21%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35728 - "GET /node/693b1b9215f407b7629e0266%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:33:25,681 - lava_callback - INFO - Received callback for node 69d31b3713dd9a95098951cf INFO: 172.21.0.1:51304 - "POST /node/69d31b3713dd9a95098951cf HTTP/1.0" 202 Accepted 2026-04-06 02:33:25,687 - lava_callback - INFO - Starting async job submit for node 69d31b3713dd9a95098951cf 2026-04-06 02:33:25,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:25,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31b3713dd9a95098951cf HTTP/1.1" 200 None 2026-04-06 02:33:25,747 - lava_callback - DEBUG - Processing node 69d31b3713dd9a95098951cf: baseline-arm64 2026-04-06 02:33:25,877 - lava_callback - WARNING - Failed to upload log 2026-04-06 02:33:25,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:33:26,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:33:26,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31b3713dd9a95098951cf/lava-logs.yaml 2026-04-06 02:33:26,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:33:26,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:33:26,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31b3713dd9a95098951cf/lava_callback.json.gz 2026-04-06 02:33:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31b3713dd9a95098951cf HTTP/1.1" 200 None 2026-04-06 02:33:26,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:33:26,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:26,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31b3713dd9a95098951cf HTTP/1.1" 200 None 2026-04-06 02:33:26,437 - lava_callback - INFO - Completed processing callback for node 69d31b3713dd9a95098951cf INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:33:30,531 - lava_callback - INFO - Received callback for node 69d3192213dd9a9509895023 INFO: 172.21.0.1:57302 - "POST /node/69d3192213dd9a9509895023 HTTP/1.0" 202 Accepted 2026-04-06 02:33:30,542 - lava_callback - INFO - Starting async job submit for node 69d3192213dd9a9509895023 2026-04-06 02:33:30,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:30,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3192213dd9a9509895023 HTTP/1.1" 200 None 2026-04-06 02:33:30,591 - lava_callback - DEBUG - Processing node 69d3192213dd9a9509895023: baseline-nfs-arm64 2026-04-06 02:33:31,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:33:31,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:33:31,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3192213dd9a9509895023/log.txt.gz 2026-04-06 02:33:31,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:33:31,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:33:31,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3192213dd9a9509895023/lava-logs.yaml 2026-04-06 02:33:31,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:33:31,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:33:31,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3192213dd9a9509895023/lava_callback.json.gz 2026-04-06 02:33:32,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:32,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3192213dd9a9509895023 HTTP/1.1" 200 None 2026-04-06 02:33:32,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:32,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:33:32,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:32,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3192213dd9a9509895023 HTTP/1.1" 200 None 2026-04-06 02:33:32,152 - lava_callback - INFO - Completed processing callback for node 69d3192213dd9a9509895023 2026-04-06 02:33:35,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:33:35,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET /node/698b38843b3beb19e761a3b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45038 - "GET /node/693b7ff141fb4c950976461a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:34:39,387 - lava_callback - INFO - Received callback for node 69d31b7913dd9a9509895202 INFO: 172.21.0.1:41702 - "POST /node/69d31b7913dd9a9509895202 HTTP/1.0" 202 Accepted 2026-04-06 02:34:39,394 - lava_callback - INFO - Starting async job submit for node 69d31b7913dd9a9509895202 2026-04-06 02:34:39,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:39,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31b7913dd9a9509895202 HTTP/1.1" 200 None 2026-04-06 02:34:39,457 - lava_callback - DEBUG - Processing node 69d31b7913dd9a9509895202: baseline-arm64 2026-04-06 02:34:39,658 - lava_callback - WARNING - Failed to upload log 2026-04-06 02:34:39,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:34:39,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:34:39,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31b7913dd9a9509895202/lava-logs.yaml 2026-04-06 02:34:39,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:34:40,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:34:40,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31b7913dd9a9509895202/lava_callback.json.gz 2026-04-06 02:34:40,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:40,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31b7913dd9a9509895202 HTTP/1.1" 200 None 2026-04-06 02:34:40,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:40,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:34:40,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:40,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31b7913dd9a9509895202 HTTP/1.1" 200 None 2026-04-06 02:34:40,271 - lava_callback - INFO - Completed processing callback for node 69d31b7913dd9a9509895202 INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:34:48,045 - lava_callback - INFO - Received callback for node 69d317ed13dd9a9509894efc INFO: 172.21.0.1:55576 - "POST /node/69d317ed13dd9a9509894efc HTTP/1.0" 202 Accepted 2026-04-06 02:34:48,053 - lava_callback - INFO - Starting async job submit for node 69d317ed13dd9a9509894efc 2026-04-06 02:34:48,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:48,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d317ed13dd9a9509894efc HTTP/1.1" 200 None 2026-04-06 02:34:48,147 - lava_callback - DEBUG - Processing node 69d317ed13dd9a9509894efc: baseline-arm 2026-04-06 02:34:48,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:34:48,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:34:48,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d317ed13dd9a9509894efc/log.txt.gz 2026-04-06 02:34:49,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:34:49,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:34:49,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d317ed13dd9a9509894efc/lava-logs.yaml 2026-04-06 02:34:49,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:34:49,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:34:49,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d317ed13dd9a9509894efc/lava_callback.json.gz DEBUG: Setup failed for 69d317ed13dd9a9509894efc. Transitting job node result: incomplete -> fail 2026-04-06 02:34:49,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:49,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d317ed13dd9a9509894efc HTTP/1.1" 200 None 2026-04-06 02:34:49,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:49,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 02:34:49,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:34:49,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d317ed13dd9a9509894efc HTTP/1.1" 200 None 2026-04-06 02:34:50,072 - lava_callback - INFO - Completed processing callback for node 69d317ed13dd9a9509894efc INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:35:05,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:35:05,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:36:24,743 - lava_callback - INFO - Received callback for node 69d319a413dd9a950989508b INFO: 172.21.0.1:58606 - "POST /node/69d319a413dd9a950989508b HTTP/1.0" 202 Accepted 2026-04-06 02:36:24,750 - lava_callback - INFO - Starting async job submit for node 69d319a413dd9a950989508b 2026-04-06 02:36:24,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:36:24,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d319a413dd9a950989508b HTTP/1.1" 200 None 2026-04-06 02:36:24,789 - lava_callback - DEBUG - Processing node 69d319a413dd9a950989508b: baseline-arm64 2026-04-06 02:36:25,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:36:25,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:36:25,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d319a413dd9a950989508b/log.txt.gz 2026-04-06 02:36:25,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:36:26,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:36:26,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d319a413dd9a950989508b/lava-logs.yaml 2026-04-06 02:36:26,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:36:26,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:36:26,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d319a413dd9a950989508b/lava_callback.json.gz 2026-04-06 02:36:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:36:26,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d319a413dd9a950989508b HTTP/1.1" 200 None 2026-04-06 02:36:26,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:36:26,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:36:26,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:36:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d319a413dd9a950989508b HTTP/1.1" 200 None 2026-04-06 02:36:26,450 - lava_callback - INFO - Completed processing callback for node 69d319a413dd9a950989508b INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:36:35,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:36:35,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET /node/698458d43a8748f2820851b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:40:11,502 - lava_callback - INFO - Received callback for node 69d31bc713dd9a9509895239 INFO: 172.21.0.1:34486 - "POST /node/69d31bc713dd9a9509895239 HTTP/1.0" 202 Accepted 2026-04-06 02:40:11,509 - lava_callback - INFO - Starting async job submit for node 69d31bc713dd9a9509895239 2026-04-06 02:40:11,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:40:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31bc713dd9a9509895239 HTTP/1.1" 200 None 2026-04-06 02:40:11,566 - lava_callback - DEBUG - Processing node 69d31bc713dd9a9509895239: baseline-arm64 2026-04-06 02:40:12,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:40:12,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:40:12,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31bc713dd9a9509895239/log.txt.gz 2026-04-06 02:40:12,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:40:12,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:40:12,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31bc713dd9a9509895239/lava-logs.yaml 2026-04-06 02:40:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:40:12,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:40:12,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31bc713dd9a9509895239/lava_callback.json.gz DEBUG: Setup failed for 69d31bc713dd9a9509895239. Transitting job node result: incomplete -> fail 2026-04-06 02:40:12,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:40:13,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31bc713dd9a9509895239 HTTP/1.1" 200 None 2026-04-06 02:40:13,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:40:13,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:40:13,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:40:13,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31bc713dd9a9509895239 HTTP/1.1" 200 None 2026-04-06 02:40:13,118 - lava_callback - INFO - Completed processing callback for node 69d31bc713dd9a9509895239 INFO: 172.21.0.1:34500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:40:35,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:40:35,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET /node/698464d03a8748f282086a0d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:46:57,696 - lava_callback - INFO - Received callback for node 69d31c0a13dd9a950989527c INFO: 172.21.0.1:58658 - "POST /node/69d31c0a13dd9a950989527c HTTP/1.0" 202 Accepted 2026-04-06 02:46:57,703 - lava_callback - INFO - Starting async job submit for node 69d31c0a13dd9a950989527c 2026-04-06 02:46:57,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:46:57,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c0a13dd9a950989527c HTTP/1.1" 200 None 2026-04-06 02:46:57,746 - lava_callback - DEBUG - Processing node 69d31c0a13dd9a950989527c: baseline-nfs-arm64 2026-04-06 02:46:58,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:46:58,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:46:58,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31c0a13dd9a950989527c/log.txt.gz 2026-04-06 02:46:58,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:46:58,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:46:58,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31c0a13dd9a950989527c/lava-logs.yaml 2026-04-06 02:46:58,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:46:59,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:46:59,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31c0a13dd9a950989527c/lava_callback.json.gz 2026-04-06 02:46:59,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:46:59,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c0a13dd9a950989527c HTTP/1.1" 200 None 2026-04-06 02:46:59,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:46:59,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:46:59,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:46:59,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31c0a13dd9a950989527c HTTP/1.1" 200 None 2026-04-06 02:46:59,463 - lava_callback - INFO - Completed processing callback for node 69d31c0a13dd9a950989527c 2026-04-06 02:47:05,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:47:05,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:47:39,567 - lava_callback - INFO - Received callback for node 69d31c6c13dd9a95098952b2 INFO: 172.21.0.1:53054 - "POST /node/69d31c6c13dd9a95098952b2 HTTP/1.0" 202 Accepted 2026-04-06 02:47:39,574 - lava_callback - INFO - Starting async job submit for node 69d31c6c13dd9a95098952b2 2026-04-06 02:47:39,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:47:39,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c6c13dd9a95098952b2 HTTP/1.1" 200 None 2026-04-06 02:47:39,618 - lava_callback - DEBUG - Processing node 69d31c6c13dd9a95098952b2: baseline-arm64 2026-04-06 02:47:40,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:47:40,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:47:40,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31c6c13dd9a95098952b2/log.txt.gz 2026-04-06 02:47:40,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:47:40,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:47:40,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31c6c13dd9a95098952b2/lava-logs.yaml 2026-04-06 02:47:40,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:47:41,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:47:41,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d31c6c13dd9a95098952b2/lava_callback.json.gz 2026-04-06 02:47:41,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:47:41,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c6c13dd9a95098952b2 HTTP/1.1" 200 None 2026-04-06 02:47:41,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:47:41,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:47:41,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:47:41,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31c6c13dd9a95098952b2 HTTP/1.1" 200 None 2026-04-06 02:47:41,140 - lava_callback - INFO - Completed processing callback for node 69d31c6c13dd9a95098952b2 INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:48:05,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:48:05,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:51:11,851 - lava_callback - INFO - Received callback for node 69d31af813dd9a95098951a3 INFO: 172.21.0.1:42414 - "POST /node/69d31af813dd9a95098951a3 HTTP/1.0" 202 Accepted 2026-04-06 02:51:11,859 - lava_callback - INFO - Starting async job submit for node 69d31af813dd9a95098951a3 2026-04-06 02:51:11,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:51:11,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31af813dd9a95098951a3 HTTP/1.1" 200 None 2026-04-06 02:51:11,919 - lava_callback - DEBUG - Processing node 69d31af813dd9a95098951a3: baseline-nfs-arm64 2026-04-06 02:51:13,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:51:13,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:51:13,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31af813dd9a95098951a3/log.txt.gz 2026-04-06 02:51:13,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:51:14,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:51:14,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31af813dd9a95098951a3/lava-logs.yaml 2026-04-06 02:51:14,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:51:14,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:51:14,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31af813dd9a95098951a3/lava_callback.json.gz DEBUG: Setup failed for 69d31af813dd9a95098951a3. Transitting job node result: incomplete -> fail 2026-04-06 02:51:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:51:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31af813dd9a95098951a3 HTTP/1.1" 200 None 2026-04-06 02:51:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:51:14,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 02:51:14,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:51:14,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31af813dd9a95098951a3 HTTP/1.1" 200 None 2026-04-06 02:51:14,643 - lava_callback - INFO - Completed processing callback for node 69d31af813dd9a95098951a3 INFO: 172.21.0.1:42416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:51:35,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:51:35,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:54:06,865 - lava_callback - INFO - Received callback for node 69d31c4913dd9a95098952a9 INFO: 172.21.0.1:33878 - "POST /node/69d31c4913dd9a95098952a9 HTTP/1.0" 202 Accepted 2026-04-06 02:54:06,872 - lava_callback - INFO - Starting async job submit for node 69d31c4913dd9a95098952a9 2026-04-06 02:54:06,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:54:06,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c4913dd9a95098952a9 HTTP/1.1" 200 None 2026-04-06 02:54:06,940 - lava_callback - DEBUG - Processing node 69d31c4913dd9a95098952a9: baseline-arm 2026-04-06 02:54:07,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:54:07,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:54:07,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d31c4913dd9a95098952a9/log.txt.gz 2026-04-06 02:54:08,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:54:08,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:54:08,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d31c4913dd9a95098952a9/lava-logs.yaml 2026-04-06 02:54:08,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 02:54:08,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 02:54:08,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d31c4913dd9a95098952a9/lava_callback.json.gz DEBUG: Setup failed for 69d31c4913dd9a95098952a9. Transitting job node result: incomplete -> fail 2026-04-06 02:54:08,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:54:08,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31c4913dd9a95098952a9 HTTP/1.1" 200 None 2026-04-06 02:54:08,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:54:08,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-06 02:54:08,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:54:08,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31c4913dd9a95098952a9 HTTP/1.1" 200 None 2026-04-06 02:54:08,846 - lava_callback - INFO - Completed processing callback for node 69d31c4913dd9a95098952a9 INFO: 172.21.0.1:42644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK 2026-04-06 02:54:35,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 02:54:35,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 03:00:16,137 - lava_callback - INFO - Received callback for node 69d07ebbd2be3e1cf2a5c65f INFO: 172.21.0.1:45204 - "POST /node/69d07ebbd2be3e1cf2a5c65f HTTP/1.0" 202 Accepted 2026-04-06 03:00:16,142 - lava_callback - INFO - Starting async job submit for node 69d07ebbd2be3e1cf2a5c65f 2026-04-06 03:00:16,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:00:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07ebbd2be3e1cf2a5c65f HTTP/1.1" 200 None 2026-04-06 03:00:16,159 - lava_callback - DEBUG - Processing node 69d07ebbd2be3e1cf2a5c65f: baseline-arm64-baylibre 2026-04-06 03:00:16,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07ebbd2be3e1cf2a5c65f 2026-04-06 03:00:16,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:00:16,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07ebbd2be3e1cf2a5c65f HTTP/1.1" 200 None 2026-04-06 03:00:16,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:00:16,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:00:16,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:00:16,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07ebbd2be3e1cf2a5c65f HTTP/1.1" 200 None 2026-04-06 03:00:16,217 - lava_callback - ERROR - Error processing callback for node 69d07ebbd2be3e1cf2a5c65f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:01:36,044 - lava_callback - INFO - Received callback for node 69d07f01d2be3e1cf2a5c699 INFO: 172.21.0.1:41022 - "POST /node/69d07f01d2be3e1cf2a5c699 HTTP/1.0" 202 Accepted 2026-04-06 03:01:36,050 - lava_callback - INFO - Starting async job submit for node 69d07f01d2be3e1cf2a5c699 2026-04-06 03:01:36,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:01:36,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07f01d2be3e1cf2a5c699 HTTP/1.1" 200 None 2026-04-06 03:01:36,065 - lava_callback - DEBUG - Processing node 69d07f01d2be3e1cf2a5c699: baseline-arm64-baylibre 2026-04-06 03:01:36,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07f01d2be3e1cf2a5c699 2026-04-06 03:01:36,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:01:36,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07f01d2be3e1cf2a5c699 HTTP/1.1" 200 None 2026-04-06 03:01:36,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:01:36,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:01:36,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:01:36,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07f01d2be3e1cf2a5c699 HTTP/1.1" 200 None 2026-04-06 03:01:36,127 - lava_callback - ERROR - Error processing callback for node 69d07f01d2be3e1cf2a5c699: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:02:56,170 - lava_callback - INFO - Received callback for node 69d07f4cd2be3e1cf2a5c6bf INFO: 172.21.0.1:40334 - "POST /node/69d07f4cd2be3e1cf2a5c6bf HTTP/1.0" 202 Accepted 2026-04-06 03:02:56,176 - lava_callback - INFO - Starting async job submit for node 69d07f4cd2be3e1cf2a5c6bf 2026-04-06 03:02:56,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:02:56,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07f4cd2be3e1cf2a5c6bf HTTP/1.1" 200 None 2026-04-06 03:02:56,192 - lava_callback - DEBUG - Processing node 69d07f4cd2be3e1cf2a5c6bf: baseline-arm64-baylibre 2026-04-06 03:02:56,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07f4cd2be3e1cf2a5c6bf 2026-04-06 03:02:56,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:02:56,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07f4cd2be3e1cf2a5c6bf HTTP/1.1" 200 None 2026-04-06 03:02:56,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:02:56,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:02:56,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:02:56,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07f4cd2be3e1cf2a5c6bf HTTP/1.1" 200 None 2026-04-06 03:02:56,243 - lava_callback - ERROR - Error processing callback for node 69d07f4cd2be3e1cf2a5c6bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:04:27,056 - lava_callback - INFO - Received callback for node 69d07fa5d2be3e1cf2a5c706 INFO: 172.21.0.1:60876 - "POST /node/69d07fa5d2be3e1cf2a5c706 HTTP/1.0" 202 Accepted 2026-04-06 03:04:27,062 - lava_callback - INFO - Starting async job submit for node 69d07fa5d2be3e1cf2a5c706 2026-04-06 03:04:27,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:04:27,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07fa5d2be3e1cf2a5c706 HTTP/1.1" 200 None 2026-04-06 03:04:27,080 - lava_callback - DEBUG - Processing node 69d07fa5d2be3e1cf2a5c706: baseline-arm64-clabbe 2026-04-06 03:04:27,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07fa5d2be3e1cf2a5c706 2026-04-06 03:04:27,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:04:27,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07fa5d2be3e1cf2a5c706 HTTP/1.1" 200 None 2026-04-06 03:04:27,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:04:27,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:04:27,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:04:27,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07fa5d2be3e1cf2a5c706 HTTP/1.1" 200 None 2026-04-06 03:04:27,139 - lava_callback - ERROR - Error processing callback for node 69d07fa5d2be3e1cf2a5c706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:05:27,085 - lava_callback - INFO - Received callback for node 69d07fe5d2be3e1cf2a5c752 INFO: 172.21.0.1:42850 - "POST /node/69d07fe5d2be3e1cf2a5c752 HTTP/1.0" 202 Accepted 2026-04-06 03:05:27,091 - lava_callback - INFO - Starting async job submit for node 69d07fe5d2be3e1cf2a5c752 2026-04-06 03:05:27,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:05:27,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07fe5d2be3e1cf2a5c752 HTTP/1.1" 200 None 2026-04-06 03:05:27,106 - lava_callback - DEBUG - Processing node 69d07fe5d2be3e1cf2a5c752: baseline-arm64-clabbe 2026-04-06 03:05:27,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d07fe5d2be3e1cf2a5c752 2026-04-06 03:05:27,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:05:27,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d07fe5d2be3e1cf2a5c752 HTTP/1.1" 200 None 2026-04-06 03:05:27,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:05:27,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:05:27,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:05:27,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d07fe5d2be3e1cf2a5c752 HTTP/1.1" 200 None 2026-04-06 03:05:27,159 - lava_callback - ERROR - Error processing callback for node 69d07fe5d2be3e1cf2a5c752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:06:27,176 - lava_callback - INFO - Received callback for node 69d0802bd2be3e1cf2a5c77b INFO: 172.21.0.1:46436 - "POST /node/69d0802bd2be3e1cf2a5c77b HTTP/1.0" 202 Accepted 2026-04-06 03:06:27,181 - lava_callback - INFO - Starting async job submit for node 69d0802bd2be3e1cf2a5c77b 2026-04-06 03:06:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:06:27,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0802bd2be3e1cf2a5c77b HTTP/1.1" 200 None 2026-04-06 03:06:27,198 - lava_callback - DEBUG - Processing node 69d0802bd2be3e1cf2a5c77b: baseline-arm64-clabbe 2026-04-06 03:06:27,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0802bd2be3e1cf2a5c77b 2026-04-06 03:06:27,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:06:27,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0802bd2be3e1cf2a5c77b HTTP/1.1" 200 None 2026-04-06 03:06:27,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:06:27,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:06:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:06:27,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0802bd2be3e1cf2a5c77b HTTP/1.1" 200 None 2026-04-06 03:06:27,257 - lava_callback - ERROR - Error processing callback for node 69d0802bd2be3e1cf2a5c77b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:07:47,160 - lava_callback - INFO - Received callback for node 69d08070d2be3e1cf2a5c7a6 INFO: 172.21.0.1:45804 - "POST /node/69d08070d2be3e1cf2a5c7a6 HTTP/1.0" 202 Accepted 2026-04-06 03:07:47,165 - lava_callback - INFO - Starting async job submit for node 69d08070d2be3e1cf2a5c7a6 2026-04-06 03:07:47,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:07:47,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08070d2be3e1cf2a5c7a6 HTTP/1.1" 200 None 2026-04-06 03:07:47,191 - lava_callback - DEBUG - Processing node 69d08070d2be3e1cf2a5c7a6: baseline-arm64-clabbe 2026-04-06 03:07:47,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08070d2be3e1cf2a5c7a6 2026-04-06 03:07:47,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:07:47,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08070d2be3e1cf2a5c7a6 HTTP/1.1" 200 None 2026-04-06 03:07:47,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:07:47,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:07:47,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:07:47,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08070d2be3e1cf2a5c7a6 HTTP/1.1" 200 None 2026-04-06 03:07:47,249 - lava_callback - ERROR - Error processing callback for node 69d08070d2be3e1cf2a5c7a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:09:27,217 - lava_callback - INFO - Received callback for node 69d080d1d2be3e1cf2a5c7df INFO: 172.21.0.1:54218 - "POST /node/69d080d1d2be3e1cf2a5c7df HTTP/1.0" 202 Accepted 2026-04-06 03:09:27,223 - lava_callback - INFO - Starting async job submit for node 69d080d1d2be3e1cf2a5c7df 2026-04-06 03:09:27,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:09:27,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d080d1d2be3e1cf2a5c7df HTTP/1.1" 200 None 2026-04-06 03:09:27,239 - lava_callback - DEBUG - Processing node 69d080d1d2be3e1cf2a5c7df: baseline-arm64-clabbe 2026-04-06 03:09:27,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d080d1d2be3e1cf2a5c7df 2026-04-06 03:09:27,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:09:27,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d080d1d2be3e1cf2a5c7df HTTP/1.1" 200 None 2026-04-06 03:09:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:09:27,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:09:27,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:09:27,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d080d1d2be3e1cf2a5c7df HTTP/1.1" 200 None 2026-04-06 03:09:27,301 - lava_callback - ERROR - Error processing callback for node 69d080d1d2be3e1cf2a5c7df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:10:27,251 - lava_callback - INFO - Received callback for node 69d08113d2be3e1cf2a5c82b INFO: 172.21.0.1:57728 - "POST /node/69d08113d2be3e1cf2a5c82b HTTP/1.0" 202 Accepted 2026-04-06 03:10:27,257 - lava_callback - INFO - Starting async job submit for node 69d08113d2be3e1cf2a5c82b 2026-04-06 03:10:27,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:10:27,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08113d2be3e1cf2a5c82b HTTP/1.1" 200 None 2026-04-06 03:10:27,273 - lava_callback - DEBUG - Processing node 69d08113d2be3e1cf2a5c82b: baseline-arm64-clabbe 2026-04-06 03:10:27,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08113d2be3e1cf2a5c82b 2026-04-06 03:10:27,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:10:27,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08113d2be3e1cf2a5c82b HTTP/1.1" 200 None 2026-04-06 03:10:27,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:10:27,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-06 03:10:27,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:10:27,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08113d2be3e1cf2a5c82b HTTP/1.1" 200 None 2026-04-06 03:10:27,329 - lava_callback - ERROR - Error processing callback for node 69d08113d2be3e1cf2a5c82b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:11:22,077 - lava_callback - INFO - Received callback for node 69d31fb313dd9a95098954ca INFO: 172.21.0.1:47982 - "POST /node/69d31fb313dd9a95098954ca HTTP/1.0" 202 Accepted 2026-04-06 03:11:22,085 - lava_callback - INFO - Starting async job submit for node 69d31fb313dd9a95098954ca 2026-04-06 03:11:22,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:11:22,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31fb313dd9a95098954ca HTTP/1.1" 200 None 2026-04-06 03:11:22,149 - lava_callback - DEBUG - Processing node 69d31fb313dd9a95098954ca: baseline-nfs-arm64 2026-04-06 03:11:23,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 03:11:23,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 03:11:23,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31fb313dd9a95098954ca/log.txt.gz 2026-04-06 03:11:24,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 03:11:24,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 03:11:24,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31fb313dd9a95098954ca/lava-logs.yaml 2026-04-06 03:11:24,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 03:11:25,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 03:11:25,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d31fb313dd9a95098954ca/lava_callback.json.gz DEBUG: Setup failed for 69d31fb313dd9a95098954ca. Transitting job node result: incomplete -> fail 2026-04-06 03:11:25,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:11:25,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31fb313dd9a95098954ca HTTP/1.1" 200 None 2026-04-06 03:11:25,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:11:25,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-06 03:11:25,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:11:25,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31fb313dd9a95098954ca HTTP/1.1" 200 None 2026-04-06 03:11:25,591 - lava_callback - INFO - Completed processing callback for node 69d31fb313dd9a95098954ca INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:11:35,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:11:35,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:12:16,700 - lava_callback - INFO - Received callback for node 69d08184d2be3e1cf2a5c8ae INFO: 172.21.0.1:58194 - "POST /node/69d08184d2be3e1cf2a5c8ae HTTP/1.0" 202 Accepted 2026-04-06 03:12:16,705 - lava_callback - INFO - Starting async job submit for node 69d08184d2be3e1cf2a5c8ae 2026-04-06 03:12:16,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:12:16,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08184d2be3e1cf2a5c8ae HTTP/1.1" 200 None 2026-04-06 03:12:16,725 - lava_callback - DEBUG - Processing node 69d08184d2be3e1cf2a5c8ae: baseline-arm-baylibre 2026-04-06 03:12:16,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08184d2be3e1cf2a5c8ae 2026-04-06 03:12:16,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:12:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08184d2be3e1cf2a5c8ae HTTP/1.1" 200 None 2026-04-06 03:12:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:12:16,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:12:16,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:12:16,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08184d2be3e1cf2a5c8ae HTTP/1.1" 200 None 2026-04-06 03:12:16,787 - lava_callback - ERROR - Error processing callback for node 69d08184d2be3e1cf2a5c8ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59156 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:16:07,480 - lava_callback - INFO - Received callback for node 69d08270d2be3e1cf2a5c939 INFO: 172.21.0.1:59168 - "POST /node/69d08270d2be3e1cf2a5c939 HTTP/1.0" 202 Accepted 2026-04-06 03:16:07,485 - lava_callback - INFO - Starting async job submit for node 69d08270d2be3e1cf2a5c939 2026-04-06 03:16:07,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:07,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08270d2be3e1cf2a5c939 HTTP/1.1" 200 None 2026-04-06 03:16:07,501 - lava_callback - DEBUG - Processing node 69d08270d2be3e1cf2a5c939: baseline-arm-clabbe 2026-04-06 03:16:07,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08270d2be3e1cf2a5c939 2026-04-06 03:16:07,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:07,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08270d2be3e1cf2a5c939 HTTP/1.1" 200 None 2026-04-06 03:16:07,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:07,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:16:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:07,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08270d2be3e1cf2a5c939 HTTP/1.1" 200 None 2026-04-06 03:16:07,560 - lava_callback - ERROR - Error processing callback for node 69d08270d2be3e1cf2a5c939: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:16:47,509 - lava_callback - INFO - Received callback for node 69d08290d2be3e1cf2a5c954 INFO: 172.21.0.1:50676 - "POST /node/69d08290d2be3e1cf2a5c954 HTTP/1.0" 202 Accepted 2026-04-06 03:16:47,514 - lava_callback - INFO - Starting async job submit for node 69d08290d2be3e1cf2a5c954 2026-04-06 03:16:47,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:47,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08290d2be3e1cf2a5c954 HTTP/1.1" 200 None 2026-04-06 03:16:47,530 - lava_callback - DEBUG - Processing node 69d08290d2be3e1cf2a5c954: baseline-arm-clabbe 2026-04-06 03:16:47,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08290d2be3e1cf2a5c954 2026-04-06 03:16:47,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:47,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08290d2be3e1cf2a5c954 HTTP/1.1" 200 None 2026-04-06 03:16:47,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:16:47,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:16:47,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08290d2be3e1cf2a5c954 HTTP/1.1" 200 None 2026-04-06 03:16:47,590 - lava_callback - ERROR - Error processing callback for node 69d08290d2be3e1cf2a5c954: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:17:27,544 - lava_callback - INFO - Received callback for node 69d082b2d2be3e1cf2a5c999 INFO: 172.21.0.1:57834 - "POST /node/69d082b2d2be3e1cf2a5c999 HTTP/1.0" 202 Accepted 2026-04-06 03:17:27,550 - lava_callback - INFO - Starting async job submit for node 69d082b2d2be3e1cf2a5c999 2026-04-06 03:17:27,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:27,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082b2d2be3e1cf2a5c999 HTTP/1.1" 200 None 2026-04-06 03:17:27,565 - lava_callback - DEBUG - Processing node 69d082b2d2be3e1cf2a5c999: baseline-arm-clabbe 2026-04-06 03:17:27,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d082b2d2be3e1cf2a5c999 2026-04-06 03:17:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:27,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082b2d2be3e1cf2a5c999 HTTP/1.1" 200 None 2026-04-06 03:17:27,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:17:27,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:27,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d082b2d2be3e1cf2a5c999 HTTP/1.1" 200 None 2026-04-06 03:17:27,645 - lava_callback - ERROR - Error processing callback for node 69d082b2d2be3e1cf2a5c999: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:17:47,534 - lava_callback - INFO - Received callback for node 69d082d1d2be3e1cf2a5c9bd INFO: 172.21.0.1:55130 - "POST /node/69d082d1d2be3e1cf2a5c9bd HTTP/1.0" 202 Accepted 2026-04-06 03:17:47,539 - lava_callback - INFO - Starting async job submit for node 69d082d1d2be3e1cf2a5c9bd 2026-04-06 03:17:47,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082d1d2be3e1cf2a5c9bd HTTP/1.1" 200 None 2026-04-06 03:17:47,555 - lava_callback - DEBUG - Processing node 69d082d1d2be3e1cf2a5c9bd: baseline-arm-clabbe 2026-04-06 03:17:47,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d082d1d2be3e1cf2a5c9bd 2026-04-06 03:17:47,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:47,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082d1d2be3e1cf2a5c9bd HTTP/1.1" 200 None 2026-04-06 03:17:47,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:47,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:17:47,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:17:47,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d082d1d2be3e1cf2a5c9bd HTTP/1.1" 200 None 2026-04-06 03:17:47,606 - lava_callback - ERROR - Error processing callback for node 69d082d1d2be3e1cf2a5c9bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:18:27,609 - lava_callback - INFO - Received callback for node 69d082f1d2be3e1cf2a5c9e8 INFO: 172.21.0.1:46526 - "POST /node/69d082f1d2be3e1cf2a5c9e8 HTTP/1.0" 202 Accepted 2026-04-06 03:18:27,615 - lava_callback - INFO - Starting async job submit for node 69d082f1d2be3e1cf2a5c9e8 2026-04-06 03:18:27,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:27,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082f1d2be3e1cf2a5c9e8 HTTP/1.1" 200 None 2026-04-06 03:18:27,633 - lava_callback - DEBUG - Processing node 69d082f1d2be3e1cf2a5c9e8: baseline-arm-clabbe 2026-04-06 03:18:27,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d082f1d2be3e1cf2a5c9e8 2026-04-06 03:18:27,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:27,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d082f1d2be3e1cf2a5c9e8 HTTP/1.1" 200 None 2026-04-06 03:18:27,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:27,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:18:27,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:27,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d082f1d2be3e1cf2a5c9e8 HTTP/1.1" 200 None 2026-04-06 03:18:27,696 - lava_callback - ERROR - Error processing callback for node 69d082f1d2be3e1cf2a5c9e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:18:47,603 - lava_callback - INFO - Received callback for node 69d08310d2be3e1cf2a5ca13 INFO: 172.21.0.1:35764 - "POST /node/69d08310d2be3e1cf2a5ca13 HTTP/1.0" 202 Accepted 2026-04-06 03:18:47,609 - lava_callback - INFO - Starting async job submit for node 69d08310d2be3e1cf2a5ca13 2026-04-06 03:18:47,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:47,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08310d2be3e1cf2a5ca13 HTTP/1.1" 200 None 2026-04-06 03:18:47,626 - lava_callback - DEBUG - Processing node 69d08310d2be3e1cf2a5ca13: baseline-arm-clabbe 2026-04-06 03:18:47,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08310d2be3e1cf2a5ca13 2026-04-06 03:18:47,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:47,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08310d2be3e1cf2a5ca13 HTTP/1.1" 200 None 2026-04-06 03:18:47,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:47,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:18:47,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:18:47,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08310d2be3e1cf2a5ca13 HTTP/1.1" 200 None 2026-04-06 03:18:47,688 - lava_callback - ERROR - Error processing callback for node 69d08310d2be3e1cf2a5ca13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK 2026-04-06 03:19:27,675 - lava_callback - INFO - Received callback for node 69d08334d2be3e1cf2a5ca23 INFO: 172.21.0.1:54090 - "POST /node/69d08334d2be3e1cf2a5ca23 HTTP/1.0" 202 Accepted 2026-04-06 03:19:27,681 - lava_callback - INFO - Starting async job submit for node 69d08334d2be3e1cf2a5ca23 2026-04-06 03:19:27,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:19:27,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08334d2be3e1cf2a5ca23 HTTP/1.1" 200 None 2026-04-06 03:19:27,698 - lava_callback - DEBUG - Processing node 69d08334d2be3e1cf2a5ca23: baseline-arm-clabbe 2026-04-06 03:19:27,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d08334d2be3e1cf2a5ca23 2026-04-06 03:19:27,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:19:27,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d08334d2be3e1cf2a5ca23 HTTP/1.1" 200 None 2026-04-06 03:19:27,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:19:27,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-06 03:19:27,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 03:19:27,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d08334d2be3e1cf2a5ca23 HTTP/1.1" 200 None 2026-04-06 03:19:27,757 - lava_callback - ERROR - Error processing callback for node 69d08334d2be3e1cf2a5ca23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET /node/6988c1089fc35f969e1edab3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34872 - "GET /node/698af3c53b3beb19e761696b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET /node/69562ef916d33f8361befc59%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48514 - "GET /node/69876b20e31b58f834f1978d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET /node/6981c883f633e773758fb9f8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /node/698403f2969566dcb0d2b8bf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38996 - "GET /node/694024c7575bc060ce153edc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET /node/6986fc1e6e077e4126a7d4fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET /node/698bd04c1e517752bab8ad99%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET /node/698af4c93b3beb19e7616b05%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56268 - "GET /node/69295cc3f7abe3da4c22a514%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET /node/693af8fdfee8383e92b6c789%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60354 - "GET /node/6985c41371989fb141498064%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET /node/69289178acdde99814a236bc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET /node/693b1b9415f407b7629e0273%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET /node/69296124f7abe3da4c22a96a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37396 - "GET /node/693af90afee8383e92b6c7b4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET /node/698a85afd9a1cfa777a23caa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET /node/693afc16fee8383e92b6d798%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41146 - "GET /node/6986162a177ca0f097bd08a9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET /node/69295cc3f7abe3da4c22a51a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET /node/6989360185773790cd34ca21%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44402 - "GET /node/6990b18cc45febfe44522ffe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET /node/699eb9238c247a4d4f281a5e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:45:28,387 - lava_callback - INFO - Received callback for node 69d0b377d2be3e1cf2a5cbb5 INFO: 172.21.0.1:45842 - "POST /node/69d0b377d2be3e1cf2a5cbb5 HTTP/1.0" 202 Accepted 2026-04-06 06:45:28,397 - lava_callback - INFO - Starting async job submit for node 69d0b377d2be3e1cf2a5cbb5 2026-04-06 06:45:28,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:28,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b377d2be3e1cf2a5cbb5 HTTP/1.1" 200 None 2026-04-06 06:45:28,426 - lava_callback - DEBUG - Processing node 69d0b377d2be3e1cf2a5cbb5: baseline-arm-baylibre 2026-04-06 06:45:28,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b377d2be3e1cf2a5cbb5 2026-04-06 06:45:28,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:28,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b377d2be3e1cf2a5cbb5 HTTP/1.1" 200 None 2026-04-06 06:45:28,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:28,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:45:28,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:28,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b377d2be3e1cf2a5cbb5 HTTP/1.1" 200 None 2026-04-06 06:45:28,482 - lava_callback - ERROR - Error processing callback for node 69d0b377d2be3e1cf2a5cbb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:45:48,400 - lava_callback - INFO - Received callback for node 69d0b39ad2be3e1cf2a5cbc6 INFO: 172.21.0.1:60778 - "POST /node/69d0b39ad2be3e1cf2a5cbc6 HTTP/1.0" 202 Accepted 2026-04-06 06:45:48,406 - lava_callback - INFO - Starting async job submit for node 69d0b39ad2be3e1cf2a5cbc6 2026-04-06 06:45:48,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:48,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b39ad2be3e1cf2a5cbc6 HTTP/1.1" 200 None 2026-04-06 06:45:48,422 - lava_callback - DEBUG - Processing node 69d0b39ad2be3e1cf2a5cbc6: baseline-arm-baylibre 2026-04-06 06:45:48,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b39ad2be3e1cf2a5cbc6 2026-04-06 06:45:48,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b39ad2be3e1cf2a5cbc6 HTTP/1.1" 200 None 2026-04-06 06:45:48,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:48,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:45:48,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:45:48,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b39ad2be3e1cf2a5cbc6 HTTP/1.1" 200 None 2026-04-06 06:45:48,478 - lava_callback - ERROR - Error processing callback for node 69d0b39ad2be3e1cf2a5cbc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET /node/695374fe31522df6df79e03e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:46:28,450 - lava_callback - INFO - Received callback for node 69d0b3bcd2be3e1cf2a5cbd5 INFO: 172.21.0.1:59806 - "POST /node/69d0b3bcd2be3e1cf2a5cbd5 HTTP/1.0" 202 Accepted 2026-04-06 06:46:28,455 - lava_callback - INFO - Starting async job submit for node 69d0b3bcd2be3e1cf2a5cbd5 2026-04-06 06:46:28,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:46:28,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b3bcd2be3e1cf2a5cbd5 HTTP/1.1" 200 None 2026-04-06 06:46:28,473 - lava_callback - DEBUG - Processing node 69d0b3bcd2be3e1cf2a5cbd5: baseline-arm-baylibre 2026-04-06 06:46:28,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b3bcd2be3e1cf2a5cbd5 2026-04-06 06:46:28,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:46:28,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b3bcd2be3e1cf2a5cbd5 HTTP/1.1" 200 None 2026-04-06 06:46:28,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:46:28,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:46:28,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:46:28,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b3bcd2be3e1cf2a5cbd5 HTTP/1.1" 200 None 2026-04-06 06:46:28,530 - lava_callback - ERROR - Error processing callback for node 69d0b3bcd2be3e1cf2a5cbd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39282 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:47:08,584 - lava_callback - INFO - Received callback for node 69d0b3e0d2be3e1cf2a5cbf0 INFO: 172.21.0.1:39286 - "POST /node/69d0b3e0d2be3e1cf2a5cbf0 HTTP/1.0" 202 Accepted 2026-04-06 06:47:08,589 - lava_callback - INFO - Starting async job submit for node 69d0b3e0d2be3e1cf2a5cbf0 2026-04-06 06:47:08,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:08,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b3e0d2be3e1cf2a5cbf0 HTTP/1.1" 200 None 2026-04-06 06:47:08,605 - lava_callback - DEBUG - Processing node 69d0b3e0d2be3e1cf2a5cbf0: baseline-arm-baylibre 2026-04-06 06:47:08,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b3e0d2be3e1cf2a5cbf0 2026-04-06 06:47:08,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:08,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b3e0d2be3e1cf2a5cbf0 HTTP/1.1" 200 None 2026-04-06 06:47:08,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:08,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:47:08,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:08,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b3e0d2be3e1cf2a5cbf0 HTTP/1.1" 200 None 2026-04-06 06:47:08,669 - lava_callback - ERROR - Error processing callback for node 69d0b3e0d2be3e1cf2a5cbf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET /node/694cfc331b4c04ddf7248c81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59000 - "GET /node/69903d63985e4efca431e2b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:47:48,520 - lava_callback - INFO - Received callback for node 69d0b404d2be3e1cf2a5cbfe INFO: 172.21.0.1:59026 - "POST /node/69d0b404d2be3e1cf2a5cbfe HTTP/1.0" 202 Accepted 2026-04-06 06:47:48,526 - lava_callback - INFO - Starting async job submit for node 69d0b404d2be3e1cf2a5cbfe 2026-04-06 06:47:48,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:48,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b404d2be3e1cf2a5cbfe HTTP/1.1" 200 None 2026-04-06 06:47:48,542 - lava_callback - DEBUG - Processing node 69d0b404d2be3e1cf2a5cbfe: baseline-arm-baylibre 2026-04-06 06:47:48,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b404d2be3e1cf2a5cbfe 2026-04-06 06:47:48,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:48,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b404d2be3e1cf2a5cbfe HTTP/1.1" 200 None 2026-04-06 06:47:48,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:48,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:47:48,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:47:48,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b404d2be3e1cf2a5cbfe HTTP/1.1" 200 None 2026-04-06 06:47:48,649 - lava_callback - ERROR - Error processing callback for node 69d0b404d2be3e1cf2a5cbfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:48:28,593 - lava_callback - INFO - Received callback for node 69d0b428d2be3e1cf2a5cc19 INFO: 172.21.0.1:42256 - "POST /node/69d0b428d2be3e1cf2a5cc19 HTTP/1.0" 202 Accepted 2026-04-06 06:48:28,598 - lava_callback - INFO - Starting async job submit for node 69d0b428d2be3e1cf2a5cc19 2026-04-06 06:48:28,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:48:28,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b428d2be3e1cf2a5cc19 HTTP/1.1" 200 None 2026-04-06 06:48:28,626 - lava_callback - DEBUG - Processing node 69d0b428d2be3e1cf2a5cc19: baseline-arm-baylibre 2026-04-06 06:48:28,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b428d2be3e1cf2a5cc19 2026-04-06 06:48:28,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:48:28,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b428d2be3e1cf2a5cc19 HTTP/1.1" 200 None 2026-04-06 06:48:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:48:28,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:48:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:48:28,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b428d2be3e1cf2a5cc19 HTTP/1.1" 200 None 2026-04-06 06:48:28,683 - lava_callback - ERROR - Error processing callback for node 69d0b428d2be3e1cf2a5cc19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET /node/694878599214b4938716930e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:49:57,465 - lava_callback - INFO - Received callback for node 69d0b48ed2be3e1cf2a5cc63 INFO: 172.21.0.1:60998 - "POST /node/69d0b48ed2be3e1cf2a5cc63 HTTP/1.0" 202 Accepted 2026-04-06 06:49:57,470 - lava_callback - INFO - Starting async job submit for node 69d0b48ed2be3e1cf2a5cc63 2026-04-06 06:49:57,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:49:57,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b48ed2be3e1cf2a5cc63 HTTP/1.1" 200 None 2026-04-06 06:49:57,487 - lava_callback - DEBUG - Processing node 69d0b48ed2be3e1cf2a5cc63: baseline-arm-clabbe 2026-04-06 06:49:57,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b48ed2be3e1cf2a5cc63 2026-04-06 06:49:57,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:49:57,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b48ed2be3e1cf2a5cc63 HTTP/1.1" 200 None 2026-04-06 06:49:57,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:49:57,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:49:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:49:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b48ed2be3e1cf2a5cc63 HTTP/1.1" 200 None 2026-04-06 06:49:57,544 - lava_callback - ERROR - Error processing callback for node 69d0b48ed2be3e1cf2a5cc63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET /node/693f8c2b0d8ce4018da97658%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38040 - "GET /node/6990b02dc45febfe44522a1f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:50:37,375 - lava_callback - INFO - Received callback for node 69d0b4b1d2be3e1cf2a5cc82 INFO: 172.21.0.1:56490 - "POST /node/69d0b4b1d2be3e1cf2a5cc82 HTTP/1.0" 202 Accepted 2026-04-06 06:50:37,381 - lava_callback - INFO - Starting async job submit for node 69d0b4b1d2be3e1cf2a5cc82 2026-04-06 06:50:37,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:50:37,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4b1d2be3e1cf2a5cc82 HTTP/1.1" 200 None 2026-04-06 06:50:37,403 - lava_callback - DEBUG - Processing node 69d0b4b1d2be3e1cf2a5cc82: baseline-arm-clabbe 2026-04-06 06:50:37,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b4b1d2be3e1cf2a5cc82 2026-04-06 06:50:37,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:50:37,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4b1d2be3e1cf2a5cc82 HTTP/1.1" 200 None 2026-04-06 06:50:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:50:37,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:50:37,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:50:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b4b1d2be3e1cf2a5cc82 HTTP/1.1" 200 None 2026-04-06 06:50:37,458 - lava_callback - ERROR - Error processing callback for node 69d0b4b1d2be3e1cf2a5cc82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:51:17,441 - lava_callback - INFO - Received callback for node 69d0b4cfd2be3e1cf2a5cc9c INFO: 172.21.0.1:33820 - "POST /node/69d0b4cfd2be3e1cf2a5cc9c HTTP/1.0" 202 Accepted 2026-04-06 06:51:17,446 - lava_callback - INFO - Starting async job submit for node 69d0b4cfd2be3e1cf2a5cc9c 2026-04-06 06:51:17,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4cfd2be3e1cf2a5cc9c HTTP/1.1" 200 None 2026-04-06 06:51:17,473 - lava_callback - DEBUG - Processing node 69d0b4cfd2be3e1cf2a5cc9c: baseline-arm-clabbe 2026-04-06 06:51:17,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b4cfd2be3e1cf2a5cc9c 2026-04-06 06:51:17,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4cfd2be3e1cf2a5cc9c HTTP/1.1" 200 None 2026-04-06 06:51:17,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:17,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:51:17,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:17,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b4cfd2be3e1cf2a5cc9c HTTP/1.1" 200 None 2026-04-06 06:51:17,523 - lava_callback - ERROR - Error processing callback for node 69d0b4cfd2be3e1cf2a5cc9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:51:37,432 - lava_callback - INFO - Received callback for node 69d0b4f0d2be3e1cf2a5ccc8 INFO: 172.21.0.1:38566 - "POST /node/69d0b4f0d2be3e1cf2a5ccc8 HTTP/1.0" 202 Accepted 2026-04-06 06:51:37,437 - lava_callback - INFO - Starting async job submit for node 69d0b4f0d2be3e1cf2a5ccc8 2026-04-06 06:51:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:37,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4f0d2be3e1cf2a5ccc8 HTTP/1.1" 200 None 2026-04-06 06:51:37,453 - lava_callback - DEBUG - Processing node 69d0b4f0d2be3e1cf2a5ccc8: baseline-arm-clabbe 2026-04-06 06:51:37,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b4f0d2be3e1cf2a5ccc8 2026-04-06 06:51:37,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:37,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b4f0d2be3e1cf2a5ccc8 HTTP/1.1" 200 None 2026-04-06 06:51:37,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:37,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:51:37,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:51:37,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b4f0d2be3e1cf2a5ccc8 HTTP/1.1" 200 None 2026-04-06 06:51:37,504 - lava_callback - ERROR - Error processing callback for node 69d0b4f0d2be3e1cf2a5ccc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:52:17,540 - lava_callback - INFO - Received callback for node 69d0b515d2be3e1cf2a5cced INFO: 172.21.0.1:38794 - "POST /node/69d0b515d2be3e1cf2a5cced HTTP/1.0" 202 Accepted 2026-04-06 06:52:17,545 - lava_callback - INFO - Starting async job submit for node 69d0b515d2be3e1cf2a5cced 2026-04-06 06:52:17,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:17,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b515d2be3e1cf2a5cced HTTP/1.1" 200 None 2026-04-06 06:52:17,568 - lava_callback - DEBUG - Processing node 69d0b515d2be3e1cf2a5cced: baseline-arm-clabbe 2026-04-06 06:52:17,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b515d2be3e1cf2a5cced 2026-04-06 06:52:17,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:17,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b515d2be3e1cf2a5cced HTTP/1.1" 200 None 2026-04-06 06:52:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:17,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:52:17,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:17,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b515d2be3e1cf2a5cced HTTP/1.1" 200 None 2026-04-06 06:52:17,622 - lava_callback - ERROR - Error processing callback for node 69d0b515d2be3e1cf2a5cced: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:52:37,463 - lava_callback - INFO - Received callback for node 69d0b533d2be3e1cf2a5cd1d INFO: 172.21.0.1:41732 - "POST /node/69d0b533d2be3e1cf2a5cd1d HTTP/1.0" 202 Accepted 2026-04-06 06:52:37,468 - lava_callback - INFO - Starting async job submit for node 69d0b533d2be3e1cf2a5cd1d 2026-04-06 06:52:37,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:37,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b533d2be3e1cf2a5cd1d HTTP/1.1" 200 None 2026-04-06 06:52:37,490 - lava_callback - DEBUG - Processing node 69d0b533d2be3e1cf2a5cd1d: baseline-arm-clabbe 2026-04-06 06:52:37,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b533d2be3e1cf2a5cd1d 2026-04-06 06:52:37,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:37,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b533d2be3e1cf2a5cd1d HTTP/1.1" 200 None 2026-04-06 06:52:37,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:37,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:52:37,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:52:37,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b533d2be3e1cf2a5cd1d HTTP/1.1" 200 None 2026-04-06 06:52:37,547 - lava_callback - ERROR - Error processing callback for node 69d0b533d2be3e1cf2a5cd1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46182 - "GET /node/69538fe30b0495cf59cc5788%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46198 - "GET /node/6927c9144e6fb3232e272a7e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53470 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:53:17,562 - lava_callback - INFO - Received callback for node 69d0b553d2be3e1cf2a5cd40 INFO: 172.21.0.1:53480 - "POST /node/69d0b553d2be3e1cf2a5cd40 HTTP/1.0" 202 Accepted 2026-04-06 06:53:17,568 - lava_callback - INFO - Starting async job submit for node 69d0b553d2be3e1cf2a5cd40 2026-04-06 06:53:17,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:17,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b553d2be3e1cf2a5cd40 HTTP/1.1" 200 None 2026-04-06 06:53:17,584 - lava_callback - DEBUG - Processing node 69d0b553d2be3e1cf2a5cd40: baseline-arm-clabbe 2026-04-06 06:53:17,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b553d2be3e1cf2a5cd40 2026-04-06 06:53:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:17,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b553d2be3e1cf2a5cd40 HTTP/1.1" 200 None 2026-04-06 06:53:17,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:17,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 06:53:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:17,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b553d2be3e1cf2a5cd40 HTTP/1.1" 200 None 2026-04-06 06:53:17,641 - lava_callback - ERROR - Error processing callback for node 69d0b553d2be3e1cf2a5cd40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:53:48,942 - lava_callback - INFO - Received callback for node 69d0b56cd2be3e1cf2a5cd4b INFO: 172.21.0.1:51180 - "POST /node/69d0b56cd2be3e1cf2a5cd4b HTTP/1.0" 202 Accepted 2026-04-06 06:53:48,947 - lava_callback - INFO - Starting async job submit for node 69d0b56cd2be3e1cf2a5cd4b 2026-04-06 06:53:48,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:48,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b56cd2be3e1cf2a5cd4b HTTP/1.1" 200 None 2026-04-06 06:53:48,964 - lava_callback - DEBUG - Processing node 69d0b56cd2be3e1cf2a5cd4b: baseline-arm-baylibre 2026-04-06 06:53:48,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b56cd2be3e1cf2a5cd4b 2026-04-06 06:53:48,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:48,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b56cd2be3e1cf2a5cd4b HTTP/1.1" 200 None 2026-04-06 06:53:48,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:48,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:53:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:53:49,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b56cd2be3e1cf2a5cd4b HTTP/1.1" 200 None 2026-04-06 06:53:49,020 - lava_callback - ERROR - Error processing callback for node 69d0b56cd2be3e1cf2a5cd4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:54:08,865 - lava_callback - INFO - Received callback for node 69d0b589d2be3e1cf2a5cd7a INFO: 172.21.0.1:38918 - "POST /node/69d0b589d2be3e1cf2a5cd7a HTTP/1.0" 202 Accepted 2026-04-06 06:54:08,871 - lava_callback - INFO - Starting async job submit for node 69d0b589d2be3e1cf2a5cd7a 2026-04-06 06:54:08,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:08,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b589d2be3e1cf2a5cd7a HTTP/1.1" 200 None 2026-04-06 06:54:08,887 - lava_callback - DEBUG - Processing node 69d0b589d2be3e1cf2a5cd7a: baseline-arm-baylibre 2026-04-06 06:54:08,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b589d2be3e1cf2a5cd7a 2026-04-06 06:54:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:08,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b589d2be3e1cf2a5cd7a HTTP/1.1" 200 None 2026-04-06 06:54:08,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:08,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:54:08,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:08,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b589d2be3e1cf2a5cd7a HTTP/1.1" 200 None 2026-04-06 06:54:08,947 - lava_callback - ERROR - Error processing callback for node 69d0b589d2be3e1cf2a5cd7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:54:48,937 - lava_callback - INFO - Received callback for node 69d0b5acd2be3e1cf2a5cdba INFO: 172.21.0.1:34080 - "POST /node/69d0b5acd2be3e1cf2a5cdba HTTP/1.0" 202 Accepted 2026-04-06 06:54:48,943 - lava_callback - INFO - Starting async job submit for node 69d0b5acd2be3e1cf2a5cdba 2026-04-06 06:54:48,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:48,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5acd2be3e1cf2a5cdba HTTP/1.1" 200 None 2026-04-06 06:54:48,958 - lava_callback - DEBUG - Processing node 69d0b5acd2be3e1cf2a5cdba: baseline-arm-baylibre 2026-04-06 06:54:48,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b5acd2be3e1cf2a5cdba 2026-04-06 06:54:48,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:48,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5acd2be3e1cf2a5cdba HTTP/1.1" 200 None 2026-04-06 06:54:48,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:54:48,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:54:49,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b5acd2be3e1cf2a5cdba HTTP/1.1" 200 None 2026-04-06 06:54:49,009 - lava_callback - ERROR - Error processing callback for node 69d0b5acd2be3e1cf2a5cdba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:55:28,972 - lava_callback - INFO - Received callback for node 69d0b5d0d2be3e1cf2a5cdd1 INFO: 172.21.0.1:34994 - "POST /node/69d0b5d0d2be3e1cf2a5cdd1 HTTP/1.0" 202 Accepted 2026-04-06 06:55:28,978 - lava_callback - INFO - Starting async job submit for node 69d0b5d0d2be3e1cf2a5cdd1 2026-04-06 06:55:28,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:28,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5d0d2be3e1cf2a5cdd1 HTTP/1.1" 200 None 2026-04-06 06:55:29,000 - lava_callback - DEBUG - Processing node 69d0b5d0d2be3e1cf2a5cdd1: baseline-arm-baylibre 2026-04-06 06:55:29,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b5d0d2be3e1cf2a5cdd1 2026-04-06 06:55:29,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:29,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5d0d2be3e1cf2a5cdd1 HTTP/1.1" 200 None 2026-04-06 06:55:29,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:29,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:55:29,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:29,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b5d0d2be3e1cf2a5cdd1 HTTP/1.1" 200 None 2026-04-06 06:55:29,065 - lava_callback - ERROR - Error processing callback for node 69d0b5d0d2be3e1cf2a5cdd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:55:48,983 - lava_callback - INFO - Received callback for node 69d0b5edd2be3e1cf2a5ce03 INFO: 172.21.0.1:45282 - "POST /node/69d0b5edd2be3e1cf2a5ce03 HTTP/1.0" 202 Accepted 2026-04-06 06:55:48,989 - lava_callback - INFO - Starting async job submit for node 69d0b5edd2be3e1cf2a5ce03 2026-04-06 06:55:48,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:49,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5edd2be3e1cf2a5ce03 HTTP/1.1" 200 None 2026-04-06 06:55:49,007 - lava_callback - DEBUG - Processing node 69d0b5edd2be3e1cf2a5ce03: baseline-arm-baylibre 2026-04-06 06:55:49,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b5edd2be3e1cf2a5ce03 2026-04-06 06:55:49,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:49,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b5edd2be3e1cf2a5ce03 HTTP/1.1" 200 None 2026-04-06 06:55:49,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:49,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:55:49,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:55:49,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b5edd2be3e1cf2a5ce03 HTTP/1.1" 200 None 2026-04-06 06:55:49,089 - lava_callback - ERROR - Error processing callback for node 69d0b5edd2be3e1cf2a5ce03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:56:29,021 - lava_callback - INFO - Received callback for node 69d0b60ed2be3e1cf2a5ce2d INFO: 172.21.0.1:46544 - "POST /node/69d0b60ed2be3e1cf2a5ce2d HTTP/1.0" 202 Accepted 2026-04-06 06:56:29,030 - lava_callback - INFO - Starting async job submit for node 69d0b60ed2be3e1cf2a5ce2d 2026-04-06 06:56:29,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:29,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b60ed2be3e1cf2a5ce2d HTTP/1.1" 200 None 2026-04-06 06:56:29,047 - lava_callback - DEBUG - Processing node 69d0b60ed2be3e1cf2a5ce2d: baseline-arm-baylibre 2026-04-06 06:56:29,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b60ed2be3e1cf2a5ce2d 2026-04-06 06:56:29,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b60ed2be3e1cf2a5ce2d HTTP/1.1" 200 None 2026-04-06 06:56:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:29,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:56:29,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:29,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b60ed2be3e1cf2a5ce2d HTTP/1.1" 200 None 2026-04-06 06:56:29,110 - lava_callback - ERROR - Error processing callback for node 69d0b60ed2be3e1cf2a5ce2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET /node/69876b98e31b58f834f19833%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 06:56:49,070 - lava_callback - INFO - Received callback for node 69d0b62ed2be3e1cf2a5ce4b INFO: 172.21.0.1:51566 - "POST /node/69d0b62ed2be3e1cf2a5ce4b HTTP/1.0" 202 Accepted 2026-04-06 06:56:49,079 - lava_callback - INFO - Starting async job submit for node 69d0b62ed2be3e1cf2a5ce4b 2026-04-06 06:56:49,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:49,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b62ed2be3e1cf2a5ce4b HTTP/1.1" 200 None 2026-04-06 06:56:49,096 - lava_callback - DEBUG - Processing node 69d0b62ed2be3e1cf2a5ce4b: baseline-arm-baylibre 2026-04-06 06:56:49,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b62ed2be3e1cf2a5ce4b 2026-04-06 06:56:49,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:49,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b62ed2be3e1cf2a5ce4b HTTP/1.1" 200 None 2026-04-06 06:56:49,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:49,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:56:49,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:56:49,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b62ed2be3e1cf2a5ce4b HTTP/1.1" 200 None 2026-04-06 06:56:49,157 - lava_callback - ERROR - Error processing callback for node 69d0b62ed2be3e1cf2a5ce4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51572 - "GET /node/693f80780d8ce4018da9665c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET /node/694a3a212060d3d84792262e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60682 - "GET /node/693fcba0575bc060ce14a75a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:57:37,754 - lava_callback - INFO - Received callback for node 69d0b654d2be3e1cf2a5ce82 INFO: 172.21.0.1:60702 - "POST /node/69d0b654d2be3e1cf2a5ce82 HTTP/1.0" 202 Accepted 2026-04-06 06:57:37,760 - lava_callback - INFO - Starting async job submit for node 69d0b654d2be3e1cf2a5ce82 2026-04-06 06:57:37,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:57:37,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b654d2be3e1cf2a5ce82 HTTP/1.1" 200 None 2026-04-06 06:57:37,777 - lava_callback - DEBUG - Processing node 69d0b654d2be3e1cf2a5ce82: baseline-arm-clabbe 2026-04-06 06:57:37,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b654d2be3e1cf2a5ce82 2026-04-06 06:57:37,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:57:37,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b654d2be3e1cf2a5ce82 HTTP/1.1" 200 None 2026-04-06 06:57:37,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:57:37,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:57:37,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:57:37,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b654d2be3e1cf2a5ce82 HTTP/1.1" 200 None 2026-04-06 06:57:37,837 - lava_callback - ERROR - Error processing callback for node 69d0b654d2be3e1cf2a5ce82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:58:17,699 - lava_callback - INFO - Received callback for node 69d0b676d2be3e1cf2a5ce99 INFO: 172.21.0.1:50160 - "POST /node/69d0b676d2be3e1cf2a5ce99 HTTP/1.0" 202 Accepted 2026-04-06 06:58:17,704 - lava_callback - INFO - Starting async job submit for node 69d0b676d2be3e1cf2a5ce99 2026-04-06 06:58:17,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:17,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b676d2be3e1cf2a5ce99 HTTP/1.1" 200 None 2026-04-06 06:58:17,720 - lava_callback - DEBUG - Processing node 69d0b676d2be3e1cf2a5ce99: baseline-arm-clabbe 2026-04-06 06:58:17,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b676d2be3e1cf2a5ce99 2026-04-06 06:58:17,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:17,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b676d2be3e1cf2a5ce99 HTTP/1.1" 200 None 2026-04-06 06:58:17,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:17,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:58:17,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:17,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b676d2be3e1cf2a5ce99 HTTP/1.1" 200 None 2026-04-06 06:58:17,782 - lava_callback - ERROR - Error processing callback for node 69d0b676d2be3e1cf2a5ce99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:58:49,230 - lava_callback - INFO - Received callback for node 69d0b694d2be3e1cf2a5ceb7 INFO: 172.21.0.1:33454 - "POST /node/69d0b694d2be3e1cf2a5ceb7 HTTP/1.0" 202 Accepted 2026-04-06 06:58:49,236 - lava_callback - INFO - Starting async job submit for node 69d0b694d2be3e1cf2a5ceb7 2026-04-06 06:58:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:49,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b694d2be3e1cf2a5ceb7 HTTP/1.1" 200 None 2026-04-06 06:58:49,254 - lava_callback - DEBUG - Processing node 69d0b694d2be3e1cf2a5ceb7: baseline-arm-baylibre 2026-04-06 06:58:49,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b694d2be3e1cf2a5ceb7 2026-04-06 06:58:49,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:49,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b694d2be3e1cf2a5ceb7 HTTP/1.1" 200 None 2026-04-06 06:58:49,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:49,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:58:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:58:49,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b694d2be3e1cf2a5ceb7 HTTP/1.1" 200 None 2026-04-06 06:58:49,316 - lava_callback - ERROR - Error processing callback for node 69d0b694d2be3e1cf2a5ceb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:59:09,133 - lava_callback - INFO - Received callback for node 69d0b6b2d2be3e1cf2a5cecd INFO: 172.21.0.1:38462 - "POST /node/69d0b6b2d2be3e1cf2a5cecd HTTP/1.0" 202 Accepted 2026-04-06 06:59:09,138 - lava_callback - INFO - Starting async job submit for node 69d0b6b2d2be3e1cf2a5cecd 2026-04-06 06:59:09,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:09,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6b2d2be3e1cf2a5cecd HTTP/1.1" 200 None 2026-04-06 06:59:09,154 - lava_callback - DEBUG - Processing node 69d0b6b2d2be3e1cf2a5cecd: baseline-arm-baylibre 2026-04-06 06:59:09,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b6b2d2be3e1cf2a5cecd 2026-04-06 06:59:09,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:09,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6b2d2be3e1cf2a5cecd HTTP/1.1" 200 None 2026-04-06 06:59:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:09,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:59:09,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:09,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b6b2d2be3e1cf2a5cecd HTTP/1.1" 200 None 2026-04-06 06:59:09,220 - lava_callback - ERROR - Error processing callback for node 69d0b6b2d2be3e1cf2a5cecd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK 2026-04-06 06:59:37,753 - lava_callback - INFO - Received callback for node 69d0b6d4d2be3e1cf2a5cef9 INFO: 172.21.0.1:47184 - "POST /node/69d0b6d4d2be3e1cf2a5cef9 HTTP/1.0" 202 Accepted 2026-04-06 06:59:37,762 - lava_callback - INFO - Starting async job submit for node 69d0b6d4d2be3e1cf2a5cef9 2026-04-06 06:59:37,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:37,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6d4d2be3e1cf2a5cef9 HTTP/1.1" 200 None 2026-04-06 06:59:37,785 - lava_callback - DEBUG - Processing node 69d0b6d4d2be3e1cf2a5cef9: baseline-arm-clabbe 2026-04-06 06:59:37,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b6d4d2be3e1cf2a5cef9 2026-04-06 06:59:37,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:37,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6d4d2be3e1cf2a5cef9 HTTP/1.1" 200 None 2026-04-06 06:59:37,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:37,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 06:59:37,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 06:59:37,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b6d4d2be3e1cf2a5cef9 HTTP/1.1" 200 None 2026-04-06 06:59:37,852 - lava_callback - ERROR - Error processing callback for node 69d0b6d4d2be3e1cf2a5cef9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48566 - "GET /node/69485a9b9214b49387168778%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48568 - "GET /node/6992688a98a8bdb31c39221f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:00:09,282 - lava_callback - INFO - Received callback for node 69d0b6f4d2be3e1cf2a5cf26 INFO: 172.21.0.1:55948 - "POST /node/69d0b6f4d2be3e1cf2a5cf26 HTTP/1.0" 202 Accepted 2026-04-06 07:00:09,289 - lava_callback - INFO - Starting async job submit for node 69d0b6f4d2be3e1cf2a5cf26 2026-04-06 07:00:09,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:09,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6f4d2be3e1cf2a5cf26 HTTP/1.1" 200 None 2026-04-06 07:00:09,306 - lava_callback - DEBUG - Processing node 69d0b6f4d2be3e1cf2a5cf26: baseline-arm-baylibre 2026-04-06 07:00:09,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b6f4d2be3e1cf2a5cf26 2026-04-06 07:00:09,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:09,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b6f4d2be3e1cf2a5cf26 HTTP/1.1" 200 None 2026-04-06 07:00:09,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:09,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:00:09,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:09,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b6f4d2be3e1cf2a5cf26 HTTP/1.1" 200 None 2026-04-06 07:00:09,421 - lava_callback - ERROR - Error processing callback for node 69d0b6f4d2be3e1cf2a5cf26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:00:57,898 - lava_callback - INFO - Received callback for node 69d0b717d2be3e1cf2a5cf64 INFO: 172.21.0.1:34814 - "POST /node/69d0b717d2be3e1cf2a5cf64 HTTP/1.0" 202 Accepted 2026-04-06 07:00:57,907 - lava_callback - INFO - Starting async job submit for node 69d0b717d2be3e1cf2a5cf64 2026-04-06 07:00:57,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:57,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b717d2be3e1cf2a5cf64 HTTP/1.1" 200 None 2026-04-06 07:00:57,929 - lava_callback - DEBUG - Processing node 69d0b717d2be3e1cf2a5cf64: baseline-arm-clabbe 2026-04-06 07:00:57,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b717d2be3e1cf2a5cf64 2026-04-06 07:00:57,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:57,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b717d2be3e1cf2a5cf64 HTTP/1.1" 200 None 2026-04-06 07:00:57,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:57,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:00:57,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:00:57,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b717d2be3e1cf2a5cf64 HTTP/1.1" 200 None 2026-04-06 07:00:57,999 - lava_callback - ERROR - Error processing callback for node 69d0b717d2be3e1cf2a5cf64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:01:17,817 - lava_callback - INFO - Received callback for node 69d0b73ad2be3e1cf2a5cf78 INFO: 172.21.0.1:42278 - "POST /node/69d0b73ad2be3e1cf2a5cf78 HTTP/1.0" 202 Accepted 2026-04-06 07:01:17,826 - lava_callback - INFO - Starting async job submit for node 69d0b73ad2be3e1cf2a5cf78 2026-04-06 07:01:17,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:17,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b73ad2be3e1cf2a5cf78 HTTP/1.1" 200 None 2026-04-06 07:01:17,848 - lava_callback - DEBUG - Processing node 69d0b73ad2be3e1cf2a5cf78: baseline-arm-clabbe 2026-04-06 07:01:17,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b73ad2be3e1cf2a5cf78 2026-04-06 07:01:17,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:17,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b73ad2be3e1cf2a5cf78 HTTP/1.1" 200 None 2026-04-06 07:01:17,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:17,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:01:17,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:17,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b73ad2be3e1cf2a5cf78 HTTP/1.1" 200 None 2026-04-06 07:01:17,914 - lava_callback - ERROR - Error processing callback for node 69d0b73ad2be3e1cf2a5cf78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET /node/69942c5e5ae459b9df3d103a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53872 - "GET /node/6985c4bb71989fb141498085%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:01:49,366 - lava_callback - INFO - Received callback for node 69d0b75bd2be3e1cf2a5cf94 INFO: 172.21.0.1:43926 - "POST /node/69d0b75bd2be3e1cf2a5cf94 HTTP/1.0" 202 Accepted 2026-04-06 07:01:49,376 - lava_callback - INFO - Starting async job submit for node 69d0b75bd2be3e1cf2a5cf94 2026-04-06 07:01:49,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:49,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b75bd2be3e1cf2a5cf94 HTTP/1.1" 200 None 2026-04-06 07:01:49,399 - lava_callback - DEBUG - Processing node 69d0b75bd2be3e1cf2a5cf94: baseline-arm-baylibre 2026-04-06 07:01:49,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b75bd2be3e1cf2a5cf94 2026-04-06 07:01:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:49,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b75bd2be3e1cf2a5cf94 HTTP/1.1" 200 None 2026-04-06 07:01:49,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:49,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:01:49,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:01:49,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b75bd2be3e1cf2a5cf94 HTTP/1.1" 200 None 2026-04-06 07:01:49,480 - lava_callback - ERROR - Error processing callback for node 69d0b75bd2be3e1cf2a5cf94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:02:29,309 - lava_callback - INFO - Received callback for node 69d0b77ed2be3e1cf2a5cfa8 INFO: 172.21.0.1:36536 - "POST /node/69d0b77ed2be3e1cf2a5cfa8 HTTP/1.0" 202 Accepted 2026-04-06 07:02:29,314 - lava_callback - INFO - Starting async job submit for node 69d0b77ed2be3e1cf2a5cfa8 2026-04-06 07:02:29,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:02:29,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b77ed2be3e1cf2a5cfa8 HTTP/1.1" 200 None 2026-04-06 07:02:29,331 - lava_callback - DEBUG - Processing node 69d0b77ed2be3e1cf2a5cfa8: baseline-arm-baylibre 2026-04-06 07:02:29,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b77ed2be3e1cf2a5cfa8 2026-04-06 07:02:29,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:02:29,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b77ed2be3e1cf2a5cfa8 HTTP/1.1" 200 None 2026-04-06 07:02:29,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:02:29,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:02:29,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:02:29,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b77ed2be3e1cf2a5cfa8 HTTP/1.1" 200 None 2026-04-06 07:02:29,400 - lava_callback - ERROR - Error processing callback for node 69d0b77ed2be3e1cf2a5cfa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET /node/6990a625c45febfe445208e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42644 - "GET /node/6984605f3a8748f28208642a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:03:17,990 - lava_callback - INFO - Received callback for node 69d0b7a3d2be3e1cf2a5cfb5 INFO: 172.21.0.1:33870 - "POST /node/69d0b7a3d2be3e1cf2a5cfb5 HTTP/1.0" 202 Accepted 2026-04-06 07:03:17,995 - lava_callback - INFO - Starting async job submit for node 69d0b7a3d2be3e1cf2a5cfb5 2026-04-06 07:03:17,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:18,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b7a3d2be3e1cf2a5cfb5 HTTP/1.1" 200 None 2026-04-06 07:03:18,012 - lava_callback - DEBUG - Processing node 69d0b7a3d2be3e1cf2a5cfb5: baseline-arm-clabbe 2026-04-06 07:03:18,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b7a3d2be3e1cf2a5cfb5 2026-04-06 07:03:18,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:18,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b7a3d2be3e1cf2a5cfb5 HTTP/1.1" 200 None 2026-04-06 07:03:18,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:18,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:03:18,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:18,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b7a3d2be3e1cf2a5cfb5 HTTP/1.1" 200 None 2026-04-06 07:03:18,069 - lava_callback - ERROR - Error processing callback for node 69d0b7a3d2be3e1cf2a5cfb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:03:37,954 - lava_callback - INFO - Received callback for node 69d0b7c4d2be3e1cf2a5cfd6 INFO: 172.21.0.1:58684 - "POST /node/69d0b7c4d2be3e1cf2a5cfd6 HTTP/1.0" 202 Accepted 2026-04-06 07:03:37,960 - lava_callback - INFO - Starting async job submit for node 69d0b7c4d2be3e1cf2a5cfd6 2026-04-06 07:03:37,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b7c4d2be3e1cf2a5cfd6 HTTP/1.1" 200 None 2026-04-06 07:03:37,975 - lava_callback - DEBUG - Processing node 69d0b7c4d2be3e1cf2a5cfd6: baseline-arm-clabbe 2026-04-06 07:03:37,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b7c4d2be3e1cf2a5cfd6 2026-04-06 07:03:37,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:37,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b7c4d2be3e1cf2a5cfd6 HTTP/1.1" 200 None 2026-04-06 07:03:37,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:38,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:03:38,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:03:38,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b7c4d2be3e1cf2a5cfd6 HTTP/1.1" 200 None 2026-04-06 07:03:38,027 - lava_callback - ERROR - Error processing callback for node 69d0b7c4d2be3e1cf2a5cfd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET /node/698704006e077e4126a7e5de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36848 - "GET /node/69a0078262feda9f0694ec72%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET /node/69371e4a93bfb52307cd3c25%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51446 - "GET /node/6910d14b699dbc4cda8e3863%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET /node/6946ed383daac48063595d7d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34788 - "GET /node/694845dc9214b49387167a72%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:53102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:08:38,197 - lava_callback - INFO - Received callback for node 69d0b8f0d2be3e1cf2a5d119 INFO: 172.21.0.1:39106 - "POST /node/69d0b8f0d2be3e1cf2a5d119 HTTP/1.0" 202 Accepted 2026-04-06 07:08:38,203 - lava_callback - INFO - Starting async job submit for node 69d0b8f0d2be3e1cf2a5d119 2026-04-06 07:08:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:08:38,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b8f0d2be3e1cf2a5d119 HTTP/1.1" 200 None 2026-04-06 07:08:38,221 - lava_callback - DEBUG - Processing node 69d0b8f0d2be3e1cf2a5d119: baseline-arm-clabbe 2026-04-06 07:08:38,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b8f0d2be3e1cf2a5d119 2026-04-06 07:08:38,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:08:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b8f0d2be3e1cf2a5d119 HTTP/1.1" 200 None 2026-04-06 07:08:38,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:08:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:08:38,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:08:38,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b8f0d2be3e1cf2a5d119 HTTP/1.1" 200 None 2026-04-06 07:08:38,273 - lava_callback - ERROR - Error processing callback for node 69d0b8f0d2be3e1cf2a5d119: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:09:30,057 - lava_callback - INFO - Received callback for node 69d0b917d2be3e1cf2a5d136 INFO: 172.21.0.1:47184 - "POST /node/69d0b917d2be3e1cf2a5d136 HTTP/1.0" 202 Accepted 2026-04-06 07:09:30,063 - lava_callback - INFO - Starting async job submit for node 69d0b917d2be3e1cf2a5d136 2026-04-06 07:09:30,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:09:30,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b917d2be3e1cf2a5d136 HTTP/1.1" 200 None 2026-04-06 07:09:30,080 - lava_callback - DEBUG - Processing node 69d0b917d2be3e1cf2a5d136: baseline-arm64-baylibre 2026-04-06 07:09:30,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b917d2be3e1cf2a5d136 2026-04-06 07:09:30,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:09:30,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b917d2be3e1cf2a5d136 HTTP/1.1" 200 None 2026-04-06 07:09:30,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:09:30,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:09:30,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:09:30,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b917d2be3e1cf2a5d136 HTTP/1.1" 200 None 2026-04-06 07:09:30,153 - lava_callback - ERROR - Error processing callback for node 69d0b917d2be3e1cf2a5d136: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:10:29,735 - lava_callback - INFO - Received callback for node 69d0b95dd2be3e1cf2a5d16c INFO: 172.21.0.1:43134 - "POST /node/69d0b95dd2be3e1cf2a5d16c HTTP/1.0" 202 Accepted 2026-04-06 07:10:29,740 - lava_callback - INFO - Starting async job submit for node 69d0b95dd2be3e1cf2a5d16c 2026-04-06 07:10:29,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:10:29,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b95dd2be3e1cf2a5d16c HTTP/1.1" 200 None 2026-04-06 07:10:29,758 - lava_callback - DEBUG - Processing node 69d0b95dd2be3e1cf2a5d16c: baseline-arm64-baylibre 2026-04-06 07:10:29,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b95dd2be3e1cf2a5d16c 2026-04-06 07:10:29,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:10:29,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b95dd2be3e1cf2a5d16c HTTP/1.1" 200 None 2026-04-06 07:10:29,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:10:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:10:29,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:10:29,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b95dd2be3e1cf2a5d16c HTTP/1.1" 200 None 2026-04-06 07:10:29,828 - lava_callback - ERROR - Error processing callback for node 69d0b95dd2be3e1cf2a5d16c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:11:50,103 - lava_callback - INFO - Received callback for node 69d0b9a3d2be3e1cf2a5d188 INFO: 172.21.0.1:45100 - "POST /node/69d0b9a3d2be3e1cf2a5d188 HTTP/1.0" 202 Accepted 2026-04-06 07:11:50,110 - lava_callback - INFO - Starting async job submit for node 69d0b9a3d2be3e1cf2a5d188 2026-04-06 07:11:50,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:11:50,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b9a3d2be3e1cf2a5d188 HTTP/1.1" 200 None 2026-04-06 07:11:50,126 - lava_callback - DEBUG - Processing node 69d0b9a3d2be3e1cf2a5d188: baseline-arm64-baylibre 2026-04-06 07:11:50,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b9a3d2be3e1cf2a5d188 2026-04-06 07:11:50,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:11:50,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b9a3d2be3e1cf2a5d188 HTTP/1.1" 200 None 2026-04-06 07:11:50,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:11:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:11:50,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:11:50,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b9a3d2be3e1cf2a5d188 HTTP/1.1" 200 None 2026-04-06 07:11:50,198 - lava_callback - ERROR - Error processing callback for node 69d0b9a3d2be3e1cf2a5d188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:12:49,899 - lava_callback - INFO - Received callback for node 69d0b9ead2be3e1cf2a5d1c8 INFO: 172.21.0.1:51986 - "POST /node/69d0b9ead2be3e1cf2a5d1c8 HTTP/1.0" 202 Accepted 2026-04-06 07:12:49,905 - lava_callback - INFO - Starting async job submit for node 69d0b9ead2be3e1cf2a5d1c8 2026-04-06 07:12:49,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:12:49,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b9ead2be3e1cf2a5d1c8 HTTP/1.1" 200 None 2026-04-06 07:12:49,921 - lava_callback - DEBUG - Processing node 69d0b9ead2be3e1cf2a5d1c8: baseline-arm64-baylibre 2026-04-06 07:12:49,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0b9ead2be3e1cf2a5d1c8 2026-04-06 07:12:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:12:49,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0b9ead2be3e1cf2a5d1c8 HTTP/1.1" 200 None 2026-04-06 07:12:49,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:12:49,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:12:49,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:12:49,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0b9ead2be3e1cf2a5d1c8 HTTP/1.1" 200 None 2026-04-06 07:12:49,983 - lava_callback - ERROR - Error processing callback for node 69d0b9ead2be3e1cf2a5d1c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:13:49,990 - lava_callback - INFO - Received callback for node 69d0ba2cd2be3e1cf2a5d205 INFO: 172.21.0.1:58812 - "POST /node/69d0ba2cd2be3e1cf2a5d205 HTTP/1.0" 202 Accepted 2026-04-06 07:13:49,998 - lava_callback - INFO - Starting async job submit for node 69d0ba2cd2be3e1cf2a5d205 2026-04-06 07:13:50,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:13:50,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba2cd2be3e1cf2a5d205 HTTP/1.1" 200 None 2026-04-06 07:13:50,024 - lava_callback - DEBUG - Processing node 69d0ba2cd2be3e1cf2a5d205: baseline-arm64-baylibre 2026-04-06 07:13:50,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ba2cd2be3e1cf2a5d205 2026-04-06 07:13:50,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:13:50,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba2cd2be3e1cf2a5d205 HTTP/1.1" 200 None 2026-04-06 07:13:50,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:13:50,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:13:50,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:13:50,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ba2cd2be3e1cf2a5d205 HTTP/1.1" 200 None 2026-04-06 07:13:50,104 - lava_callback - ERROR - Error processing callback for node 69d0ba2cd2be3e1cf2a5d205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38738 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:14:58,451 - lava_callback - INFO - Received callback for node 69d0ba69d2be3e1cf2a5d229 INFO: 172.21.0.1:38748 - "POST /node/69d0ba69d2be3e1cf2a5d229 HTTP/1.0" 202 Accepted 2026-04-06 07:14:58,456 - lava_callback - INFO - Starting async job submit for node 69d0ba69d2be3e1cf2a5d229 2026-04-06 07:14:58,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:14:58,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba69d2be3e1cf2a5d229 HTTP/1.1" 200 None 2026-04-06 07:14:58,472 - lava_callback - DEBUG - Processing node 69d0ba69d2be3e1cf2a5d229: baseline-arm-clabbe 2026-04-06 07:14:58,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ba69d2be3e1cf2a5d229 2026-04-06 07:14:58,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:14:58,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba69d2be3e1cf2a5d229 HTTP/1.1" 200 None 2026-04-06 07:14:58,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:14:58,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:14:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:14:58,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ba69d2be3e1cf2a5d229 HTTP/1.1" 200 None 2026-04-06 07:14:58,529 - lava_callback - ERROR - Error processing callback for node 69d0ba69d2be3e1cf2a5d229: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:15:58,534 - lava_callback - INFO - Received callback for node 69d0ba9ad2be3e1cf2a5d23c INFO: 172.21.0.1:43190 - "POST /node/69d0ba9ad2be3e1cf2a5d23c HTTP/1.0" 202 Accepted 2026-04-06 07:15:58,541 - lava_callback - INFO - Starting async job submit for node 69d0ba9ad2be3e1cf2a5d23c 2026-04-06 07:15:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:15:58,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba9ad2be3e1cf2a5d23c HTTP/1.1" 200 None 2026-04-06 07:15:58,566 - lava_callback - DEBUG - Processing node 69d0ba9ad2be3e1cf2a5d23c: baseline-arm64-clabbe 2026-04-06 07:15:58,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ba9ad2be3e1cf2a5d23c 2026-04-06 07:15:58,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:15:58,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ba9ad2be3e1cf2a5d23c HTTP/1.1" 200 None 2026-04-06 07:15:58,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:15:58,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:15:58,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:15:58,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ba9ad2be3e1cf2a5d23c HTTP/1.1" 200 None 2026-04-06 07:15:58,621 - lava_callback - ERROR - Error processing callback for node 69d0ba9ad2be3e1cf2a5d23c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:16:58,533 - lava_callback - INFO - Received callback for node 69d0baded2be3e1cf2a5d27a INFO: 172.21.0.1:56730 - "POST /node/69d0baded2be3e1cf2a5d27a HTTP/1.0" 202 Accepted 2026-04-06 07:16:58,541 - lava_callback - INFO - Starting async job submit for node 69d0baded2be3e1cf2a5d27a 2026-04-06 07:16:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:16:58,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0baded2be3e1cf2a5d27a HTTP/1.1" 200 None 2026-04-06 07:16:58,561 - lava_callback - DEBUG - Processing node 69d0baded2be3e1cf2a5d27a: baseline-arm64-clabbe 2026-04-06 07:16:58,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0baded2be3e1cf2a5d27a 2026-04-06 07:16:58,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:16:58,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0baded2be3e1cf2a5d27a HTTP/1.1" 200 None 2026-04-06 07:16:58,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:16:58,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:16:58,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:16:58,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0baded2be3e1cf2a5d27a HTTP/1.1" 200 None 2026-04-06 07:16:58,616 - lava_callback - ERROR - Error processing callback for node 69d0baded2be3e1cf2a5d27a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49268 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:17:58,609 - lava_callback - INFO - Received callback for node 69d0bb23d2be3e1cf2a5d29d INFO: 172.21.0.1:49274 - "POST /node/69d0bb23d2be3e1cf2a5d29d HTTP/1.0" 202 Accepted 2026-04-06 07:17:58,614 - lava_callback - INFO - Starting async job submit for node 69d0bb23d2be3e1cf2a5d29d 2026-04-06 07:17:58,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:17:58,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bb23d2be3e1cf2a5d29d HTTP/1.1" 200 None 2026-04-06 07:17:58,643 - lava_callback - DEBUG - Processing node 69d0bb23d2be3e1cf2a5d29d: baseline-arm64-clabbe 2026-04-06 07:17:58,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bb23d2be3e1cf2a5d29d 2026-04-06 07:17:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:17:58,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bb23d2be3e1cf2a5d29d HTTP/1.1" 200 None 2026-04-06 07:17:58,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:17:58,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:17:58,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:17:58,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bb23d2be3e1cf2a5d29d HTTP/1.1" 200 None 2026-04-06 07:17:58,701 - lava_callback - ERROR - Error processing callback for node 69d0bb23d2be3e1cf2a5d29d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:19:18,631 - lava_callback - INFO - Received callback for node 69d0bb67d2be3e1cf2a5d2cc INFO: 172.21.0.1:59158 - "POST /node/69d0bb67d2be3e1cf2a5d2cc HTTP/1.0" 202 Accepted 2026-04-06 07:19:18,637 - lava_callback - INFO - Starting async job submit for node 69d0bb67d2be3e1cf2a5d2cc 2026-04-06 07:19:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:19:18,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bb67d2be3e1cf2a5d2cc HTTP/1.1" 200 None 2026-04-06 07:19:18,654 - lava_callback - DEBUG - Processing node 69d0bb67d2be3e1cf2a5d2cc: baseline-arm64-clabbe 2026-04-06 07:19:18,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bb67d2be3e1cf2a5d2cc 2026-04-06 07:19:18,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:19:18,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bb67d2be3e1cf2a5d2cc HTTP/1.1" 200 None 2026-04-06 07:19:18,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:19:18,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:19:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:19:18,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bb67d2be3e1cf2a5d2cc HTTP/1.1" 200 None 2026-04-06 07:19:18,733 - lava_callback - ERROR - Error processing callback for node 69d0bb67d2be3e1cf2a5d2cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:20:18,750 - lava_callback - INFO - Received callback for node 69d0bbacd2be3e1cf2a5d315 INFO: 172.21.0.1:51740 - "POST /node/69d0bbacd2be3e1cf2a5d315 HTTP/1.0" 202 Accepted 2026-04-06 07:20:18,756 - lava_callback - INFO - Starting async job submit for node 69d0bbacd2be3e1cf2a5d315 2026-04-06 07:20:18,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:20:18,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bbacd2be3e1cf2a5d315 HTTP/1.1" 200 None 2026-04-06 07:20:18,774 - lava_callback - DEBUG - Processing node 69d0bbacd2be3e1cf2a5d315: baseline-arm64-clabbe 2026-04-06 07:20:18,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bbacd2be3e1cf2a5d315 2026-04-06 07:20:18,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:20:18,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bbacd2be3e1cf2a5d315 HTTP/1.1" 200 None 2026-04-06 07:20:18,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:20:18,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:20:18,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:20:18,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bbacd2be3e1cf2a5d315 HTTP/1.1" 200 None 2026-04-06 07:20:18,841 - lava_callback - ERROR - Error processing callback for node 69d0bbacd2be3e1cf2a5d315: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:21:18,737 - lava_callback - INFO - Received callback for node 69d0bbe9d2be3e1cf2a5d376 INFO: 172.21.0.1:50912 - "POST /node/69d0bbe9d2be3e1cf2a5d376 HTTP/1.0" 202 Accepted 2026-04-06 07:21:18,743 - lava_callback - INFO - Starting async job submit for node 69d0bbe9d2be3e1cf2a5d376 2026-04-06 07:21:18,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:21:18,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bbe9d2be3e1cf2a5d376 HTTP/1.1" 200 None 2026-04-06 07:21:18,760 - lava_callback - DEBUG - Processing node 69d0bbe9d2be3e1cf2a5d376: baseline-arm64-clabbe 2026-04-06 07:21:18,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bbe9d2be3e1cf2a5d376 2026-04-06 07:21:18,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:21:18,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bbe9d2be3e1cf2a5d376 HTTP/1.1" 200 None 2026-04-06 07:21:18,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:21:18,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 07:21:18,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:21:18,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bbe9d2be3e1cf2a5d376 HTTP/1.1" 200 None 2026-04-06 07:21:18,819 - lava_callback - ERROR - Error processing callback for node 69d0bbe9d2be3e1cf2a5d376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:22:18,777 - lava_callback - INFO - Received callback for node 69d0bc25d2be3e1cf2a5d392 INFO: 172.21.0.1:44538 - "POST /node/69d0bc25d2be3e1cf2a5d392 HTTP/1.0" 202 Accepted 2026-04-06 07:22:18,782 - lava_callback - INFO - Starting async job submit for node 69d0bc25d2be3e1cf2a5d392 2026-04-06 07:22:18,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:18,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc25d2be3e1cf2a5d392 HTTP/1.1" 200 None 2026-04-06 07:22:18,798 - lava_callback - DEBUG - Processing node 69d0bc25d2be3e1cf2a5d392: baseline-arm-clabbe 2026-04-06 07:22:18,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bc25d2be3e1cf2a5d392 2026-04-06 07:22:18,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:18,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc25d2be3e1cf2a5d392 HTTP/1.1" 200 None 2026-04-06 07:22:18,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:18,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:22:18,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:18,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bc25d2be3e1cf2a5d392 HTTP/1.1" 200 None 2026-04-06 07:22:18,853 - lava_callback - ERROR - Error processing callback for node 69d0bc25d2be3e1cf2a5d392: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:22:58,788 - lava_callback - INFO - Received callback for node 69d0bc47d2be3e1cf2a5d3af INFO: 172.21.0.1:37872 - "POST /node/69d0bc47d2be3e1cf2a5d3af HTTP/1.0" 202 Accepted 2026-04-06 07:22:58,798 - lava_callback - INFO - Starting async job submit for node 69d0bc47d2be3e1cf2a5d3af 2026-04-06 07:22:58,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:58,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc47d2be3e1cf2a5d3af HTTP/1.1" 200 None 2026-04-06 07:22:58,824 - lava_callback - DEBUG - Processing node 69d0bc47d2be3e1cf2a5d3af: baseline-arm-clabbe 2026-04-06 07:22:58,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bc47d2be3e1cf2a5d3af 2026-04-06 07:22:58,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:58,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc47d2be3e1cf2a5d3af HTTP/1.1" 200 None 2026-04-06 07:22:58,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:58,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:22:58,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:22:58,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bc47d2be3e1cf2a5d3af HTTP/1.1" 200 None 2026-04-06 07:22:58,891 - lava_callback - ERROR - Error processing callback for node 69d0bc47d2be3e1cf2a5d3af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:23:38,836 - lava_callback - INFO - Received callback for node 69d0bc65d2be3e1cf2a5d3dc INFO: 172.21.0.1:36830 - "POST /node/69d0bc65d2be3e1cf2a5d3dc HTTP/1.0" 202 Accepted 2026-04-06 07:23:38,842 - lava_callback - INFO - Starting async job submit for node 69d0bc65d2be3e1cf2a5d3dc 2026-04-06 07:23:38,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:38,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc65d2be3e1cf2a5d3dc HTTP/1.1" 200 None 2026-04-06 07:23:38,857 - lava_callback - DEBUG - Processing node 69d0bc65d2be3e1cf2a5d3dc: baseline-arm-clabbe 2026-04-06 07:23:38,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bc65d2be3e1cf2a5d3dc 2026-04-06 07:23:38,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:38,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc65d2be3e1cf2a5d3dc HTTP/1.1" 200 None 2026-04-06 07:23:38,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:38,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 07:23:38,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:38,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bc65d2be3e1cf2a5d3dc HTTP/1.1" 200 None 2026-04-06 07:23:38,918 - lava_callback - ERROR - Error processing callback for node 69d0bc65d2be3e1cf2a5d3dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:23:50,597 - lava_callback - INFO - Received callback for node 69d0bc80d2be3e1cf2a5d407 INFO: 172.21.0.1:59386 - "POST /node/69d0bc80d2be3e1cf2a5d407 HTTP/1.0" 202 Accepted 2026-04-06 07:23:50,603 - lava_callback - INFO - Starting async job submit for node 69d0bc80d2be3e1cf2a5d407 2026-04-06 07:23:50,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:50,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc80d2be3e1cf2a5d407 HTTP/1.1" 200 None 2026-04-06 07:23:50,619 - lava_callback - DEBUG - Processing node 69d0bc80d2be3e1cf2a5d407: baseline-arm-baylibre 2026-04-06 07:23:50,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bc80d2be3e1cf2a5d407 2026-04-06 07:23:50,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:50,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc80d2be3e1cf2a5d407 HTTP/1.1" 200 None 2026-04-06 07:23:50,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:50,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:23:50,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:23:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bc80d2be3e1cf2a5d407 HTTP/1.1" 200 None 2026-04-06 07:23:50,670 - lava_callback - ERROR - Error processing callback for node 69d0bc80d2be3e1cf2a5d407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:24:30,553 - lava_callback - INFO - Received callback for node 69d0bc9fd2be3e1cf2a5d429 INFO: 172.21.0.1:37154 - "POST /node/69d0bc9fd2be3e1cf2a5d429 HTTP/1.0" 202 Accepted 2026-04-06 07:24:30,558 - lava_callback - INFO - Starting async job submit for node 69d0bc9fd2be3e1cf2a5d429 2026-04-06 07:24:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:24:30,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc9fd2be3e1cf2a5d429 HTTP/1.1" 200 None 2026-04-06 07:24:30,574 - lava_callback - DEBUG - Processing node 69d0bc9fd2be3e1cf2a5d429: baseline-arm-baylibre 2026-04-06 07:24:30,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bc9fd2be3e1cf2a5d429 2026-04-06 07:24:30,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:24:30,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bc9fd2be3e1cf2a5d429 HTTP/1.1" 200 None 2026-04-06 07:24:30,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:24:30,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:24:30,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:24:30,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bc9fd2be3e1cf2a5d429 HTTP/1.1" 200 None 2026-04-06 07:24:30,629 - lava_callback - ERROR - Error processing callback for node 69d0bc9fd2be3e1cf2a5d429: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:25:10,574 - lava_callback - INFO - Received callback for node 69d0bcc2d2be3e1cf2a5d446 INFO: 172.21.0.1:55312 - "POST /node/69d0bcc2d2be3e1cf2a5d446 HTTP/1.0" 202 Accepted 2026-04-06 07:25:10,580 - lava_callback - INFO - Starting async job submit for node 69d0bcc2d2be3e1cf2a5d446 2026-04-06 07:25:10,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:10,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bcc2d2be3e1cf2a5d446 HTTP/1.1" 200 None 2026-04-06 07:25:10,597 - lava_callback - DEBUG - Processing node 69d0bcc2d2be3e1cf2a5d446: baseline-arm-baylibre 2026-04-06 07:25:10,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bcc2d2be3e1cf2a5d446 2026-04-06 07:25:10,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:10,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bcc2d2be3e1cf2a5d446 HTTP/1.1" 200 None 2026-04-06 07:25:10,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:10,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:25:10,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:10,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bcc2d2be3e1cf2a5d446 HTTP/1.1" 200 None 2026-04-06 07:25:10,668 - lava_callback - ERROR - Error processing callback for node 69d0bcc2d2be3e1cf2a5d446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:25:30,607 - lava_callback - INFO - Received callback for node 69d0bce4d2be3e1cf2a5d460 INFO: 172.21.0.1:55886 - "POST /node/69d0bce4d2be3e1cf2a5d460 HTTP/1.0" 202 Accepted 2026-04-06 07:25:30,613 - lava_callback - INFO - Starting async job submit for node 69d0bce4d2be3e1cf2a5d460 2026-04-06 07:25:30,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:30,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bce4d2be3e1cf2a5d460 HTTP/1.1" 200 None 2026-04-06 07:25:30,630 - lava_callback - DEBUG - Processing node 69d0bce4d2be3e1cf2a5d460: baseline-arm-baylibre 2026-04-06 07:25:30,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bce4d2be3e1cf2a5d460 2026-04-06 07:25:30,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:30,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bce4d2be3e1cf2a5d460 HTTP/1.1" 200 None 2026-04-06 07:25:30,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:30,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:25:30,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:25:30,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bce4d2be3e1cf2a5d460 HTTP/1.1" 200 None 2026-04-06 07:25:30,696 - lava_callback - ERROR - Error processing callback for node 69d0bce4d2be3e1cf2a5d460: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:26:10,646 - lava_callback - INFO - Received callback for node 69d0bd04d2be3e1cf2a5d47b INFO: 172.21.0.1:55208 - "POST /node/69d0bd04d2be3e1cf2a5d47b HTTP/1.0" 202 Accepted 2026-04-06 07:26:10,652 - lava_callback - INFO - Starting async job submit for node 69d0bd04d2be3e1cf2a5d47b 2026-04-06 07:26:10,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:10,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd04d2be3e1cf2a5d47b HTTP/1.1" 200 None 2026-04-06 07:26:10,679 - lava_callback - DEBUG - Processing node 69d0bd04d2be3e1cf2a5d47b: baseline-arm-baylibre 2026-04-06 07:26:10,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bd04d2be3e1cf2a5d47b 2026-04-06 07:26:10,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:10,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd04d2be3e1cf2a5d47b HTTP/1.1" 200 None 2026-04-06 07:26:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:10,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:26:10,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:10,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bd04d2be3e1cf2a5d47b HTTP/1.1" 200 None 2026-04-06 07:26:10,756 - lava_callback - ERROR - Error processing callback for node 69d0bd04d2be3e1cf2a5d47b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:26:30,710 - lava_callback - INFO - Received callback for node 69d0bd1fd2be3e1cf2a5d496 INFO: 172.21.0.1:55756 - "POST /node/69d0bd1fd2be3e1cf2a5d496 HTTP/1.0" 202 Accepted 2026-04-06 07:26:30,715 - lava_callback - INFO - Starting async job submit for node 69d0bd1fd2be3e1cf2a5d496 2026-04-06 07:26:30,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:30,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd1fd2be3e1cf2a5d496 HTTP/1.1" 200 None 2026-04-06 07:26:30,732 - lava_callback - DEBUG - Processing node 69d0bd1fd2be3e1cf2a5d496: baseline-arm-baylibre 2026-04-06 07:26:30,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bd1fd2be3e1cf2a5d496 2026-04-06 07:26:30,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:30,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd1fd2be3e1cf2a5d496 HTTP/1.1" 200 None 2026-04-06 07:26:30,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:30,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:26:30,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:26:30,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bd1fd2be3e1cf2a5d496 HTTP/1.1" 200 None 2026-04-06 07:26:30,789 - lava_callback - ERROR - Error processing callback for node 69d0bd1fd2be3e1cf2a5d496: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:27:18,984 - lava_callback - INFO - Received callback for node 69d0bd42d2be3e1cf2a5d4d1 INFO: 172.21.0.1:54192 - "POST /node/69d0bd42d2be3e1cf2a5d4d1 HTTP/1.0" 202 Accepted 2026-04-06 07:27:18,993 - lava_callback - INFO - Starting async job submit for node 69d0bd42d2be3e1cf2a5d4d1 2026-04-06 07:27:18,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:19,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd42d2be3e1cf2a5d4d1 HTTP/1.1" 200 None 2026-04-06 07:27:19,016 - lava_callback - DEBUG - Processing node 69d0bd42d2be3e1cf2a5d4d1: baseline-arm-clabbe 2026-04-06 07:27:19,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bd42d2be3e1cf2a5d4d1 2026-04-06 07:27:19,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd42d2be3e1cf2a5d4d1 HTTP/1.1" 200 None 2026-04-06 07:27:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:19,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:27:19,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:19,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bd42d2be3e1cf2a5d4d1 HTTP/1.1" 200 None 2026-04-06 07:27:19,095 - lava_callback - ERROR - Error processing callback for node 69d0bd42d2be3e1cf2a5d4d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:27:50,722 - lava_callback - INFO - Received callback for node 69d0bd61d2be3e1cf2a5d4fa INFO: 172.21.0.1:50660 - "POST /node/69d0bd61d2be3e1cf2a5d4fa HTTP/1.0" 202 Accepted 2026-04-06 07:27:50,727 - lava_callback - INFO - Starting async job submit for node 69d0bd61d2be3e1cf2a5d4fa 2026-04-06 07:27:50,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:50,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd61d2be3e1cf2a5d4fa HTTP/1.1" 200 None 2026-04-06 07:27:50,744 - lava_callback - DEBUG - Processing node 69d0bd61d2be3e1cf2a5d4fa: baseline-arm-baylibre 2026-04-06 07:27:50,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bd61d2be3e1cf2a5d4fa 2026-04-06 07:27:50,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:50,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd61d2be3e1cf2a5d4fa HTTP/1.1" 200 None 2026-04-06 07:27:50,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:50,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:27:50,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:27:50,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bd61d2be3e1cf2a5d4fa HTTP/1.1" 200 None 2026-04-06 07:27:50,802 - lava_callback - ERROR - Error processing callback for node 69d0bd61d2be3e1cf2a5d4fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:28:10,718 - lava_callback - INFO - Received callback for node 69d0bd7ed2be3e1cf2a5d521 INFO: 172.21.0.1:46016 - "POST /node/69d0bd7ed2be3e1cf2a5d521 HTTP/1.0" 202 Accepted 2026-04-06 07:28:10,724 - lava_callback - INFO - Starting async job submit for node 69d0bd7ed2be3e1cf2a5d521 2026-04-06 07:28:10,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:10,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd7ed2be3e1cf2a5d521 HTTP/1.1" 200 None 2026-04-06 07:28:10,743 - lava_callback - DEBUG - Processing node 69d0bd7ed2be3e1cf2a5d521: baseline-arm-baylibre 2026-04-06 07:28:10,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bd7ed2be3e1cf2a5d521 2026-04-06 07:28:10,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:10,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bd7ed2be3e1cf2a5d521 HTTP/1.1" 200 None 2026-04-06 07:28:10,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:10,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:28:10,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:10,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bd7ed2be3e1cf2a5d521 HTTP/1.1" 200 None 2026-04-06 07:28:10,845 - lava_callback - ERROR - Error processing callback for node 69d0bd7ed2be3e1cf2a5d521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:28:50,748 - lava_callback - INFO - Received callback for node 69d0bda0d2be3e1cf2a5d548 INFO: 172.21.0.1:46038 - "POST /node/69d0bda0d2be3e1cf2a5d548 HTTP/1.0" 202 Accepted 2026-04-06 07:28:50,753 - lava_callback - INFO - Starting async job submit for node 69d0bda0d2be3e1cf2a5d548 2026-04-06 07:28:50,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:50,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bda0d2be3e1cf2a5d548 HTTP/1.1" 200 None 2026-04-06 07:28:50,769 - lava_callback - DEBUG - Processing node 69d0bda0d2be3e1cf2a5d548: baseline-arm-baylibre 2026-04-06 07:28:50,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bda0d2be3e1cf2a5d548 2026-04-06 07:28:50,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:50,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bda0d2be3e1cf2a5d548 HTTP/1.1" 200 None 2026-04-06 07:28:50,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:50,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:28:50,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:28:50,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bda0d2be3e1cf2a5d548 HTTP/1.1" 200 None 2026-04-06 07:28:50,822 - lava_callback - ERROR - Error processing callback for node 69d0bda0d2be3e1cf2a5d548: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:29:10,924 - lava_callback - INFO - Received callback for node 69d0bdc2d2be3e1cf2a5d587 INFO: 172.21.0.1:35554 - "POST /node/69d0bdc2d2be3e1cf2a5d587 HTTP/1.0" 202 Accepted 2026-04-06 07:29:10,929 - lava_callback - INFO - Starting async job submit for node 69d0bdc2d2be3e1cf2a5d587 2026-04-06 07:29:10,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:10,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bdc2d2be3e1cf2a5d587 HTTP/1.1" 200 None 2026-04-06 07:29:10,945 - lava_callback - DEBUG - Processing node 69d0bdc2d2be3e1cf2a5d587: baseline-arm-baylibre 2026-04-06 07:29:10,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bdc2d2be3e1cf2a5d587 2026-04-06 07:29:10,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:10,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bdc2d2be3e1cf2a5d587 HTTP/1.1" 200 None 2026-04-06 07:29:10,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:10,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:29:10,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:10,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bdc2d2be3e1cf2a5d587 HTTP/1.1" 200 None 2026-04-06 07:29:11,008 - lava_callback - ERROR - Error processing callback for node 69d0bdc2d2be3e1cf2a5d587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:29:50,840 - lava_callback - INFO - Received callback for node 69d0bde0d2be3e1cf2a5d5c4 INFO: 172.21.0.1:57114 - "POST /node/69d0bde0d2be3e1cf2a5d5c4 HTTP/1.0" 202 Accepted 2026-04-06 07:29:50,846 - lava_callback - INFO - Starting async job submit for node 69d0bde0d2be3e1cf2a5d5c4 2026-04-06 07:29:50,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:50,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bde0d2be3e1cf2a5d5c4 HTTP/1.1" 200 None 2026-04-06 07:29:50,861 - lava_callback - DEBUG - Processing node 69d0bde0d2be3e1cf2a5d5c4: baseline-arm-baylibre 2026-04-06 07:29:50,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bde0d2be3e1cf2a5d5c4 2026-04-06 07:29:50,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:50,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bde0d2be3e1cf2a5d5c4 HTTP/1.1" 200 None 2026-04-06 07:29:50,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:50,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:29:50,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:29:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bde0d2be3e1cf2a5d5c4 HTTP/1.1" 200 None 2026-04-06 07:29:50,923 - lava_callback - ERROR - Error processing callback for node 69d0bde0d2be3e1cf2a5d5c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:30:50,880 - lava_callback - INFO - Received callback for node 69d0be18d2be3e1cf2a5d5fc INFO: 172.21.0.1:40404 - "POST /node/69d0be18d2be3e1cf2a5d5fc HTTP/1.0" 202 Accepted 2026-04-06 07:30:50,888 - lava_callback - INFO - Starting async job submit for node 69d0be18d2be3e1cf2a5d5fc 2026-04-06 07:30:50,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:30:50,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be18d2be3e1cf2a5d5fc HTTP/1.1" 200 None 2026-04-06 07:30:50,905 - lava_callback - DEBUG - Processing node 69d0be18d2be3e1cf2a5d5fc: baseline-arm-baylibre 2026-04-06 07:30:50,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0be18d2be3e1cf2a5d5fc 2026-04-06 07:30:50,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:30:50,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be18d2be3e1cf2a5d5fc HTTP/1.1" 200 None 2026-04-06 07:30:50,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:30:50,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:30:50,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:30:50,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0be18d2be3e1cf2a5d5fc HTTP/1.1" 200 None 2026-04-06 07:30:50,965 - lava_callback - ERROR - Error processing callback for node 69d0be18d2be3e1cf2a5d5fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:31:30,917 - lava_callback - INFO - Received callback for node 69d0be42d2be3e1cf2a5d62c INFO: 172.21.0.1:33156 - "POST /node/69d0be42d2be3e1cf2a5d62c HTTP/1.0" 202 Accepted 2026-04-06 07:31:30,922 - lava_callback - INFO - Starting async job submit for node 69d0be42d2be3e1cf2a5d62c 2026-04-06 07:31:30,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:31:30,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be42d2be3e1cf2a5d62c HTTP/1.1" 200 None 2026-04-06 07:31:30,939 - lava_callback - DEBUG - Processing node 69d0be42d2be3e1cf2a5d62c: baseline-arm-baylibre 2026-04-06 07:31:30,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0be42d2be3e1cf2a5d62c 2026-04-06 07:31:30,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:31:30,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be42d2be3e1cf2a5d62c HTTP/1.1" 200 None 2026-04-06 07:31:30,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:31:30,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:31:30,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:31:31,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0be42d2be3e1cf2a5d62c HTTP/1.1" 200 None 2026-04-06 07:31:31,003 - lava_callback - ERROR - Error processing callback for node 69d0be42d2be3e1cf2a5d62c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:32:10,959 - lava_callback - INFO - Received callback for node 69d0be6bd2be3e1cf2a5d645 INFO: 172.21.0.1:43706 - "POST /node/69d0be6bd2be3e1cf2a5d645 HTTP/1.0" 202 Accepted 2026-04-06 07:32:10,965 - lava_callback - INFO - Starting async job submit for node 69d0be6bd2be3e1cf2a5d645 2026-04-06 07:32:10,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:32:10,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be6bd2be3e1cf2a5d645 HTTP/1.1" 200 None 2026-04-06 07:32:10,981 - lava_callback - DEBUG - Processing node 69d0be6bd2be3e1cf2a5d645: baseline-arm64-baylibre 2026-04-06 07:32:10,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0be6bd2be3e1cf2a5d645 2026-04-06 07:32:10,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:32:10,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0be6bd2be3e1cf2a5d645 HTTP/1.1" 200 None 2026-04-06 07:32:10,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:32:11,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:32:11,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:32:11,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0be6bd2be3e1cf2a5d645 HTTP/1.1" 200 None 2026-04-06 07:32:11,053 - lava_callback - ERROR - Error processing callback for node 69d0be6bd2be3e1cf2a5d645: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:33:10,976 - lava_callback - INFO - Received callback for node 69d0beabd2be3e1cf2a5d659 INFO: 172.21.0.1:52256 - "POST /node/69d0beabd2be3e1cf2a5d659 HTTP/1.0" 202 Accepted 2026-04-06 07:33:10,982 - lava_callback - INFO - Starting async job submit for node 69d0beabd2be3e1cf2a5d659 2026-04-06 07:33:10,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:10,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0beabd2be3e1cf2a5d659 HTTP/1.1" 200 None 2026-04-06 07:33:10,997 - lava_callback - DEBUG - Processing node 69d0beabd2be3e1cf2a5d659: baseline-arm-baylibre 2026-04-06 07:33:10,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0beabd2be3e1cf2a5d659 2026-04-06 07:33:10,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:11,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0beabd2be3e1cf2a5d659 HTTP/1.1" 200 None 2026-04-06 07:33:11,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:11,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:33:11,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:11,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0beabd2be3e1cf2a5d659 HTTP/1.1" 200 None 2026-04-06 07:33:11,059 - lava_callback - ERROR - Error processing callback for node 69d0beabd2be3e1cf2a5d659: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:33:51,103 - lava_callback - INFO - Received callback for node 69d0bed8d2be3e1cf2a5d672 INFO: 172.21.0.1:48932 - "POST /node/69d0bed8d2be3e1cf2a5d672 HTTP/1.0" 202 Accepted 2026-04-06 07:33:51,109 - lava_callback - INFO - Starting async job submit for node 69d0bed8d2be3e1cf2a5d672 2026-04-06 07:33:51,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:51,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bed8d2be3e1cf2a5d672 HTTP/1.1" 200 None 2026-04-06 07:33:51,139 - lava_callback - DEBUG - Processing node 69d0bed8d2be3e1cf2a5d672: baseline-arm64-baylibre 2026-04-06 07:33:51,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bed8d2be3e1cf2a5d672 2026-04-06 07:33:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:51,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bed8d2be3e1cf2a5d672 HTTP/1.1" 200 None 2026-04-06 07:33:51,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:51,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:33:51,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:33:51,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bed8d2be3e1cf2a5d672 HTTP/1.1" 200 None 2026-04-06 07:33:51,211 - lava_callback - ERROR - Error processing callback for node 69d0bed8d2be3e1cf2a5d672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:34:59,418 - lava_callback - INFO - Received callback for node 69d0bf1bd2be3e1cf2a5d689 INFO: 172.21.0.1:47648 - "POST /node/69d0bf1bd2be3e1cf2a5d689 HTTP/1.0" 202 Accepted 2026-04-06 07:34:59,424 - lava_callback - INFO - Starting async job submit for node 69d0bf1bd2be3e1cf2a5d689 2026-04-06 07:34:59,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:34:59,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf1bd2be3e1cf2a5d689 HTTP/1.1" 200 None 2026-04-06 07:34:59,439 - lava_callback - DEBUG - Processing node 69d0bf1bd2be3e1cf2a5d689: baseline-arm-clabbe 2026-04-06 07:34:59,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bf1bd2be3e1cf2a5d689 2026-04-06 07:34:59,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:34:59,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf1bd2be3e1cf2a5d689 HTTP/1.1" 200 None 2026-04-06 07:34:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:34:59,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:34:59,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:34:59,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bf1bd2be3e1cf2a5d689 HTTP/1.1" 200 None 2026-04-06 07:34:59,491 - lava_callback - ERROR - Error processing callback for node 69d0bf1bd2be3e1cf2a5d689: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:35:31,301 - lava_callback - INFO - Received callback for node 69d0bf38d2be3e1cf2a5d6b5 INFO: 172.21.0.1:47222 - "POST /node/69d0bf38d2be3e1cf2a5d6b5 HTTP/1.0" 202 Accepted 2026-04-06 07:35:31,309 - lava_callback - INFO - Starting async job submit for node 69d0bf38d2be3e1cf2a5d6b5 2026-04-06 07:35:31,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:35:31,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf38d2be3e1cf2a5d6b5 HTTP/1.1" 200 None 2026-04-06 07:35:31,331 - lava_callback - DEBUG - Processing node 69d0bf38d2be3e1cf2a5d6b5: baseline-arm-baylibre 2026-04-06 07:35:31,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bf38d2be3e1cf2a5d6b5 2026-04-06 07:35:31,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:35:31,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf38d2be3e1cf2a5d6b5 HTTP/1.1" 200 None 2026-04-06 07:35:31,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:35:31,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:35:31,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:35:31,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bf38d2be3e1cf2a5d6b5 HTTP/1.1" 200 None 2026-04-06 07:35:31,402 - lava_callback - ERROR - Error processing callback for node 69d0bf38d2be3e1cf2a5d6b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:36:11,160 - lava_callback - INFO - Received callback for node 69d0bf62d2be3e1cf2a5d6ca INFO: 172.21.0.1:47366 - "POST /node/69d0bf62d2be3e1cf2a5d6ca HTTP/1.0" 202 Accepted 2026-04-06 07:36:11,166 - lava_callback - INFO - Starting async job submit for node 69d0bf62d2be3e1cf2a5d6ca 2026-04-06 07:36:11,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:36:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf62d2be3e1cf2a5d6ca HTTP/1.1" 200 None 2026-04-06 07:36:11,185 - lava_callback - DEBUG - Processing node 69d0bf62d2be3e1cf2a5d6ca: baseline-arm64-baylibre 2026-04-06 07:36:11,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bf62d2be3e1cf2a5d6ca 2026-04-06 07:36:11,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:36:11,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf62d2be3e1cf2a5d6ca HTTP/1.1" 200 None 2026-04-06 07:36:11,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:36:11,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:36:11,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:36:11,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bf62d2be3e1cf2a5d6ca HTTP/1.1" 200 None 2026-04-06 07:36:11,262 - lava_callback - ERROR - Error processing callback for node 69d0bf62d2be3e1cf2a5d6ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:37:11,286 - lava_callback - INFO - Received callback for node 69d0bf9dd2be3e1cf2a5d712 INFO: 172.21.0.1:49932 - "POST /node/69d0bf9dd2be3e1cf2a5d712 HTTP/1.0" 202 Accepted 2026-04-06 07:37:11,292 - lava_callback - INFO - Starting async job submit for node 69d0bf9dd2be3e1cf2a5d712 2026-04-06 07:37:11,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:11,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf9dd2be3e1cf2a5d712 HTTP/1.1" 200 None 2026-04-06 07:37:11,328 - lava_callback - DEBUG - Processing node 69d0bf9dd2be3e1cf2a5d712: baseline-arm-baylibre 2026-04-06 07:37:11,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bf9dd2be3e1cf2a5d712 2026-04-06 07:37:11,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:11,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bf9dd2be3e1cf2a5d712 HTTP/1.1" 200 None 2026-04-06 07:37:11,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:11,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:37:11,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:11,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bf9dd2be3e1cf2a5d712 HTTP/1.1" 200 None 2026-04-06 07:37:11,396 - lava_callback - ERROR - Error processing callback for node 69d0bf9dd2be3e1cf2a5d712: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:37:51,263 - lava_callback - INFO - Received callback for node 69d0bfc9d2be3e1cf2a5d72d INFO: 172.21.0.1:32826 - "POST /node/69d0bfc9d2be3e1cf2a5d72d HTTP/1.0" 202 Accepted 2026-04-06 07:37:51,269 - lava_callback - INFO - Starting async job submit for node 69d0bfc9d2be3e1cf2a5d72d 2026-04-06 07:37:51,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:51,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bfc9d2be3e1cf2a5d72d HTTP/1.1" 200 None 2026-04-06 07:37:51,288 - lava_callback - DEBUG - Processing node 69d0bfc9d2be3e1cf2a5d72d: baseline-arm64-baylibre 2026-04-06 07:37:51,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0bfc9d2be3e1cf2a5d72d 2026-04-06 07:37:51,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0bfc9d2be3e1cf2a5d72d HTTP/1.1" 200 None 2026-04-06 07:37:51,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:51,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:37:51,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:37:51,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0bfc9d2be3e1cf2a5d72d HTTP/1.1" 200 None 2026-04-06 07:37:51,355 - lava_callback - ERROR - Error processing callback for node 69d0bfc9d2be3e1cf2a5d72d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:39:11,337 - lava_callback - INFO - Received callback for node 69d0c00dd2be3e1cf2a5d758 INFO: 172.21.0.1:57832 - "POST /node/69d0c00dd2be3e1cf2a5d758 HTTP/1.0" 202 Accepted 2026-04-06 07:39:11,343 - lava_callback - INFO - Starting async job submit for node 69d0c00dd2be3e1cf2a5d758 2026-04-06 07:39:11,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:39:11,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c00dd2be3e1cf2a5d758 HTTP/1.1" 200 None 2026-04-06 07:39:11,361 - lava_callback - DEBUG - Processing node 69d0c00dd2be3e1cf2a5d758: baseline-arm64-baylibre 2026-04-06 07:39:11,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c00dd2be3e1cf2a5d758 2026-04-06 07:39:11,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:39:11,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c00dd2be3e1cf2a5d758 HTTP/1.1" 200 None 2026-04-06 07:39:11,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:39:11,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:39:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:39:11,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c00dd2be3e1cf2a5d758 HTTP/1.1" 200 None 2026-04-06 07:39:11,433 - lava_callback - ERROR - Error processing callback for node 69d0c00dd2be3e1cf2a5d758: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:40:11,410 - lava_callback - INFO - Received callback for node 69d0c052d2be3e1cf2a5d793 INFO: 172.21.0.1:47854 - "POST /node/69d0c052d2be3e1cf2a5d793 HTTP/1.0" 202 Accepted 2026-04-06 07:40:11,419 - lava_callback - INFO - Starting async job submit for node 69d0c052d2be3e1cf2a5d793 2026-04-06 07:40:11,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:40:11,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c052d2be3e1cf2a5d793 HTTP/1.1" 200 None 2026-04-06 07:40:11,435 - lava_callback - DEBUG - Processing node 69d0c052d2be3e1cf2a5d793: baseline-arm64-baylibre 2026-04-06 07:40:11,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c052d2be3e1cf2a5d793 2026-04-06 07:40:11,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:40:11,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c052d2be3e1cf2a5d793 HTTP/1.1" 200 None 2026-04-06 07:40:11,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:40:11,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:40:11,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:40:11,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c052d2be3e1cf2a5d793 HTTP/1.1" 200 None 2026-04-06 07:40:11,506 - lava_callback - ERROR - Error processing callback for node 69d0c052d2be3e1cf2a5d793: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:41:31,573 - lava_callback - INFO - Received callback for node 69d0c097d2be3e1cf2a5d7c4 INFO: 172.21.0.1:53970 - "POST /node/69d0c097d2be3e1cf2a5d7c4 HTTP/1.0" 202 Accepted 2026-04-06 07:41:31,579 - lava_callback - INFO - Starting async job submit for node 69d0c097d2be3e1cf2a5d7c4 2026-04-06 07:41:31,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:41:31,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c097d2be3e1cf2a5d7c4 HTTP/1.1" 200 None 2026-04-06 07:41:31,595 - lava_callback - DEBUG - Processing node 69d0c097d2be3e1cf2a5d7c4: baseline-arm64-baylibre 2026-04-06 07:41:31,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c097d2be3e1cf2a5d7c4 2026-04-06 07:41:31,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:41:31,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c097d2be3e1cf2a5d7c4 HTTP/1.1" 200 None 2026-04-06 07:41:31,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:41:31,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:41:31,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:41:31,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c097d2be3e1cf2a5d7c4 HTTP/1.1" 200 None 2026-04-06 07:41:31,650 - lava_callback - ERROR - Error processing callback for node 69d0c097d2be3e1cf2a5d7c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:42:31,540 - lava_callback - INFO - Received callback for node 69d0c0ddd2be3e1cf2a5d7f3 INFO: 172.21.0.1:45180 - "POST /node/69d0c0ddd2be3e1cf2a5d7f3 HTTP/1.0" 202 Accepted 2026-04-06 07:42:31,546 - lava_callback - INFO - Starting async job submit for node 69d0c0ddd2be3e1cf2a5d7f3 2026-04-06 07:42:31,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:42:31,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c0ddd2be3e1cf2a5d7f3 HTTP/1.1" 200 None 2026-04-06 07:42:31,562 - lava_callback - DEBUG - Processing node 69d0c0ddd2be3e1cf2a5d7f3: baseline-arm64-baylibre 2026-04-06 07:42:31,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c0ddd2be3e1cf2a5d7f3 2026-04-06 07:42:31,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:42:31,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c0ddd2be3e1cf2a5d7f3 HTTP/1.1" 200 None 2026-04-06 07:42:31,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:42:31,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:42:31,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:42:31,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c0ddd2be3e1cf2a5d7f3 HTTP/1.1" 200 None 2026-04-06 07:42:31,638 - lava_callback - ERROR - Error processing callback for node 69d0c0ddd2be3e1cf2a5d7f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:43:51,845 - lava_callback - INFO - Received callback for node 69d0c123d2be3e1cf2a5d80a INFO: 172.21.0.1:34780 - "POST /node/69d0c123d2be3e1cf2a5d80a HTTP/1.0" 202 Accepted 2026-04-06 07:43:51,851 - lava_callback - INFO - Starting async job submit for node 69d0c123d2be3e1cf2a5d80a 2026-04-06 07:43:51,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:43:51,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c123d2be3e1cf2a5d80a HTTP/1.1" 200 None 2026-04-06 07:43:51,869 - lava_callback - DEBUG - Processing node 69d0c123d2be3e1cf2a5d80a: baseline-arm64-baylibre 2026-04-06 07:43:51,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c123d2be3e1cf2a5d80a 2026-04-06 07:43:51,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:43:51,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c123d2be3e1cf2a5d80a HTTP/1.1" 200 None 2026-04-06 07:43:51,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:43:51,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:43:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:43:51,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c123d2be3e1cf2a5d80a HTTP/1.1" 200 None 2026-04-06 07:43:51,937 - lava_callback - ERROR - Error processing callback for node 69d0c123d2be3e1cf2a5d80a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38766 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:44:59,841 - lava_callback - INFO - Received callback for node 69d0c168d2be3e1cf2a5d856 INFO: 172.21.0.1:59054 - "POST /node/69d0c168d2be3e1cf2a5d856 HTTP/1.0" 202 Accepted 2026-04-06 07:44:59,847 - lava_callback - INFO - Starting async job submit for node 69d0c168d2be3e1cf2a5d856 2026-04-06 07:44:59,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:44:59,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c168d2be3e1cf2a5d856 HTTP/1.1" 200 None 2026-04-06 07:44:59,870 - lava_callback - DEBUG - Processing node 69d0c168d2be3e1cf2a5d856: baseline-arm64-clabbe 2026-04-06 07:44:59,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c168d2be3e1cf2a5d856 2026-04-06 07:44:59,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:44:59,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c168d2be3e1cf2a5d856 HTTP/1.1" 200 None 2026-04-06 07:44:59,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:44:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:44:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:44:59,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c168d2be3e1cf2a5d856 HTTP/1.1" 200 None 2026-04-06 07:44:59,933 - lava_callback - ERROR - Error processing callback for node 69d0c168d2be3e1cf2a5d856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:45:51,828 - lava_callback - INFO - Received callback for node 69d0c1acd2be3e1cf2a5d869 INFO: 172.21.0.1:53266 - "POST /node/69d0c1acd2be3e1cf2a5d869 HTTP/1.0" 202 Accepted 2026-04-06 07:45:51,834 - lava_callback - INFO - Starting async job submit for node 69d0c1acd2be3e1cf2a5d869 2026-04-06 07:45:51,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:45:51,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c1acd2be3e1cf2a5d869 HTTP/1.1" 200 None 2026-04-06 07:45:51,854 - lava_callback - DEBUG - Processing node 69d0c1acd2be3e1cf2a5d869: baseline-arm64-baylibre 2026-04-06 07:45:51,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c1acd2be3e1cf2a5d869 2026-04-06 07:45:51,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:45:51,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c1acd2be3e1cf2a5d869 HTTP/1.1" 200 None 2026-04-06 07:45:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:45:51,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:45:51,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:45:51,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c1acd2be3e1cf2a5d869 HTTP/1.1" 200 None 2026-04-06 07:45:51,938 - lava_callback - ERROR - Error processing callback for node 69d0c1acd2be3e1cf2a5d869: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:47:20,023 - lava_callback - INFO - Received callback for node 69d0c1f5d2be3e1cf2a5d88e INFO: 172.21.0.1:39734 - "POST /node/69d0c1f5d2be3e1cf2a5d88e HTTP/1.0" 202 Accepted 2026-04-06 07:47:20,029 - lava_callback - INFO - Starting async job submit for node 69d0c1f5d2be3e1cf2a5d88e 2026-04-06 07:47:20,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:47:20,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c1f5d2be3e1cf2a5d88e HTTP/1.1" 200 None 2026-04-06 07:47:20,051 - lava_callback - DEBUG - Processing node 69d0c1f5d2be3e1cf2a5d88e: baseline-arm64-clabbe 2026-04-06 07:47:20,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c1f5d2be3e1cf2a5d88e 2026-04-06 07:47:20,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:47:20,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c1f5d2be3e1cf2a5d88e HTTP/1.1" 200 None 2026-04-06 07:47:20,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:47:20,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:47:20,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:47:20,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c1f5d2be3e1cf2a5d88e HTTP/1.1" 200 None 2026-04-06 07:47:20,129 - lava_callback - ERROR - Error processing callback for node 69d0c1f5d2be3e1cf2a5d88e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58904 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:48:11,845 - lava_callback - INFO - Received callback for node 69d0c234d2be3e1cf2a5d8ad INFO: 172.21.0.1:43754 - "POST /node/69d0c234d2be3e1cf2a5d8ad HTTP/1.0" 202 Accepted 2026-04-06 07:48:11,851 - lava_callback - INFO - Starting async job submit for node 69d0c234d2be3e1cf2a5d8ad 2026-04-06 07:48:11,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:48:11,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c234d2be3e1cf2a5d8ad HTTP/1.1" 200 None 2026-04-06 07:48:11,870 - lava_callback - DEBUG - Processing node 69d0c234d2be3e1cf2a5d8ad: baseline-arm64-baylibre 2026-04-06 07:48:11,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c234d2be3e1cf2a5d8ad 2026-04-06 07:48:11,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:48:11,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c234d2be3e1cf2a5d8ad HTTP/1.1" 200 None 2026-04-06 07:48:11,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:48:11,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:48:11,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:48:11,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c234d2be3e1cf2a5d8ad HTTP/1.1" 200 None 2026-04-06 07:48:11,925 - lava_callback - ERROR - Error processing callback for node 69d0c234d2be3e1cf2a5d8ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:49:40,081 - lava_callback - INFO - Received callback for node 69d0c27fd2be3e1cf2a5d8e7 INFO: 172.21.0.1:55904 - "POST /node/69d0c27fd2be3e1cf2a5d8e7 HTTP/1.0" 202 Accepted 2026-04-06 07:49:40,087 - lava_callback - INFO - Starting async job submit for node 69d0c27fd2be3e1cf2a5d8e7 2026-04-06 07:49:40,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:49:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c27fd2be3e1cf2a5d8e7 HTTP/1.1" 200 None 2026-04-06 07:49:40,132 - lava_callback - DEBUG - Processing node 69d0c27fd2be3e1cf2a5d8e7: baseline-arm64-clabbe 2026-04-06 07:49:40,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c27fd2be3e1cf2a5d8e7 2026-04-06 07:49:40,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:49:40,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c27fd2be3e1cf2a5d8e7 HTTP/1.1" 200 None 2026-04-06 07:49:40,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:49:40,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:49:40,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:49:40,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c27fd2be3e1cf2a5d8e7 HTTP/1.1" 200 None 2026-04-06 07:49:40,203 - lava_callback - ERROR - Error processing callback for node 69d0c27fd2be3e1cf2a5d8e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:50:40,120 - lava_callback - INFO - Received callback for node 69d0c2bed2be3e1cf2a5d943 INFO: 172.21.0.1:49802 - "POST /node/69d0c2bed2be3e1cf2a5d943 HTTP/1.0" 202 Accepted 2026-04-06 07:50:40,128 - lava_callback - INFO - Starting async job submit for node 69d0c2bed2be3e1cf2a5d943 2026-04-06 07:50:40,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:50:40,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c2bed2be3e1cf2a5d943 HTTP/1.1" 200 None 2026-04-06 07:50:40,147 - lava_callback - DEBUG - Processing node 69d0c2bed2be3e1cf2a5d943: baseline-arm64-clabbe 2026-04-06 07:50:40,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c2bed2be3e1cf2a5d943 2026-04-06 07:50:40,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:50:40,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c2bed2be3e1cf2a5d943 HTTP/1.1" 200 None 2026-04-06 07:50:40,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:50:40,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:50:40,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:50:40,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c2bed2be3e1cf2a5d943 HTTP/1.1" 200 None 2026-04-06 07:50:40,211 - lava_callback - ERROR - Error processing callback for node 69d0c2bed2be3e1cf2a5d943: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:51:40,111 - lava_callback - INFO - Received callback for node 69d0c306d2be3e1cf2a5d96a INFO: 172.21.0.1:51092 - "POST /node/69d0c306d2be3e1cf2a5d96a HTTP/1.0" 202 Accepted 2026-04-06 07:51:40,117 - lava_callback - INFO - Starting async job submit for node 69d0c306d2be3e1cf2a5d96a 2026-04-06 07:51:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:51:40,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c306d2be3e1cf2a5d96a HTTP/1.1" 200 None 2026-04-06 07:51:40,147 - lava_callback - DEBUG - Processing node 69d0c306d2be3e1cf2a5d96a: baseline-arm64-clabbe 2026-04-06 07:51:40,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c306d2be3e1cf2a5d96a 2026-04-06 07:51:40,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:51:40,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c306d2be3e1cf2a5d96a HTTP/1.1" 200 None 2026-04-06 07:51:40,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:51:40,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:51:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:51:40,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c306d2be3e1cf2a5d96a HTTP/1.1" 200 None 2026-04-06 07:51:40,206 - lava_callback - ERROR - Error processing callback for node 69d0c306d2be3e1cf2a5d96a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:53:00,219 - lava_callback - INFO - Received callback for node 69d0c351d2be3e1cf2a5d988 INFO: 172.21.0.1:52068 - "POST /node/69d0c351d2be3e1cf2a5d988 HTTP/1.0" 202 Accepted 2026-04-06 07:53:00,225 - lava_callback - INFO - Starting async job submit for node 69d0c351d2be3e1cf2a5d988 2026-04-06 07:53:00,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:53:00,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c351d2be3e1cf2a5d988 HTTP/1.1" 200 None 2026-04-06 07:53:00,240 - lava_callback - DEBUG - Processing node 69d0c351d2be3e1cf2a5d988: baseline-arm64-clabbe 2026-04-06 07:53:00,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c351d2be3e1cf2a5d988 2026-04-06 07:53:00,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:53:00,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c351d2be3e1cf2a5d988 HTTP/1.1" 200 None 2026-04-06 07:53:00,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:53:00,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:53:00,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:53:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c351d2be3e1cf2a5d988 HTTP/1.1" 200 None 2026-04-06 07:53:00,292 - lava_callback - ERROR - Error processing callback for node 69d0c351d2be3e1cf2a5d988: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50678 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:54:20,242 - lava_callback - INFO - Received callback for node 69d0c398d2be3e1cf2a5d9b1 INFO: 172.21.0.1:51970 - "POST /node/69d0c398d2be3e1cf2a5d9b1 HTTP/1.0" 202 Accepted 2026-04-06 07:54:20,247 - lava_callback - INFO - Starting async job submit for node 69d0c398d2be3e1cf2a5d9b1 2026-04-06 07:54:20,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:54:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c398d2be3e1cf2a5d9b1 HTTP/1.1" 200 None 2026-04-06 07:54:20,263 - lava_callback - DEBUG - Processing node 69d0c398d2be3e1cf2a5d9b1: baseline-arm64-clabbe 2026-04-06 07:54:20,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c398d2be3e1cf2a5d9b1 2026-04-06 07:54:20,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:54:20,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c398d2be3e1cf2a5d9b1 HTTP/1.1" 200 None 2026-04-06 07:54:20,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:54:20,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:54:20,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:54:20,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c398d2be3e1cf2a5d9b1 HTTP/1.1" 200 None 2026-04-06 07:54:20,320 - lava_callback - ERROR - Error processing callback for node 69d0c398d2be3e1cf2a5d9b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:55:20,314 - lava_callback - INFO - Received callback for node 69d0c3d7d2be3e1cf2a5da09 INFO: 172.21.0.1:45702 - "POST /node/69d0c3d7d2be3e1cf2a5da09 HTTP/1.0" 202 Accepted 2026-04-06 07:55:20,320 - lava_callback - INFO - Starting async job submit for node 69d0c3d7d2be3e1cf2a5da09 2026-04-06 07:55:20,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:55:20,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c3d7d2be3e1cf2a5da09 HTTP/1.1" 200 None 2026-04-06 07:55:20,336 - lava_callback - DEBUG - Processing node 69d0c3d7d2be3e1cf2a5da09: baseline-arm64-clabbe 2026-04-06 07:55:20,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c3d7d2be3e1cf2a5da09 2026-04-06 07:55:20,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:55:20,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c3d7d2be3e1cf2a5da09 HTTP/1.1" 200 None 2026-04-06 07:55:20,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:55:20,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:55:20,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:55:20,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c3d7d2be3e1cf2a5da09 HTTP/1.1" 200 None 2026-04-06 07:55:20,394 - lava_callback - ERROR - Error processing callback for node 69d0c3d7d2be3e1cf2a5da09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:56:20,337 - lava_callback - INFO - Received callback for node 69d0c41ed2be3e1cf2a5da40 INFO: 172.21.0.1:55804 - "POST /node/69d0c41ed2be3e1cf2a5da40 HTTP/1.0" 202 Accepted 2026-04-06 07:56:20,344 - lava_callback - INFO - Starting async job submit for node 69d0c41ed2be3e1cf2a5da40 2026-04-06 07:56:20,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:56:20,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c41ed2be3e1cf2a5da40 HTTP/1.1" 200 None 2026-04-06 07:56:20,362 - lava_callback - DEBUG - Processing node 69d0c41ed2be3e1cf2a5da40: baseline-arm64-clabbe 2026-04-06 07:56:20,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c41ed2be3e1cf2a5da40 2026-04-06 07:56:20,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:56:20,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c41ed2be3e1cf2a5da40 HTTP/1.1" 200 None 2026-04-06 07:56:20,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:56:20,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:56:20,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:56:20,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c41ed2be3e1cf2a5da40 HTTP/1.1" 200 None 2026-04-06 07:56:20,430 - lava_callback - ERROR - Error processing callback for node 69d0c41ed2be3e1cf2a5da40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:57:40,366 - lava_callback - INFO - Received callback for node 69d0c463d2be3e1cf2a5da6f INFO: 172.21.0.1:44190 - "POST /node/69d0c463d2be3e1cf2a5da6f HTTP/1.0" 202 Accepted 2026-04-06 07:57:40,371 - lava_callback - INFO - Starting async job submit for node 69d0c463d2be3e1cf2a5da6f 2026-04-06 07:57:40,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:57:40,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c463d2be3e1cf2a5da6f HTTP/1.1" 200 None 2026-04-06 07:57:40,397 - lava_callback - DEBUG - Processing node 69d0c463d2be3e1cf2a5da6f: baseline-arm64-clabbe 2026-04-06 07:57:40,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c463d2be3e1cf2a5da6f 2026-04-06 07:57:40,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:57:40,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c463d2be3e1cf2a5da6f HTTP/1.1" 200 None 2026-04-06 07:57:40,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:57:40,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:57:40,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:57:40,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c463d2be3e1cf2a5da6f HTTP/1.1" 200 None 2026-04-06 07:57:40,449 - lava_callback - ERROR - Error processing callback for node 69d0c463d2be3e1cf2a5da6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:58:40,450 - lava_callback - INFO - Received callback for node 69d0c49dd2be3e1cf2a5da8e INFO: 172.21.0.1:37700 - "POST /node/69d0c49dd2be3e1cf2a5da8e HTTP/1.0" 202 Accepted 2026-04-06 07:58:40,456 - lava_callback - INFO - Starting async job submit for node 69d0c49dd2be3e1cf2a5da8e 2026-04-06 07:58:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:58:40,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c49dd2be3e1cf2a5da8e HTTP/1.1" 200 None 2026-04-06 07:58:40,473 - lava_callback - DEBUG - Processing node 69d0c49dd2be3e1cf2a5da8e: baseline-arm-clabbe 2026-04-06 07:58:40,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c49dd2be3e1cf2a5da8e 2026-04-06 07:58:40,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:58:40,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c49dd2be3e1cf2a5da8e HTTP/1.1" 200 None 2026-04-06 07:58:40,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:58:40,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 07:58:40,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:58:40,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c49dd2be3e1cf2a5da8e HTTP/1.1" 200 None 2026-04-06 07:58:40,524 - lava_callback - ERROR - Error processing callback for node 69d0c49dd2be3e1cf2a5da8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK 2026-04-06 07:59:20,436 - lava_callback - INFO - Received callback for node 69d0c4cbd2be3e1cf2a5dac1 INFO: 172.21.0.1:52312 - "POST /node/69d0c4cbd2be3e1cf2a5dac1 HTTP/1.0" 202 Accepted 2026-04-06 07:59:20,442 - lava_callback - INFO - Starting async job submit for node 69d0c4cbd2be3e1cf2a5dac1 2026-04-06 07:59:20,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:59:20,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c4cbd2be3e1cf2a5dac1 HTTP/1.1" 200 None 2026-04-06 07:59:20,463 - lava_callback - DEBUG - Processing node 69d0c4cbd2be3e1cf2a5dac1: baseline-arm64-clabbe 2026-04-06 07:59:20,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c4cbd2be3e1cf2a5dac1 2026-04-06 07:59:20,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:59:20,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c4cbd2be3e1cf2a5dac1 HTTP/1.1" 200 None 2026-04-06 07:59:20,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:59:20,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 07:59:20,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 07:59:20,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c4cbd2be3e1cf2a5dac1 HTTP/1.1" 200 None 2026-04-06 07:59:20,520 - lava_callback - ERROR - Error processing callback for node 69d0c4cbd2be3e1cf2a5dac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:00:12,505 - lava_callback - INFO - Received callback for node 69d0c4fed2be3e1cf2a5daf6 INFO: 172.21.0.1:37940 - "POST /node/69d0c4fed2be3e1cf2a5daf6 HTTP/1.0" 202 Accepted 2026-04-06 08:00:12,510 - lava_callback - INFO - Starting async job submit for node 69d0c4fed2be3e1cf2a5daf6 2026-04-06 08:00:12,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:00:12,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c4fed2be3e1cf2a5daf6 HTTP/1.1" 200 None 2026-04-06 08:00:12,528 - lava_callback - DEBUG - Processing node 69d0c4fed2be3e1cf2a5daf6: baseline-arm-baylibre 2026-04-06 08:00:12,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c4fed2be3e1cf2a5daf6 2026-04-06 08:00:12,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:00:12,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c4fed2be3e1cf2a5daf6 HTTP/1.1" 200 None 2026-04-06 08:00:12,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:00:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:00:12,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:00:12,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c4fed2be3e1cf2a5daf6 HTTP/1.1" 200 None 2026-04-06 08:00:12,580 - lava_callback - ERROR - Error processing callback for node 69d0c4fed2be3e1cf2a5daf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:01:00,576 - lava_callback - INFO - Received callback for node 69d0c533d2be3e1cf2a5db0c INFO: 172.21.0.1:53262 - "POST /node/69d0c533d2be3e1cf2a5db0c HTTP/1.0" 202 Accepted 2026-04-06 08:01:00,581 - lava_callback - INFO - Starting async job submit for node 69d0c533d2be3e1cf2a5db0c 2026-04-06 08:01:00,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:01:00,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c533d2be3e1cf2a5db0c HTTP/1.1" 200 None 2026-04-06 08:01:00,597 - lava_callback - DEBUG - Processing node 69d0c533d2be3e1cf2a5db0c: baseline-arm64-clabbe 2026-04-06 08:01:00,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c533d2be3e1cf2a5db0c 2026-04-06 08:01:00,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:01:00,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c533d2be3e1cf2a5db0c HTTP/1.1" 200 None 2026-04-06 08:01:00,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:01:00,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 08:01:00,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:01:00,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c533d2be3e1cf2a5db0c HTTP/1.1" 200 None 2026-04-06 08:01:00,653 - lava_callback - ERROR - Error processing callback for node 69d0c533d2be3e1cf2a5db0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:02:00,570 - lava_callback - INFO - Received callback for node 69d0c56dd2be3e1cf2a5db26 INFO: 172.21.0.1:45374 - "POST /node/69d0c56dd2be3e1cf2a5db26 HTTP/1.0" 202 Accepted 2026-04-06 08:02:00,578 - lava_callback - INFO - Starting async job submit for node 69d0c56dd2be3e1cf2a5db26 2026-04-06 08:02:00,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:00,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c56dd2be3e1cf2a5db26 HTTP/1.1" 200 None 2026-04-06 08:02:00,600 - lava_callback - DEBUG - Processing node 69d0c56dd2be3e1cf2a5db26: baseline-arm-clabbe 2026-04-06 08:02:00,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c56dd2be3e1cf2a5db26 2026-04-06 08:02:00,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:00,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c56dd2be3e1cf2a5db26 HTTP/1.1" 200 None 2026-04-06 08:02:00,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:00,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:02:00,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:00,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c56dd2be3e1cf2a5db26 HTTP/1.1" 200 None 2026-04-06 08:02:00,668 - lava_callback - ERROR - Error processing callback for node 69d0c56dd2be3e1cf2a5db26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:02:40,607 - lava_callback - INFO - Received callback for node 69d0c58bd2be3e1cf2a5db49 INFO: 172.21.0.1:51706 - "POST /node/69d0c58bd2be3e1cf2a5db49 HTTP/1.0" 202 Accepted 2026-04-06 08:02:40,614 - lava_callback - INFO - Starting async job submit for node 69d0c58bd2be3e1cf2a5db49 2026-04-06 08:02:40,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:40,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c58bd2be3e1cf2a5db49 HTTP/1.1" 200 None 2026-04-06 08:02:40,628 - lava_callback - DEBUG - Processing node 69d0c58bd2be3e1cf2a5db49: baseline-arm-clabbe 2026-04-06 08:02:40,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c58bd2be3e1cf2a5db49 2026-04-06 08:02:40,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:40,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c58bd2be3e1cf2a5db49 HTTP/1.1" 200 None 2026-04-06 08:02:40,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:40,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:02:40,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:02:40,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c58bd2be3e1cf2a5db49 HTTP/1.1" 200 None 2026-04-06 08:02:40,686 - lava_callback - ERROR - Error processing callback for node 69d0c58bd2be3e1cf2a5db49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:03:00,644 - lava_callback - INFO - Received callback for node 69d0c5a7d2be3e1cf2a5db90 INFO: 172.21.0.1:55152 - "POST /node/69d0c5a7d2be3e1cf2a5db90 HTTP/1.0" 202 Accepted 2026-04-06 08:03:00,649 - lava_callback - INFO - Starting async job submit for node 69d0c5a7d2be3e1cf2a5db90 2026-04-06 08:03:00,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:00,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5a7d2be3e1cf2a5db90 HTTP/1.1" 200 None 2026-04-06 08:03:00,664 - lava_callback - DEBUG - Processing node 69d0c5a7d2be3e1cf2a5db90: baseline-arm-clabbe 2026-04-06 08:03:00,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c5a7d2be3e1cf2a5db90 2026-04-06 08:03:00,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:00,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5a7d2be3e1cf2a5db90 HTTP/1.1" 200 None 2026-04-06 08:03:00,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:00,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:03:00,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c5a7d2be3e1cf2a5db90 HTTP/1.1" 200 None 2026-04-06 08:03:00,718 - lava_callback - ERROR - Error processing callback for node 69d0c5a7d2be3e1cf2a5db90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:03:40,638 - lava_callback - INFO - Received callback for node 69d0c5cad2be3e1cf2a5dbac INFO: 172.21.0.1:58492 - "POST /node/69d0c5cad2be3e1cf2a5dbac HTTP/1.0" 202 Accepted 2026-04-06 08:03:40,643 - lava_callback - INFO - Starting async job submit for node 69d0c5cad2be3e1cf2a5dbac 2026-04-06 08:03:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5cad2be3e1cf2a5dbac HTTP/1.1" 200 None 2026-04-06 08:03:40,666 - lava_callback - DEBUG - Processing node 69d0c5cad2be3e1cf2a5dbac: baseline-arm-clabbe 2026-04-06 08:03:40,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c5cad2be3e1cf2a5dbac 2026-04-06 08:03:40,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:40,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5cad2be3e1cf2a5dbac HTTP/1.1" 200 None 2026-04-06 08:03:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:40,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:03:40,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:03:40,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c5cad2be3e1cf2a5dbac HTTP/1.1" 200 None 2026-04-06 08:03:40,728 - lava_callback - ERROR - Error processing callback for node 69d0c5cad2be3e1cf2a5dbac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:04:00,728 - lava_callback - INFO - Received callback for node 69d0c5e5d2be3e1cf2a5dbde INFO: 172.21.0.1:39124 - "POST /node/69d0c5e5d2be3e1cf2a5dbde HTTP/1.0" 202 Accepted 2026-04-06 08:04:00,737 - lava_callback - INFO - Starting async job submit for node 69d0c5e5d2be3e1cf2a5dbde 2026-04-06 08:04:00,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:00,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5e5d2be3e1cf2a5dbde HTTP/1.1" 200 None 2026-04-06 08:04:00,759 - lava_callback - DEBUG - Processing node 69d0c5e5d2be3e1cf2a5dbde: baseline-arm-clabbe 2026-04-06 08:04:00,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c5e5d2be3e1cf2a5dbde 2026-04-06 08:04:00,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:00,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c5e5d2be3e1cf2a5dbde HTTP/1.1" 200 None 2026-04-06 08:04:00,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:00,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:04:00,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:00,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c5e5d2be3e1cf2a5dbde HTTP/1.1" 200 None 2026-04-06 08:04:00,818 - lava_callback - ERROR - Error processing callback for node 69d0c5e5d2be3e1cf2a5dbde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:04:40,680 - lava_callback - INFO - Received callback for node 69d0c604d2be3e1cf2a5dc11 INFO: 172.21.0.1:58860 - "POST /node/69d0c604d2be3e1cf2a5dc11 HTTP/1.0" 202 Accepted 2026-04-06 08:04:40,686 - lava_callback - INFO - Starting async job submit for node 69d0c604d2be3e1cf2a5dc11 2026-04-06 08:04:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c604d2be3e1cf2a5dc11 HTTP/1.1" 200 None 2026-04-06 08:04:40,704 - lava_callback - DEBUG - Processing node 69d0c604d2be3e1cf2a5dc11: baseline-arm-clabbe 2026-04-06 08:04:40,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c604d2be3e1cf2a5dc11 2026-04-06 08:04:40,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:40,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c604d2be3e1cf2a5dc11 HTTP/1.1" 200 None 2026-04-06 08:04:40,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:40,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:04:40,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:04:40,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c604d2be3e1cf2a5dc11 HTTP/1.1" 200 None 2026-04-06 08:04:40,776 - lava_callback - ERROR - Error processing callback for node 69d0c604d2be3e1cf2a5dc11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:05:00,711 - lava_callback - INFO - Received callback for node 69d0c627d2be3e1cf2a5dc2b INFO: 172.21.0.1:47700 - "POST /node/69d0c627d2be3e1cf2a5dc2b HTTP/1.0" 202 Accepted 2026-04-06 08:05:00,719 - lava_callback - INFO - Starting async job submit for node 69d0c627d2be3e1cf2a5dc2b 2026-04-06 08:05:00,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:00,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c627d2be3e1cf2a5dc2b HTTP/1.1" 200 None 2026-04-06 08:05:00,736 - lava_callback - DEBUG - Processing node 69d0c627d2be3e1cf2a5dc2b: baseline-arm-clabbe 2026-04-06 08:05:00,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c627d2be3e1cf2a5dc2b 2026-04-06 08:05:00,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:00,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c627d2be3e1cf2a5dc2b HTTP/1.1" 200 None 2026-04-06 08:05:00,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:00,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:05:00,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:00,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c627d2be3e1cf2a5dc2b HTTP/1.1" 200 None 2026-04-06 08:05:00,804 - lava_callback - ERROR - Error processing callback for node 69d0c627d2be3e1cf2a5dc2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:05:40,719 - lava_callback - INFO - Received callback for node 69d0c647d2be3e1cf2a5dc51 INFO: 172.21.0.1:35792 - "POST /node/69d0c647d2be3e1cf2a5dc51 HTTP/1.0" 202 Accepted 2026-04-06 08:05:40,725 - lava_callback - INFO - Starting async job submit for node 69d0c647d2be3e1cf2a5dc51 2026-04-06 08:05:40,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:40,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c647d2be3e1cf2a5dc51 HTTP/1.1" 200 None 2026-04-06 08:05:40,741 - lava_callback - DEBUG - Processing node 69d0c647d2be3e1cf2a5dc51: baseline-arm-clabbe 2026-04-06 08:05:40,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c647d2be3e1cf2a5dc51 2026-04-06 08:05:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c647d2be3e1cf2a5dc51 HTTP/1.1" 200 None 2026-04-06 08:05:40,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:40,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:05:40,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:05:40,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c647d2be3e1cf2a5dc51 HTTP/1.1" 200 None 2026-04-06 08:05:40,794 - lava_callback - ERROR - Error processing callback for node 69d0c647d2be3e1cf2a5dc51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:06:20,750 - lava_callback - INFO - Received callback for node 69d0c66ad2be3e1cf2a5dc6e INFO: 172.21.0.1:51574 - "POST /node/69d0c66ad2be3e1cf2a5dc6e HTTP/1.0" 202 Accepted 2026-04-06 08:06:20,756 - lava_callback - INFO - Starting async job submit for node 69d0c66ad2be3e1cf2a5dc6e 2026-04-06 08:06:20,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:20,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c66ad2be3e1cf2a5dc6e HTTP/1.1" 200 None 2026-04-06 08:06:20,771 - lava_callback - DEBUG - Processing node 69d0c66ad2be3e1cf2a5dc6e: baseline-arm-clabbe 2026-04-06 08:06:20,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c66ad2be3e1cf2a5dc6e 2026-04-06 08:06:20,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:20,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c66ad2be3e1cf2a5dc6e HTTP/1.1" 200 None 2026-04-06 08:06:20,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:06:20,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:20,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c66ad2be3e1cf2a5dc6e HTTP/1.1" 200 None 2026-04-06 08:06:20,834 - lava_callback - ERROR - Error processing callback for node 69d0c66ad2be3e1cf2a5dc6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:06:40,736 - lava_callback - INFO - Received callback for node 69d0c68bd2be3e1cf2a5dc89 INFO: 172.21.0.1:57342 - "POST /node/69d0c68bd2be3e1cf2a5dc89 HTTP/1.0" 202 Accepted 2026-04-06 08:06:40,742 - lava_callback - INFO - Starting async job submit for node 69d0c68bd2be3e1cf2a5dc89 2026-04-06 08:06:40,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:40,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c68bd2be3e1cf2a5dc89 HTTP/1.1" 200 None 2026-04-06 08:06:40,758 - lava_callback - DEBUG - Processing node 69d0c68bd2be3e1cf2a5dc89: baseline-arm-clabbe 2026-04-06 08:06:40,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c68bd2be3e1cf2a5dc89 2026-04-06 08:06:40,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:40,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c68bd2be3e1cf2a5dc89 HTTP/1.1" 200 None 2026-04-06 08:06:40,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:40,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:06:40,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:06:40,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c68bd2be3e1cf2a5dc89 HTTP/1.1" 200 None 2026-04-06 08:06:40,817 - lava_callback - ERROR - Error processing callback for node 69d0c68bd2be3e1cf2a5dc89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:07:20,858 - lava_callback - INFO - Received callback for node 69d0c6acd2be3e1cf2a5dcc9 INFO: 172.21.0.1:52472 - "POST /node/69d0c6acd2be3e1cf2a5dcc9 HTTP/1.0" 202 Accepted 2026-04-06 08:07:20,864 - lava_callback - INFO - Starting async job submit for node 69d0c6acd2be3e1cf2a5dcc9 2026-04-06 08:07:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:07:20,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6acd2be3e1cf2a5dcc9 HTTP/1.1" 200 None 2026-04-06 08:07:20,888 - lava_callback - DEBUG - Processing node 69d0c6acd2be3e1cf2a5dcc9: baseline-arm-clabbe 2026-04-06 08:07:20,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c6acd2be3e1cf2a5dcc9 2026-04-06 08:07:20,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:07:20,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6acd2be3e1cf2a5dcc9 HTTP/1.1" 200 None 2026-04-06 08:07:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:07:20,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:07:20,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:07:20,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c6acd2be3e1cf2a5dcc9 HTTP/1.1" 200 None 2026-04-06 08:07:20,944 - lava_callback - ERROR - Error processing callback for node 69d0c6acd2be3e1cf2a5dcc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:08:00,793 - lava_callback - INFO - Received callback for node 69d0c6cdd2be3e1cf2a5dcea INFO: 172.21.0.1:53978 - "POST /node/69d0c6cdd2be3e1cf2a5dcea HTTP/1.0" 202 Accepted 2026-04-06 08:08:00,799 - lava_callback - INFO - Starting async job submit for node 69d0c6cdd2be3e1cf2a5dcea 2026-04-06 08:08:00,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:00,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6cdd2be3e1cf2a5dcea HTTP/1.1" 200 None 2026-04-06 08:08:00,821 - lava_callback - DEBUG - Processing node 69d0c6cdd2be3e1cf2a5dcea: baseline-arm-clabbe 2026-04-06 08:08:00,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c6cdd2be3e1cf2a5dcea 2026-04-06 08:08:00,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:00,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6cdd2be3e1cf2a5dcea HTTP/1.1" 200 None 2026-04-06 08:08:00,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:00,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-06 08:08:00,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:00,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c6cdd2be3e1cf2a5dcea HTTP/1.1" 200 None 2026-04-06 08:08:00,880 - lava_callback - ERROR - Error processing callback for node 69d0c6cdd2be3e1cf2a5dcea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:08:33,176 - lava_callback - INFO - Received callback for node 69d0c6f2d2be3e1cf2a5dd19 INFO: 172.21.0.1:58638 - "POST /node/69d0c6f2d2be3e1cf2a5dd19 HTTP/1.0" 202 Accepted 2026-04-06 08:08:33,185 - lava_callback - INFO - Starting async job submit for node 69d0c6f2d2be3e1cf2a5dd19 2026-04-06 08:08:33,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:33,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6f2d2be3e1cf2a5dd19 HTTP/1.1" 200 None 2026-04-06 08:08:33,210 - lava_callback - DEBUG - Processing node 69d0c6f2d2be3e1cf2a5dd19: baseline-arm64-baylibre 2026-04-06 08:08:33,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c6f2d2be3e1cf2a5dd19 2026-04-06 08:08:33,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:33,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c6f2d2be3e1cf2a5dd19 HTTP/1.1" 200 None 2026-04-06 08:08:33,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:33,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 08:08:33,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:08:33,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c6f2d2be3e1cf2a5dd19 HTTP/1.1" 200 None 2026-04-06 08:08:33,270 - lava_callback - ERROR - Error processing callback for node 69d0c6f2d2be3e1cf2a5dd19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:09:52,982 - lava_callback - INFO - Received callback for node 69d0c73cd2be3e1cf2a5dd2d INFO: 172.21.0.1:34930 - "POST /node/69d0c73cd2be3e1cf2a5dd2d HTTP/1.0" 202 Accepted 2026-04-06 08:09:52,988 - lava_callback - INFO - Starting async job submit for node 69d0c73cd2be3e1cf2a5dd2d 2026-04-06 08:09:52,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:09:53,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c73cd2be3e1cf2a5dd2d HTTP/1.1" 200 None 2026-04-06 08:09:53,006 - lava_callback - DEBUG - Processing node 69d0c73cd2be3e1cf2a5dd2d: baseline-arm64-baylibre 2026-04-06 08:09:53,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c73cd2be3e1cf2a5dd2d 2026-04-06 08:09:53,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:09:53,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c73cd2be3e1cf2a5dd2d HTTP/1.1" 200 None 2026-04-06 08:09:53,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:09:53,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 08:09:53,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:09:53,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c73cd2be3e1cf2a5dd2d HTTP/1.1" 200 None 2026-04-06 08:09:53,081 - lava_callback - ERROR - Error processing callback for node 69d0c73cd2be3e1cf2a5dd2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:10:53,021 - lava_callback - INFO - Received callback for node 69d0c779d2be3e1cf2a5dd81 INFO: 172.21.0.1:43434 - "POST /node/69d0c779d2be3e1cf2a5dd81 HTTP/1.0" 202 Accepted 2026-04-06 08:10:53,027 - lava_callback - INFO - Starting async job submit for node 69d0c779d2be3e1cf2a5dd81 2026-04-06 08:10:53,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:10:53,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c779d2be3e1cf2a5dd81 HTTP/1.1" 200 None 2026-04-06 08:10:53,045 - lava_callback - DEBUG - Processing node 69d0c779d2be3e1cf2a5dd81: baseline-arm64-baylibre 2026-04-06 08:10:53,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c779d2be3e1cf2a5dd81 2026-04-06 08:10:53,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:10:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c779d2be3e1cf2a5dd81 HTTP/1.1" 200 None 2026-04-06 08:10:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:10:53,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 08:10:53,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:10:53,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c779d2be3e1cf2a5dd81 HTTP/1.1" 200 None 2026-04-06 08:10:53,100 - lava_callback - ERROR - Error processing callback for node 69d0c779d2be3e1cf2a5dd81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:11:53,133 - lava_callback - INFO - Received callback for node 69d0c7c3d2be3e1cf2a5ddae INFO: 172.21.0.1:57420 - "POST /node/69d0c7c3d2be3e1cf2a5ddae HTTP/1.0" 202 Accepted 2026-04-06 08:11:53,139 - lava_callback - INFO - Starting async job submit for node 69d0c7c3d2be3e1cf2a5ddae 2026-04-06 08:11:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:11:53,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c7c3d2be3e1cf2a5ddae HTTP/1.1" 200 None 2026-04-06 08:11:53,156 - lava_callback - DEBUG - Processing node 69d0c7c3d2be3e1cf2a5ddae: baseline-arm64-baylibre 2026-04-06 08:11:53,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0c7c3d2be3e1cf2a5ddae 2026-04-06 08:11:53,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:11:53,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c7c3d2be3e1cf2a5ddae HTTP/1.1" 200 None 2026-04-06 08:11:53,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:11:53,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-06 08:11:53,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:11:53,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0c7c3d2be3e1cf2a5ddae HTTP/1.1" 200 None 2026-04-06 08:11:53,223 - lava_callback - ERROR - Error processing callback for node 69d0c7c3d2be3e1cf2a5ddae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]