INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:42:53,149 - lava_callback - INFO - Received callback for node 69d5a45d34043de23ba13f51 2026-04-08 00:42:53,163 - lava_callback - INFO - Starting async job submit for node 69d5a45d34043de23ba13f51 INFO: 172.20.0.1:58638 - "POST /node/69d5a45d34043de23ba13f51 HTTP/1.0" 202 Accepted 2026-04-08 00:42:53,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:53,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45d34043de23ba13f51 HTTP/1.1" 200 None 2026-04-08 00:42:53,236 - lava_callback - DEBUG - Processing node 69d5a45d34043de23ba13f51: baseline-x86 2026-04-08 00:42:53,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:53,629 - lava_callback - INFO - Received callback for node 69d5a45a34043de23ba13f48 2026-04-08 00:42:53,639 - lava_callback - INFO - Starting async job submit for node 69d5a45a34043de23ba13f48 INFO: 172.20.0.1:58654 - "POST /node/69d5a45a34043de23ba13f48 HTTP/1.0" 202 Accepted 2026-04-08 00:42:53,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:53,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45a34043de23ba13f48 HTTP/1.1" 200 None 2026-04-08 00:42:53,695 - lava_callback - DEBUG - Processing node 69d5a45a34043de23ba13f48: baseline-x86 2026-04-08 00:42:53,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:53,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f51/log.txt.gz 2026-04-08 00:42:53,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:54,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:54,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:54,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45a34043de23ba13f48/log.txt.gz 2026-04-08 00:42:54,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:54,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f51/lava-logs.yaml 2026-04-08 00:42:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:54,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:54,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:54,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f51/lava_callback.json.gz 2026-04-08 00:42:54,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:54,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:54,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45a34043de23ba13f48/lava-logs.yaml 2026-04-08 00:42:54,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:42:54,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45d34043de23ba13f51 HTTP/1.1" 200 None 2026-04-08 00:42:54,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ebc34043de23ba13b71 HTTP/1.1" 200 None 2026-04-08 00:42:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:54,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a45d34043de23ba13f51 HTTP/1.1" 200 None 2026-04-08 00:42:55,020 - lava_callback - INFO - Completed processing callback for node 69d5a45d34043de23ba13f51 2026-04-08 00:42:55,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:42:55,466 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45a34043de23ba13f48/lava_callback.json.gz 2026-04-08 00:42:55,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:55,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45a34043de23ba13f48 HTTP/1.1" 200 None 2026-04-08 00:42:55,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:55,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ebc34043de23ba13b71 HTTP/1.1" 200 None 2026-04-08 00:42:55,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:42:55,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a45a34043de23ba13f48 HTTP/1.1" 200 None 2026-04-08 00:42:55,629 - lava_callback - INFO - Completed processing callback for node 69d5a45a34043de23ba13f48 INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51572 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:43:25,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:25,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45964 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:43:44,508 - lava_callback - INFO - Received callback for node 69d5a4ab34043de23ba13f83 INFO: 172.20.0.1:46354 - "POST /node/69d5a4ab34043de23ba13f83 HTTP/1.0" 202 Accepted 2026-04-08 00:43:44,514 - lava_callback - INFO - Starting async job submit for node 69d5a4ab34043de23ba13f83 2026-04-08 00:43:44,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:44,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ab34043de23ba13f83 HTTP/1.1" 200 None 2026-04-08 00:43:44,533 - lava_callback - DEBUG - Processing node 69d5a4ab34043de23ba13f83: baseline-arm 2026-04-08 00:43:44,538 - lava_callback - WARNING - Failed to upload log 2026-04-08 00:43:44,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:43:44,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:43:44,745 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ab34043de23ba13f83/lava-logs.yaml 2026-04-08 00:43:44,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:43:44,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:43:44,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ab34043de23ba13f83/lava_callback.json.gz 2026-04-08 00:43:44,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:44,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ab34043de23ba13f83 HTTP/1.1" 200 None 2026-04-08 00:43:44,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:44,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:43:44,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:45,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ab34043de23ba13f83 HTTP/1.1" 200 None 2026-04-08 00:43:45,059 - lava_callback - INFO - Completed processing callback for node 69d5a4ab34043de23ba13f83 2026-04-08 00:43:45,812 - lava_callback - INFO - Received callback for node 69d301b113dd9a95098938f7 INFO: 172.20.0.1:46360 - "POST /node/69d301b113dd9a95098938f7 HTTP/1.0" 202 Accepted 2026-04-08 00:43:45,818 - lava_callback - INFO - Starting async job submit for node 69d301b113dd9a95098938f7 2026-04-08 00:43:45,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:45,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b113dd9a95098938f7 HTTP/1.1" 200 None 2026-04-08 00:43:45,835 - lava_callback - DEBUG - Processing node 69d301b113dd9a95098938f7: baseline-arm-baylibre 2026-04-08 00:43:45,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b113dd9a95098938f7 2026-04-08 00:43:45,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:45,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b113dd9a95098938f7 HTTP/1.1" 200 None 2026-04-08 00:43:45,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:45,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b113dd9a95098938f7 HTTP/1.1" 200 None 2026-04-08 00:43:45,904 - lava_callback - ERROR - Error processing callback for node 69d301b113dd9a95098938f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:46,505 - lava_callback - INFO - Received callback for node 69d301b213dd9a95098938fa INFO: 172.20.0.1:46372 - "POST /node/69d301b213dd9a95098938fa HTTP/1.0" 202 Accepted 2026-04-08 00:43:46,511 - lava_callback - INFO - Starting async job submit for node 69d301b213dd9a95098938fa 2026-04-08 00:43:46,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:43:46,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b213dd9a95098938fa HTTP/1.1" 200 None 2026-04-08 00:43:46,531 - lava_callback - DEBUG - Processing node 69d301b213dd9a95098938fa: baseline-arm-baylibre 2026-04-08 00:43:46,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b213dd9a95098938fa 2026-04-08 00:43:46,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:46,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b213dd9a95098938fa HTTP/1.1" 200 None 2026-04-08 00:43:46,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:46,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:46,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:46,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b213dd9a95098938fa HTTP/1.1" 200 None 2026-04-08 00:43:46,593 - lava_callback - ERROR - Error processing callback for node 69d301b213dd9a95098938fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:47,170 - lava_callback - INFO - Received callback for node 69d301b313dd9a95098938fd INFO: 172.20.0.1:46392 - "POST /node/69d301b313dd9a95098938fd HTTP/1.0" 202 Accepted 2026-04-08 00:43:47,176 - lava_callback - INFO - Starting async job submit for node 69d301b313dd9a95098938fd 2026-04-08 00:43:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b313dd9a95098938fd HTTP/1.1" 200 None 2026-04-08 00:43:47,192 - lava_callback - DEBUG - Processing node 69d301b313dd9a95098938fd: baseline-arm-baylibre 2026-04-08 00:43:47,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b313dd9a95098938fd 2026-04-08 00:43:47,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b313dd9a95098938fd HTTP/1.1" 200 None 2026-04-08 00:43:47,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:47,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b313dd9a95098938fd HTTP/1.1" 200 None 2026-04-08 00:43:47,250 - lava_callback - ERROR - Error processing callback for node 69d301b313dd9a95098938fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:47,818 - lava_callback - INFO - Received callback for node 69d301b513dd9a9509893900 INFO: 172.20.0.1:46398 - "POST /node/69d301b513dd9a9509893900 HTTP/1.0" 202 Accepted 2026-04-08 00:43:47,824 - lava_callback - INFO - Starting async job submit for node 69d301b513dd9a9509893900 2026-04-08 00:43:47,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b513dd9a9509893900 HTTP/1.1" 200 None 2026-04-08 00:43:47,843 - lava_callback - DEBUG - Processing node 69d301b513dd9a9509893900: baseline-arm-baylibre 2026-04-08 00:43:47,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b513dd9a9509893900 2026-04-08 00:43:47,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b513dd9a9509893900 HTTP/1.1" 200 None 2026-04-08 00:43:47,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:47,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:47,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b513dd9a9509893900 HTTP/1.1" 200 None 2026-04-08 00:43:47,896 - lava_callback - ERROR - Error processing callback for node 69d301b513dd9a9509893900: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:48,467 - lava_callback - INFO - Received callback for node 69d301b813dd9a9509893910 INFO: 172.20.0.1:46410 - "POST /node/69d301b813dd9a9509893910 HTTP/1.0" 202 Accepted 2026-04-08 00:43:48,477 - lava_callback - INFO - Starting async job submit for node 69d301b813dd9a9509893910 2026-04-08 00:43:48,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:48,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b813dd9a9509893910 HTTP/1.1" 200 None 2026-04-08 00:43:48,504 - lava_callback - DEBUG - Processing node 69d301b813dd9a9509893910: baseline-arm-baylibre 2026-04-08 00:43:48,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b813dd9a9509893910 2026-04-08 00:43:48,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:48,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b813dd9a9509893910 HTTP/1.1" 200 None 2026-04-08 00:43:48,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:48,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:48,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:48,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b813dd9a9509893910 HTTP/1.1" 200 None 2026-04-08 00:43:48,616 - lava_callback - ERROR - Error processing callback for node 69d301b813dd9a9509893910: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:49,162 - lava_callback - INFO - Received callback for node 69d301b913dd9a9509893913 INFO: 172.20.0.1:46424 - "POST /node/69d301b913dd9a9509893913 HTTP/1.0" 202 Accepted 2026-04-08 00:43:49,168 - lava_callback - INFO - Starting async job submit for node 69d301b913dd9a9509893913 2026-04-08 00:43:49,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b913dd9a9509893913 HTTP/1.1" 200 None 2026-04-08 00:43:49,185 - lava_callback - DEBUG - Processing node 69d301b913dd9a9509893913: baseline-arm-baylibre 2026-04-08 00:43:49,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301b913dd9a9509893913 2026-04-08 00:43:49,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301b913dd9a9509893913 HTTP/1.1" 200 None 2026-04-08 00:43:49,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:49,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301b913dd9a9509893913 HTTP/1.1" 200 None 2026-04-08 00:43:49,242 - lava_callback - ERROR - Error processing callback for node 69d301b913dd9a9509893913: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:49,670 - lava_callback - INFO - Received callback for node 69d301c013dd9a9509893929 INFO: 172.20.0.1:46428 - "POST /node/69d301c013dd9a9509893929 HTTP/1.0" 202 Accepted 2026-04-08 00:43:49,676 - lava_callback - INFO - Starting async job submit for node 69d301c013dd9a9509893929 2026-04-08 00:43:49,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c013dd9a9509893929 HTTP/1.1" 200 None 2026-04-08 00:43:49,691 - lava_callback - DEBUG - Processing node 69d301c013dd9a9509893929: baseline-arm-clabbe 2026-04-08 00:43:49,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c013dd9a9509893929 2026-04-08 00:43:49,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c013dd9a9509893929 HTTP/1.1" 200 None 2026-04-08 00:43:49,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:49,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:49,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c013dd9a9509893929 HTTP/1.1" 200 None 2026-04-08 00:43:49,752 - lava_callback - ERROR - Error processing callback for node 69d301c013dd9a9509893929: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:50,352 - lava_callback - INFO - Received callback for node 69d301c213dd9a950989392f INFO: 172.20.0.1:41966 - "POST /node/69d301c213dd9a950989392f HTTP/1.0" 202 Accepted 2026-04-08 00:43:50,358 - lava_callback - INFO - Starting async job submit for node 69d301c213dd9a950989392f 2026-04-08 00:43:50,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:50,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c213dd9a950989392f HTTP/1.1" 200 None 2026-04-08 00:43:50,374 - lava_callback - DEBUG - Processing node 69d301c213dd9a950989392f: baseline-arm-clabbe 2026-04-08 00:43:50,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c213dd9a950989392f 2026-04-08 00:43:50,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:50,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c213dd9a950989392f HTTP/1.1" 200 None 2026-04-08 00:43:50,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:50,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:50,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:50,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c213dd9a950989392f HTTP/1.1" 200 None 2026-04-08 00:43:50,424 - lava_callback - ERROR - Error processing callback for node 69d301c213dd9a950989392f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:51,085 - lava_callback - INFO - Received callback for node 69d301c313dd9a9509893933 INFO: 172.20.0.1:41982 - "POST /node/69d301c313dd9a9509893933 HTTP/1.0" 202 Accepted 2026-04-08 00:43:51,094 - lava_callback - INFO - Starting async job submit for node 69d301c313dd9a9509893933 2026-04-08 00:43:51,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c313dd9a9509893933 HTTP/1.1" 200 None 2026-04-08 00:43:51,119 - lava_callback - DEBUG - Processing node 69d301c313dd9a9509893933: baseline-arm-clabbe 2026-04-08 00:43:51,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c313dd9a9509893933 2026-04-08 00:43:51,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c313dd9a9509893933 HTTP/1.1" 200 None 2026-04-08 00:43:51,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:51,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c313dd9a9509893933 HTTP/1.1" 200 None 2026-04-08 00:43:51,212 - lava_callback - ERROR - Error processing callback for node 69d301c313dd9a9509893933: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:51,415 - lava_callback - INFO - Received callback for node 69d5a45d34043de23ba13f4e INFO: 172.20.0.1:41988 - "POST /node/69d5a45d34043de23ba13f4e HTTP/1.0" 202 Accepted 2026-04-08 00:43:51,424 - lava_callback - INFO - Starting async job submit for node 69d5a45d34043de23ba13f4e 2026-04-08 00:43:51,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45d34043de23ba13f4e HTTP/1.1" 200 None 2026-04-08 00:43:51,466 - lava_callback - DEBUG - Processing node 69d5a45d34043de23ba13f4e: baseline-x86 2026-04-08 00:43:51,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:43:51,780 - lava_callback - INFO - Received callback for node 69d301c413dd9a9509893936 INFO: 172.20.0.1:42000 - "POST /node/69d301c413dd9a9509893936 HTTP/1.0" 202 Accepted 2026-04-08 00:43:51,794 - lava_callback - INFO - Starting async job submit for node 69d301c413dd9a9509893936 2026-04-08 00:43:51,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c413dd9a9509893936 HTTP/1.1" 200 None 2026-04-08 00:43:51,835 - lava_callback - DEBUG - Processing node 69d301c413dd9a9509893936: baseline-arm-clabbe 2026-04-08 00:43:51,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c413dd9a9509893936 2026-04-08 00:43:51,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c413dd9a9509893936 HTTP/1.1" 200 None 2026-04-08 00:43:51,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:43:51,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:51,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c413dd9a9509893936 HTTP/1.1" 200 None 2026-04-08 00:43:51,902 - lava_callback - ERROR - Error processing callback for node 69d301c413dd9a9509893936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:43:51,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:43:51,959 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f4e/log.txt.gz 2026-04-08 00:43:52,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:43:52,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:43:52,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f4e/lava-logs.yaml 2026-04-08 00:43:52,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:43:52,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:43:52,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45d34043de23ba13f4e/lava_callback.json.gz 2026-04-08 00:43:52,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:52,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45d34043de23ba13f4e HTTP/1.1" 200 None 2026-04-08 00:43:52,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:52,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ebc34043de23ba13b71 HTTP/1.1" 200 None 2026-04-08 00:43:52,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:52,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a45d34043de23ba13f4e HTTP/1.1" 200 None 2026-04-08 00:43:52,643 - lava_callback - INFO - Completed processing callback for node 69d5a45d34043de23ba13f4e 2026-04-08 00:43:55,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:43:55,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:44:00,249 - lava_callback - INFO - Received callback for node 69d5a45f34043de23ba13f54 INFO: 172.20.0.1:46764 - "POST /node/69d5a45f34043de23ba13f54 HTTP/1.0" 202 Accepted 2026-04-08 00:44:00,257 - lava_callback - INFO - Starting async job submit for node 69d5a45f34043de23ba13f54 2026-04-08 00:44:00,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:00,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45f34043de23ba13f54 HTTP/1.1" 200 None 2026-04-08 00:44:00,290 - lava_callback - DEBUG - Processing node 69d5a45f34043de23ba13f54: baseline-x86 2026-04-08 00:44:00,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:00,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:00,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45f34043de23ba13f54/log.txt.gz 2026-04-08 00:44:01,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:01,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:01,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45f34043de23ba13f54/lava-logs.yaml 2026-04-08 00:44:01,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:01,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:01,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45f34043de23ba13f54/lava_callback.json.gz 2026-04-08 00:44:01,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:01,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45f34043de23ba13f54 HTTP/1.1" 200 None 2026-04-08 00:44:01,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:01,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ebc34043de23ba13b71 HTTP/1.1" 200 None 2026-04-08 00:44:01,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:01,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a45f34043de23ba13f54 HTTP/1.1" 200 None 2026-04-08 00:44:01,574 - lava_callback - INFO - Completed processing callback for node 69d5a45f34043de23ba13f54 2026-04-08 00:44:03,551 - lava_callback - INFO - Received callback for node 69d5a4ac34043de23ba13f86 INFO: 172.20.0.1:46776 - "POST /node/69d5a4ac34043de23ba13f86 HTTP/1.0" 202 Accepted 2026-04-08 00:44:03,597 - lava_callback - INFO - Starting async job submit for node 69d5a4ac34043de23ba13f86 2026-04-08 00:44:03,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:03,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ac34043de23ba13f86 HTTP/1.1" 200 None 2026-04-08 00:44:03,631 - lava_callback - DEBUG - Processing node 69d5a4ac34043de23ba13f86: baseline-arm 2026-04-08 00:44:03,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:03,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:03,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ac34043de23ba13f86/log.txt.gz 2026-04-08 00:44:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:04,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:04,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ac34043de23ba13f86/lava-logs.yaml 2026-04-08 00:44:04,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:04,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:04,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ac34043de23ba13f86/lava_callback.json.gz 2026-04-08 00:44:04,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:04,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ac34043de23ba13f86 HTTP/1.1" 200 None 2026-04-08 00:44:04,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:04,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:44:04,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:04,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ac34043de23ba13f86 HTTP/1.1" 200 None 2026-04-08 00:44:04,321 - lava_callback - INFO - Completed processing callback for node 69d5a4ac34043de23ba13f86 INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:44:09,607 - lava_callback - INFO - Received callback for node 69d301c413dd9a950989393b INFO: 172.20.0.1:46802 - "POST /node/69d301c413dd9a950989393b HTTP/1.0" 202 Accepted 2026-04-08 00:44:09,612 - lava_callback - INFO - Starting async job submit for node 69d301c413dd9a950989393b 2026-04-08 00:44:09,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:09,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c413dd9a950989393b HTTP/1.1" 200 None 2026-04-08 00:44:09,628 - lava_callback - DEBUG - Processing node 69d301c413dd9a950989393b: baseline-arm-clabbe 2026-04-08 00:44:09,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c413dd9a950989393b 2026-04-08 00:44:09,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:09,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c413dd9a950989393b HTTP/1.1" 200 None 2026-04-08 00:44:09,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:09,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:44:09,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:09,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c413dd9a950989393b HTTP/1.1" 200 None 2026-04-08 00:44:09,707 - lava_callback - ERROR - Error processing callback for node 69d301c413dd9a950989393b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:44:10,297 - lava_callback - INFO - Received callback for node 69d301c513dd9a9509893940 INFO: 172.20.0.1:47582 - "POST /node/69d301c513dd9a9509893940 HTTP/1.0" 202 Accepted 2026-04-08 00:44:10,302 - lava_callback - INFO - Starting async job submit for node 69d301c513dd9a9509893940 2026-04-08 00:44:10,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:10,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c513dd9a9509893940 HTTP/1.1" 200 None 2026-04-08 00:44:10,324 - lava_callback - DEBUG - Processing node 69d301c513dd9a9509893940: baseline-arm-clabbe 2026-04-08 00:44:10,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c513dd9a9509893940 2026-04-08 00:44:10,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:10,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c513dd9a9509893940 HTTP/1.1" 200 None 2026-04-08 00:44:10,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:10,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:44:10,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:10,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c513dd9a9509893940 HTTP/1.1" 200 None 2026-04-08 00:44:10,375 - lava_callback - ERROR - Error processing callback for node 69d301c513dd9a9509893940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:44:10,977 - lava_callback - INFO - Received callback for node 69d301c613dd9a9509893945 INFO: 172.20.0.1:47584 - "POST /node/69d301c613dd9a9509893945 HTTP/1.0" 202 Accepted 2026-04-08 00:44:10,983 - lava_callback - INFO - Starting async job submit for node 69d301c613dd9a9509893945 2026-04-08 00:44:10,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:10,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c613dd9a9509893945 HTTP/1.1" 200 None 2026-04-08 00:44:10,999 - lava_callback - DEBUG - Processing node 69d301c613dd9a9509893945: baseline-arm-clabbe 2026-04-08 00:44:10,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c613dd9a9509893945 2026-04-08 00:44:11,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c613dd9a9509893945 HTTP/1.1" 200 None 2026-04-08 00:44:11,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:44:11,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c613dd9a9509893945 HTTP/1.1" 200 None 2026-04-08 00:44:11,059 - lava_callback - ERROR - Error processing callback for node 69d301c613dd9a9509893945: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:44:11,656 - lava_callback - INFO - Received callback for node 69d301c713dd9a950989394c INFO: 172.20.0.1:47598 - "POST /node/69d301c713dd9a950989394c HTTP/1.0" 202 Accepted 2026-04-08 00:44:11,662 - lava_callback - INFO - Starting async job submit for node 69d301c713dd9a950989394c 2026-04-08 00:44:11,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c713dd9a950989394c HTTP/1.1" 200 None 2026-04-08 00:44:11,677 - lava_callback - DEBUG - Processing node 69d301c713dd9a950989394c: baseline-arm-clabbe 2026-04-08 00:44:11,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c713dd9a950989394c 2026-04-08 00:44:11,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c713dd9a950989394c HTTP/1.1" 200 None 2026-04-08 00:44:11,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:44:11,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:11,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c713dd9a950989394c HTTP/1.1" 200 None 2026-04-08 00:44:11,745 - lava_callback - ERROR - Error processing callback for node 69d301c713dd9a950989394c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:44:12,168 - lava_callback - INFO - Received callback for node 69d5a45c34043de23ba13f4b INFO: 172.20.0.1:47602 - "POST /node/69d5a45c34043de23ba13f4b HTTP/1.0" 202 Accepted 2026-04-08 00:44:12,175 - lava_callback - INFO - Starting async job submit for node 69d5a45c34043de23ba13f4b 2026-04-08 00:44:12,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:12,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45c34043de23ba13f4b HTTP/1.1" 200 None 2026-04-08 00:44:12,220 - lava_callback - DEBUG - Processing node 69d5a45c34043de23ba13f4b: baseline-x86 2026-04-08 00:44:12,350 - lava_callback - INFO - Received callback for node 69d301c813dd9a9509893951 INFO: 172.20.0.1:47606 - "POST /node/69d301c813dd9a9509893951 HTTP/1.0" 202 Accepted 2026-04-08 00:44:12,372 - lava_callback - INFO - Starting async job submit for node 69d301c813dd9a9509893951 2026-04-08 00:44:12,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:12,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c813dd9a9509893951 HTTP/1.1" 200 None 2026-04-08 00:44:12,493 - lava_callback - DEBUG - Processing node 69d301c813dd9a9509893951: baseline-arm-clabbe 2026-04-08 00:44:12,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d301c813dd9a9509893951 2026-04-08 00:44:12,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:12,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d301c813dd9a9509893951 HTTP/1.1" 200 None 2026-04-08 00:44:12,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:12,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:12,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 00:44:12,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:12,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d301c813dd9a9509893951 HTTP/1.1" 200 None 2026-04-08 00:44:12,668 - lava_callback - ERROR - Error processing callback for node 69d301c813dd9a9509893951: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:44:12,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:12,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45c34043de23ba13f4b/log.txt.gz 2026-04-08 00:44:13,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:13,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:13,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45c34043de23ba13f4b/lava-logs.yaml 2026-04-08 00:44:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:13,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:13,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d5a45c34043de23ba13f4b/lava_callback.json.gz 2026-04-08 00:44:13,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:13,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a45c34043de23ba13f4b HTTP/1.1" 200 None 2026-04-08 00:44:13,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:13,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ebc34043de23ba13b71 HTTP/1.1" 200 None 2026-04-08 00:44:13,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:13,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a45c34043de23ba13f4b HTTP/1.1" 200 None 2026-04-08 00:44:13,526 - lava_callback - INFO - Completed processing callback for node 69d5a45c34043de23ba13f4b INFO: 172.20.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47626 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:44:23,276 - lava_callback - INFO - Received callback for node 69d5a4af34043de23ba13f95 INFO: 172.20.0.1:53000 - "POST /node/69d5a4af34043de23ba13f95 HTTP/1.0" 202 Accepted 2026-04-08 00:44:23,322 - lava_callback - INFO - Starting async job submit for node 69d5a4af34043de23ba13f95 2026-04-08 00:44:23,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:23,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4af34043de23ba13f95 HTTP/1.1" 200 None 2026-04-08 00:44:23,355 - lava_callback - DEBUG - Processing node 69d5a4af34043de23ba13f95: baseline-arm 2026-04-08 00:44:23,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:23,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:23,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4af34043de23ba13f95/log.txt.gz 2026-04-08 00:44:23,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:23,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:23,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4af34043de23ba13f95/lava-logs.yaml 2026-04-08 00:44:23,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:24,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:24,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4af34043de23ba13f95/lava_callback.json.gz 2026-04-08 00:44:24,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:24,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4af34043de23ba13f95 HTTP/1.1" 200 None 2026-04-08 00:44:24,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:24,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:44:24,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:24,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4af34043de23ba13f95 HTTP/1.1" 200 None 2026-04-08 00:44:24,157 - lava_callback - INFO - Completed processing callback for node 69d5a4af34043de23ba13f95 2026-04-08 00:44:25,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:25,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55636 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:44:44,058 - lava_callback - INFO - Received callback for node 69d5a4aa34043de23ba13f80 INFO: 172.20.0.1:52970 - "POST /node/69d5a4aa34043de23ba13f80 HTTP/1.0" 202 Accepted 2026-04-08 00:44:44,064 - lava_callback - INFO - Starting async job submit for node 69d5a4aa34043de23ba13f80 2026-04-08 00:44:44,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:44,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4aa34043de23ba13f80 HTTP/1.1" 200 None 2026-04-08 00:44:44,101 - lava_callback - DEBUG - Processing node 69d5a4aa34043de23ba13f80: baseline-arm 2026-04-08 00:44:44,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:44,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:44,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4aa34043de23ba13f80/log.txt.gz 2026-04-08 00:44:44,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:44,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:44,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4aa34043de23ba13f80/lava-logs.yaml 2026-04-08 00:44:44,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:44:44,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:44:44,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4aa34043de23ba13f80/lava_callback.json.gz 2026-04-08 00:44:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:44,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4aa34043de23ba13f80 HTTP/1.1" 200 None 2026-04-08 00:44:44,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:44,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:44:44,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:44,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4aa34043de23ba13f80 HTTP/1.1" 200 None 2026-04-08 00:44:44,927 - lava_callback - INFO - Completed processing callback for node 69d5a4aa34043de23ba13f80 INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:44:55,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:44:55,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:00,076 - lava_callback - INFO - Received callback for node 69d5a4d034043de23ba14039 INFO: 172.20.0.1:53400 - "POST /node/69d5a4d034043de23ba14039 HTTP/1.0" 202 Accepted 2026-04-08 00:45:00,125 - lava_callback - INFO - Starting async job submit for node 69d5a4d034043de23ba14039 2026-04-08 00:45:00,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:00,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4d034043de23ba14039 HTTP/1.1" 200 None 2026-04-08 00:45:00,161 - lava_callback - DEBUG - Processing node 69d5a4d034043de23ba14039: baseline-arm-pengutronix 2026-04-08 00:45:00,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:00,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:00,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4d034043de23ba14039/log.txt.gz 2026-04-08 00:45:00,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:00,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:00,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4d034043de23ba14039/lava-logs.yaml 2026-04-08 00:45:00,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:00,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:00,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4d034043de23ba14039/lava_callback.json.gz 2026-04-08 00:45:00,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:00,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4d034043de23ba14039 HTTP/1.1" 200 None 2026-04-08 00:45:00,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:00,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:00,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4d034043de23ba14039 HTTP/1.1" 200 None 2026-04-08 00:45:00,901 - lava_callback - INFO - Completed processing callback for node 69d5a4d034043de23ba14039 2026-04-08 00:45:03,657 - lava_callback - INFO - Received callback for node 69d5a4cd34043de23ba14033 INFO: 172.20.0.1:53408 - "POST /node/69d5a4cd34043de23ba14033 HTTP/1.0" 202 Accepted 2026-04-08 00:45:03,663 - lava_callback - INFO - Starting async job submit for node 69d5a4cd34043de23ba14033 2026-04-08 00:45:03,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:03,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4cd34043de23ba14033 HTTP/1.1" 200 None 2026-04-08 00:45:03,698 - lava_callback - DEBUG - Processing node 69d5a4cd34043de23ba14033: baseline-arm-pengutronix 2026-04-08 00:45:03,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:04,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:04,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4cd34043de23ba14033/log.txt.gz 2026-04-08 00:45:04,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:04,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:04,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4cd34043de23ba14033/lava-logs.yaml 2026-04-08 00:45:04,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:04,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:04,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4cd34043de23ba14033/lava_callback.json.gz 2026-04-08 00:45:04,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:04,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4cd34043de23ba14033 HTTP/1.1" 200 None 2026-04-08 00:45:04,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:04,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:04,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:04,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4cd34043de23ba14033 HTTP/1.1" 200 None 2026-04-08 00:45:04,580 - lava_callback - INFO - Completed processing callback for node 69d5a4cd34043de23ba14033 2026-04-08 00:45:06,036 - lava_callback - INFO - Received callback for node 69d5a4ce34043de23ba14036 INFO: 172.20.0.1:53422 - "POST /node/69d5a4ce34043de23ba14036 HTTP/1.0" 202 Accepted 2026-04-08 00:45:06,045 - lava_callback - INFO - Starting async job submit for node 69d5a4ce34043de23ba14036 2026-04-08 00:45:06,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:06,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ce34043de23ba14036 HTTP/1.1" 200 None 2026-04-08 00:45:06,103 - lava_callback - DEBUG - Processing node 69d5a4ce34043de23ba14036: baseline-arm-pengutronix 2026-04-08 00:45:06,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:06,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:06,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4ce34043de23ba14036/log.txt.gz 2026-04-08 00:45:06,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:06,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:06,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4ce34043de23ba14036/lava-logs.yaml 2026-04-08 00:45:06,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:06,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:06,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d5a4ce34043de23ba14036/lava_callback.json.gz 2026-04-08 00:45:06,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:06,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ce34043de23ba14036 HTTP/1.1" 200 None 2026-04-08 00:45:06,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:06,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:06,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:06,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ce34043de23ba14036 HTTP/1.1" 200 None 2026-04-08 00:45:06,895 - lava_callback - INFO - Completed processing callback for node 69d5a4ce34043de23ba14036 INFO: 172.20.0.1:60416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60422 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:25,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:25,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57574 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:26,866 - lava_callback - INFO - Received callback for node 69d5a4c834043de23ba14021 INFO: 172.20.0.1:57588 - "POST /node/69d5a4c834043de23ba14021 HTTP/1.0" 202 Accepted 2026-04-08 00:45:26,873 - lava_callback - INFO - Starting async job submit for node 69d5a4c834043de23ba14021 2026-04-08 00:45:26,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:26,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4c834043de23ba14021 HTTP/1.1" 200 None 2026-04-08 00:45:26,918 - lava_callback - DEBUG - Processing node 69d5a4c834043de23ba14021: baseline-arm-kontron 2026-04-08 00:45:27,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:27,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:27,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4c834043de23ba14021/log.txt.gz 2026-04-08 00:45:27,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:27,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:27,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4c834043de23ba14021/lava-logs.yaml 2026-04-08 00:45:27,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:27,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:27,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4c834043de23ba14021/lava_callback.json.gz 2026-04-08 00:45:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:27,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4c834043de23ba14021 HTTP/1.1" 200 None 2026-04-08 00:45:27,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:27,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:27,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:27,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4c834043de23ba14021 HTTP/1.1" 200 None 2026-04-08 00:45:27,742 - lava_callback - INFO - Completed processing callback for node 69d5a4c834043de23ba14021 2026-04-08 00:45:28,120 - lava_callback - INFO - Received callback for node 69d5a4ca34043de23ba14024 INFO: 172.20.0.1:57598 - "POST /node/69d5a4ca34043de23ba14024 HTTP/1.0" 202 Accepted 2026-04-08 00:45:28,126 - lava_callback - INFO - Starting async job submit for node 69d5a4ca34043de23ba14024 2026-04-08 00:45:28,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:28,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ca34043de23ba14024 HTTP/1.1" 200 None 2026-04-08 00:45:28,173 - lava_callback - DEBUG - Processing node 69d5a4ca34043de23ba14024: baseline-arm-kontron 2026-04-08 00:45:28,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:28,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:28,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4ca34043de23ba14024/log.txt.gz 2026-04-08 00:45:28,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:28,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:28,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4ca34043de23ba14024/lava-logs.yaml 2026-04-08 00:45:28,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:28,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:28,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d5a4ca34043de23ba14024/lava_callback.json.gz 2026-04-08 00:45:29,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:29,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ca34043de23ba14024 HTTP/1.1" 200 None 2026-04-08 00:45:29,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:29,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:29,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:29,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ca34043de23ba14024 HTTP/1.1" 200 None 2026-04-08 00:45:29,065 - lava_callback - INFO - Completed processing callback for node 69d5a4ca34043de23ba14024 2026-04-08 00:45:31,357 - lava_callback - INFO - Received callback for node 69d5a4ba34043de23ba13faf INFO: 172.20.0.1:40602 - "POST /node/69d5a4ba34043de23ba13faf HTTP/1.0" 202 Accepted 2026-04-08 00:45:31,363 - lava_callback - INFO - Starting async job submit for node 69d5a4ba34043de23ba13faf 2026-04-08 00:45:31,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:31,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ba34043de23ba13faf HTTP/1.1" 200 None 2026-04-08 00:45:31,402 - lava_callback - DEBUG - Processing node 69d5a4ba34043de23ba13faf: baseline-arm-broonie 2026-04-08 00:45:31,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:31,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:31,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a4ba34043de23ba13faf/log.txt.gz 2026-04-08 00:45:31,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:32,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:32,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a4ba34043de23ba13faf/lava-logs.yaml 2026-04-08 00:45:32,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:32,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:32,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a4ba34043de23ba13faf/lava_callback.json.gz 2026-04-08 00:45:32,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:32,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ba34043de23ba13faf HTTP/1.1" 200 None 2026-04-08 00:45:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:32,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:32,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:32,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ba34043de23ba13faf HTTP/1.1" 200 None 2026-04-08 00:45:32,247 - lava_callback - INFO - Completed processing callback for node 69d5a4ba34043de23ba13faf INFO: 172.20.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51744 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:45:50,627 - lava_callback - INFO - Received callback for node 69d5a4ae34043de23ba13f92 INFO: 172.20.0.1:44588 - "POST /node/69d5a4ae34043de23ba13f92 HTTP/1.0" 202 Accepted 2026-04-08 00:45:50,634 - lava_callback - INFO - Starting async job submit for node 69d5a4ae34043de23ba13f92 2026-04-08 00:45:50,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:50,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ae34043de23ba13f92 HTTP/1.1" 200 None 2026-04-08 00:45:50,672 - lava_callback - DEBUG - Processing node 69d5a4ae34043de23ba13f92: baseline-arm 2026-04-08 00:45:51,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:51,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:51,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ae34043de23ba13f92/log.txt.gz 2026-04-08 00:45:51,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:51,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:51,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ae34043de23ba13f92/lava-logs.yaml 2026-04-08 00:45:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:45:52,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:45:52,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ae34043de23ba13f92/lava_callback.json.gz 2026-04-08 00:45:52,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:52,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ae34043de23ba13f92 HTTP/1.1" 200 None 2026-04-08 00:45:52,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:52,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:45:52,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:52,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ae34043de23ba13f92 HTTP/1.1" 200 None 2026-04-08 00:45:52,178 - lava_callback - INFO - Completed processing callback for node 69d5a4ae34043de23ba13f92 2026-04-08 00:45:55,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:45:55,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57462 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:46:28,206 - lava_callback - INFO - Received callback for node 69d5a4e434043de23ba14087 INFO: 172.20.0.1:57470 - "POST /node/69d5a4e434043de23ba14087 HTTP/1.0" 202 Accepted 2026-04-08 00:46:28,214 - lava_callback - INFO - Starting async job submit for node 69d5a4e434043de23ba14087 2026-04-08 00:46:28,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:46:28,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e434043de23ba14087 HTTP/1.1" 200 None 2026-04-08 00:46:28,260 - lava_callback - DEBUG - Processing node 69d5a4e434043de23ba14087: ltp-dio 2026-04-08 00:46:28,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:46:29,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:46:29,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d5a4e434043de23ba14087/log.txt.gz 2026-04-08 00:46:29,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:46:29,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:46:29,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d5a4e434043de23ba14087/lava-logs.yaml 2026-04-08 00:46:29,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:46:29,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:46:29,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d5a4e434043de23ba14087/lava_callback.json.gz 2026-04-08 00:46:29,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:46:29,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e434043de23ba14087 HTTP/1.1" 200 None 2026-04-08 00:46:29,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:46:29,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:46:29,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:46:30,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e434043de23ba14087 HTTP/1.1" 200 None 2026-04-08 00:46:30,007 - lava_callback - INFO - Completed processing callback for node 69d5a4e434043de23ba14087 INFO: 172.20.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49288 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:46:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:46:55,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48880 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:47:05,910 - lava_callback - INFO - Received callback for node 69d3028713dd9a9509893b31 INFO: 172.20.0.1:44798 - "POST /node/69d3028713dd9a9509893b31 HTTP/1.0" 202 Accepted 2026-04-08 00:47:05,917 - lava_callback - INFO - Starting async job submit for node 69d3028713dd9a9509893b31 2026-04-08 00:47:05,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:05,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3028713dd9a9509893b31 HTTP/1.1" 200 None 2026-04-08 00:47:05,943 - lava_callback - DEBUG - Processing node 69d3028713dd9a9509893b31: baseline-arm-baylibre 2026-04-08 00:47:05,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3028713dd9a9509893b31 2026-04-08 00:47:05,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:05,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3028713dd9a9509893b31 HTTP/1.1" 200 None 2026-04-08 00:47:05,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:47:05,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:06,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3028713dd9a9509893b31 HTTP/1.1" 200 None 2026-04-08 00:47:06,030 - lava_callback - ERROR - Error processing callback for node 69d3028713dd9a9509893b31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:47:22,029 - lava_callback - INFO - Received callback for node 69d5a53a34043de23ba14126 INFO: 172.20.0.1:58168 - "POST /node/69d5a53a34043de23ba14126 HTTP/1.0" 202 Accepted 2026-04-08 00:47:22,039 - lava_callback - INFO - Starting async job submit for node 69d5a53a34043de23ba14126 2026-04-08 00:47:22,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:22,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a53a34043de23ba14126 HTTP/1.1" 200 None 2026-04-08 00:47:22,115 - lava_callback - DEBUG - Processing node 69d5a53a34043de23ba14126: baseline-arm-broonie 2026-04-08 00:47:22,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:22,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:22,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a53a34043de23ba14126/log.txt.gz 2026-04-08 00:47:22,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:23,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:23,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a53a34043de23ba14126/lava-logs.yaml 2026-04-08 00:47:23,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:23,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:23,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a53a34043de23ba14126/lava_callback.json.gz 2026-04-08 00:47:23,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:23,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a53a34043de23ba14126 HTTP/1.1" 200 None 2026-04-08 00:47:23,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:23,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:47:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:23,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a53a34043de23ba14126 HTTP/1.1" 200 None 2026-04-08 00:47:23,373 - lava_callback - INFO - Completed processing callback for node 69d5a53a34043de23ba14126 2026-04-08 00:47:25,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:25,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60784 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:47:45,526 - lava_callback - INFO - Received callback for node 69d5a5a134043de23ba14175 INFO: 172.20.0.1:60220 - "POST /node/69d5a5a134043de23ba14175 HTTP/1.0" 202 Accepted 2026-04-08 00:47:45,532 - lava_callback - INFO - Starting async job submit for node 69d5a5a134043de23ba14175 2026-04-08 00:47:45,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a5a134043de23ba14175 HTTP/1.1" 200 None 2026-04-08 00:47:45,550 - lava_callback - DEBUG - Processing node 69d5a5a134043de23ba14175: baseline-arm 2026-04-08 00:47:45,555 - lava_callback - WARNING - Failed to upload log 2026-04-08 00:47:45,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:45,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:45,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a5a134043de23ba14175/lava-logs.yaml 2026-04-08 00:47:45,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:45,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:45,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a5a134043de23ba14175/lava_callback.json.gz 2026-04-08 00:47:45,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a5a134043de23ba14175 HTTP/1.1" 200 None 2026-04-08 00:47:45,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:47:45,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a5a134043de23ba14175 HTTP/1.1" 200 None 2026-04-08 00:47:45,880 - lava_callback - INFO - Completed processing callback for node 69d5a5a134043de23ba14175 2026-04-08 00:47:45,906 - lava_callback - INFO - Received callback for node 69d302ac13dd9a9509893b4e INFO: 172.20.0.1:60230 - "POST /node/69d302ac13dd9a9509893b4e HTTP/1.0" 202 Accepted 2026-04-08 00:47:45,917 - lava_callback - INFO - Starting async job submit for node 69d302ac13dd9a9509893b4e 2026-04-08 00:47:45,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302ac13dd9a9509893b4e HTTP/1.1" 200 None 2026-04-08 00:47:45,947 - lava_callback - DEBUG - Processing node 69d302ac13dd9a9509893b4e: baseline-arm-baylibre 2026-04-08 00:47:45,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d302ac13dd9a9509893b4e 2026-04-08 00:47:45,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:45,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302ac13dd9a9509893b4e HTTP/1.1" 200 None 2026-04-08 00:47:45,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:46,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:47:46,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:46,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d302ac13dd9a9509893b4e HTTP/1.1" 200 None 2026-04-08 00:47:46,038 - lava_callback - ERROR - Error processing callback for node 69d302ac13dd9a9509893b4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60236 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:47:50,909 - lava_callback - INFO - Received callback for node 69d5a4f034043de23ba140b4 INFO: 172.20.0.1:42702 - "POST /node/69d5a4f034043de23ba140b4 HTTP/1.0" 202 Accepted 2026-04-08 00:47:50,916 - lava_callback - INFO - Starting async job submit for node 69d5a4f034043de23ba140b4 2026-04-08 00:47:50,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:50,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f034043de23ba140b4 HTTP/1.1" 200 None 2026-04-08 00:47:50,956 - lava_callback - DEBUG - Processing node 69d5a4f034043de23ba140b4: ltp-syscalls 2026-04-08 00:47:51,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:51,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:51,937 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d5a4f034043de23ba140b4/log.txt.gz 2026-04-08 00:47:52,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:52,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:52,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d5a4f034043de23ba140b4/lava-logs.yaml 2026-04-08 00:47:52,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:47:52,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:47:52,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d5a4f034043de23ba140b4/lava_callback.json.gz 2026-04-08 00:47:52,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:52,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f034043de23ba140b4 HTTP/1.1" 200 None 2026-04-08 00:47:52,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:52,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:47:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:52,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4f034043de23ba140b4 HTTP/1.1" 200 None 2026-04-08 00:47:52,866 - lava_callback - INFO - Completed processing callback for node 69d5a4f034043de23ba140b4 2026-04-08 00:47:55,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:47:55,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42710 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:48:02,088 - lava_callback - INFO - Received callback for node 69d5a56134043de23ba14141 INFO: 172.20.0.1:42356 - "POST /node/69d5a56134043de23ba14141 HTTP/1.0" 202 Accepted 2026-04-08 00:48:02,094 - lava_callback - INFO - Starting async job submit for node 69d5a56134043de23ba14141 2026-04-08 00:48:02,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:02,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a56134043de23ba14141 HTTP/1.1" 200 None 2026-04-08 00:48:02,131 - lava_callback - DEBUG - Processing node 69d5a56134043de23ba14141: baseline-arm-broonie 2026-04-08 00:48:02,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:02,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:02,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a56134043de23ba14141/log.txt.gz 2026-04-08 00:48:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:02,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:02,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a56134043de23ba14141/lava-logs.yaml 2026-04-08 00:48:02,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:02,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:02,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a56134043de23ba14141/lava_callback.json.gz 2026-04-08 00:48:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:02,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a56134043de23ba14141 HTTP/1.1" 200 None 2026-04-08 00:48:02,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:02,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:48:02,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:02,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a56134043de23ba14141 HTTP/1.1" 200 None 2026-04-08 00:48:02,993 - lava_callback - INFO - Completed processing callback for node 69d5a56134043de23ba14141 INFO: 172.20.0.1:42358 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:48:11,126 - lava_callback - INFO - Received callback for node 69d5a4e034043de23ba14081 INFO: 172.20.0.1:57406 - "POST /node/69d5a4e034043de23ba14081 HTTP/1.0" 202 Accepted 2026-04-08 00:48:11,133 - lava_callback - INFO - Starting async job submit for node 69d5a4e034043de23ba14081 2026-04-08 00:48:11,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:11,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e034043de23ba14081 HTTP/1.1" 200 None 2026-04-08 00:48:11,177 - lava_callback - DEBUG - Processing node 69d5a4e034043de23ba14081: ltp-controllers 2026-04-08 00:48:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:11,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:11,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d5a4e034043de23ba14081/log.txt.gz 2026-04-08 00:48:12,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:12,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:12,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d5a4e034043de23ba14081/lava-logs.yaml 2026-04-08 00:48:12,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:12,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:12,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d5a4e034043de23ba14081/lava_callback.json.gz 2026-04-08 00:48:12,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:12,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e034043de23ba14081 HTTP/1.1" 200 None 2026-04-08 00:48:12,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:12,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:48:12,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:12,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e034043de23ba14081 HTTP/1.1" 200 None 2026-04-08 00:48:12,658 - lava_callback - INFO - Completed processing callback for node 69d5a4e034043de23ba14081 INFO: 172.20.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57426 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:48:21,974 - lava_callback - INFO - Received callback for node 69d5a4e634043de23ba1408a INFO: 172.20.0.1:45096 - "POST /node/69d5a4e634043de23ba1408a HTTP/1.0" 202 Accepted 2026-04-08 00:48:21,980 - lava_callback - INFO - Starting async job submit for node 69d5a4e634043de23ba1408a 2026-04-08 00:48:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:22,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e634043de23ba1408a HTTP/1.1" 200 None 2026-04-08 00:48:22,028 - lava_callback - DEBUG - Processing node 69d5a4e634043de23ba1408a: ltp-fs_bind 2026-04-08 00:48:22,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:22,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:22,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d5a4e634043de23ba1408a/log.txt.gz 2026-04-08 00:48:22,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:22,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:22,931 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d5a4e634043de23ba1408a/lava-logs.yaml 2026-04-08 00:48:22,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:23,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:23,096 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d5a4e634043de23ba1408a/lava_callback.json.gz 2026-04-08 00:48:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:23,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e634043de23ba1408a HTTP/1.1" 200 None 2026-04-08 00:48:23,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:23,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:48:23,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:23,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e634043de23ba1408a HTTP/1.1" 200 None 2026-04-08 00:48:23,183 - lava_callback - INFO - Completed processing callback for node 69d5a4e634043de23ba1408a 2026-04-08 00:48:25,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:25,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-08 00:48:25,939 - lava_callback - INFO - Received callback for node 69d302d313dd9a9509893b66 INFO: 172.20.0.1:45102 - "POST /node/69d302d313dd9a9509893b66 HTTP/1.0" 202 Accepted 2026-04-08 00:48:25,944 - lava_callback - INFO - Starting async job submit for node 69d302d313dd9a9509893b66 2026-04-08 00:48:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:25,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302d313dd9a9509893b66 HTTP/1.1" 200 None 2026-04-08 00:48:25,960 - lava_callback - DEBUG - Processing node 69d302d313dd9a9509893b66: baseline-arm-baylibre 2026-04-08 00:48:25,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d302d313dd9a9509893b66 2026-04-08 00:48:25,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302d313dd9a9509893b66 HTTP/1.1" 200 None 2026-04-08 00:48:25,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:25,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:48:25,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:26,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d302d313dd9a9509893b66 HTTP/1.1" 200 None 2026-04-08 00:48:26,011 - lava_callback - ERROR - Error processing callback for node 69d302d313dd9a9509893b66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:48:50,935 - lava_callback - INFO - Received callback for node 69d5a4e234043de23ba14084 INFO: 172.20.0.1:44380 - "POST /node/69d5a4e234043de23ba14084 HTTP/1.0" 202 Accepted 2026-04-08 00:48:50,941 - lava_callback - INFO - Starting async job submit for node 69d5a4e234043de23ba14084 2026-04-08 00:48:50,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:50,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e234043de23ba14084 HTTP/1.1" 200 None 2026-04-08 00:48:50,990 - lava_callback - DEBUG - Processing node 69d5a4e234043de23ba14084: ltp-cve 2026-04-08 00:48:51,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:51,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:51,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d5a4e234043de23ba14084/log.txt.gz 2026-04-08 00:48:51,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:52,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:52,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d5a4e234043de23ba14084/lava-logs.yaml 2026-04-08 00:48:52,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:48:52,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:48:52,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d5a4e234043de23ba14084/lava_callback.json.gz 2026-04-08 00:48:52,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:52,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e234043de23ba14084 HTTP/1.1" 200 None 2026-04-08 00:48:52,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:52,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:48:52,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:52,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e234043de23ba14084 HTTP/1.1" 200 None 2026-04-08 00:48:52,298 - lava_callback - INFO - Completed processing callback for node 69d5a4e234043de23ba14084 2026-04-08 00:48:55,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:48:55,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:01,911 - lava_callback - INFO - Received callback for node 69d5a1c134043de23ba13f23 INFO: 172.20.0.1:36204 - "POST /node/69d5a1c134043de23ba13f23 HTTP/1.0" 202 Accepted 2026-04-08 00:49:01,918 - lava_callback - INFO - Starting async job submit for node 69d5a1c134043de23ba13f23 2026-04-08 00:49:01,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:01,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a1c134043de23ba13f23 HTTP/1.1" 200 None 2026-04-08 00:49:01,991 - lava_callback - DEBUG - Processing node 69d5a1c134043de23ba13f23: ltp-smoke 2026-04-08 00:49:02,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:02,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:02,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a1c134043de23ba13f23/log.txt.gz 2026-04-08 00:49:02,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:03,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:03,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a1c134043de23ba13f23/lava-logs.yaml 2026-04-08 00:49:03,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:03,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:03,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a1c134043de23ba13f23/lava_callback.json.gz 2026-04-08 00:49:03,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:03,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a1c134043de23ba13f23 HTTP/1.1" 200 None 2026-04-08 00:49:03,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:03,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9f34043de23ba13b4f HTTP/1.1" 200 None 2026-04-08 00:49:03,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:03,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a1c134043de23ba13f23 HTTP/1.1" 200 None 2026-04-08 00:49:03,591 - lava_callback - INFO - Completed processing callback for node 69d5a1c134043de23ba13f23 2026-04-08 00:49:06,069 - lava_callback - INFO - Received callback for node 69d302f513dd9a9509893b8b INFO: 172.20.0.1:36210 - "POST /node/69d302f513dd9a9509893b8b HTTP/1.0" 202 Accepted 2026-04-08 00:49:06,075 - lava_callback - INFO - Starting async job submit for node 69d302f513dd9a9509893b8b 2026-04-08 00:49:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:06,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302f513dd9a9509893b8b HTTP/1.1" 200 None 2026-04-08 00:49:06,096 - lava_callback - DEBUG - Processing node 69d302f513dd9a9509893b8b: baseline-arm-baylibre 2026-04-08 00:49:06,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d302f513dd9a9509893b8b 2026-04-08 00:49:06,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:06,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d302f513dd9a9509893b8b HTTP/1.1" 200 None 2026-04-08 00:49:06,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:06,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:49:06,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:06,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d302f513dd9a9509893b8b HTTP/1.1" 200 None 2026-04-08 00:49:06,161 - lava_callback - ERROR - Error processing callback for node 69d302f513dd9a9509893b8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:11,080 - lava_callback - INFO - Received callback for node 69d5a58534043de23ba14161 INFO: 172.20.0.1:36356 - "POST /node/69d5a58534043de23ba14161 HTTP/1.0" 202 Accepted 2026-04-08 00:49:11,086 - lava_callback - INFO - Starting async job submit for node 69d5a58534043de23ba14161 2026-04-08 00:49:11,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:11,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a58534043de23ba14161 HTTP/1.1" 200 None 2026-04-08 00:49:11,124 - lava_callback - DEBUG - Processing node 69d5a58534043de23ba14161: baseline-arm-broonie 2026-04-08 00:49:11,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:11,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:11,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a58534043de23ba14161/log.txt.gz 2026-04-08 00:49:11,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:11,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:12,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a58534043de23ba14161/lava-logs.yaml 2026-04-08 00:49:12,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:12,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:12,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d5a58534043de23ba14161/lava_callback.json.gz 2026-04-08 00:49:12,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:12,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a58534043de23ba14161 HTTP/1.1" 200 None 2026-04-08 00:49:12,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:12,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:49:12,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:12,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a58534043de23ba14161 HTTP/1.1" 200 None 2026-04-08 00:49:12,217 - lava_callback - INFO - Completed processing callback for node 69d5a58534043de23ba14161 INFO: 172.20.0.1:36370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36380 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:25,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:25,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:30,984 - lava_callback - INFO - Received callback for node 69d5a4e734043de23ba1408d INFO: 172.20.0.1:56904 - "POST /node/69d5a4e734043de23ba1408d HTTP/1.0" 202 Accepted 2026-04-08 00:49:30,991 - lava_callback - INFO - Starting async job submit for node 69d5a4e734043de23ba1408d 2026-04-08 00:49:31,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:31,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e734043de23ba1408d HTTP/1.1" 200 None 2026-04-08 00:49:31,032 - lava_callback - DEBUG - Processing node 69d5a4e734043de23ba1408d: ltp-fsx 2026-04-08 00:49:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:31,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:31,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d5a4e734043de23ba1408d/log.txt.gz 2026-04-08 00:49:31,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:31,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:31,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d5a4e734043de23ba1408d/lava-logs.yaml 2026-04-08 00:49:31,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:32,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:32,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d5a4e734043de23ba1408d/lava_callback.json.gz 2026-04-08 00:49:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:32,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e734043de23ba1408d HTTP/1.1" 200 None 2026-04-08 00:49:32,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:32,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:49:32,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:32,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e734043de23ba1408d HTTP/1.1" 200 None 2026-04-08 00:49:32,198 - lava_callback - INFO - Completed processing callback for node 69d5a4e734043de23ba1408d INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:46,070 - lava_callback - INFO - Received callback for node 69d3031913dd9a9509893bcd INFO: 172.20.0.1:45842 - "POST /node/69d3031913dd9a9509893bcd HTTP/1.0" 202 Accepted 2026-04-08 00:49:46,078 - lava_callback - INFO - Starting async job submit for node 69d3031913dd9a9509893bcd 2026-04-08 00:49:46,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:46,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3031913dd9a9509893bcd HTTP/1.1" 200 None 2026-04-08 00:49:46,095 - lava_callback - DEBUG - Processing node 69d3031913dd9a9509893bcd: baseline-arm-baylibre 2026-04-08 00:49:46,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3031913dd9a9509893bcd 2026-04-08 00:49:46,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:46,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3031913dd9a9509893bcd HTTP/1.1" 200 None 2026-04-08 00:49:46,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:46,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:49:46,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:46,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3031913dd9a9509893bcd HTTP/1.1" 200 None 2026-04-08 00:49:46,148 - lava_callback - ERROR - Error processing callback for node 69d3031913dd9a9509893bcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45854 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:55,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:55,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-08 00:49:55,464 - lava_callback - INFO - Received callback for node 69d5a4df34043de23ba1407e INFO: 172.20.0.1:52972 - "POST /node/69d5a4df34043de23ba1407e HTTP/1.0" 202 Accepted 2026-04-08 00:49:55,471 - lava_callback - INFO - Starting async job submit for node 69d5a4df34043de23ba1407e 2026-04-08 00:49:55,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4df34043de23ba1407e HTTP/1.1" 200 None 2026-04-08 00:49:55,512 - lava_callback - DEBUG - Processing node 69d5a4df34043de23ba1407e: ltp-containers 2026-04-08 00:49:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:56,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:56,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d5a4df34043de23ba1407e/log.txt.gz 2026-04-08 00:49:56,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:49:56,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:56,473 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d5a4df34043de23ba1407e/lava-logs.yaml 2026-04-08 00:49:56,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:49:56,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:49:56,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d5a4df34043de23ba1407e/lava_callback.json.gz 2026-04-08 00:49:56,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:56,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4df34043de23ba1407e HTTP/1.1" 200 None 2026-04-08 00:49:56,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:49:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:49:56,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4df34043de23ba1407e HTTP/1.1" 200 None 2026-04-08 00:49:56,714 - lava_callback - INFO - Completed processing callback for node 69d5a4df34043de23ba1407e 2026-04-08 00:50:06,001 - lava_callback - INFO - Received callback for node 69d3033c13dd9a9509893bf3 INFO: 172.20.0.1:57890 - "POST /node/69d3033c13dd9a9509893bf3 HTTP/1.0" 202 Accepted 2026-04-08 00:50:06,007 - lava_callback - INFO - Starting async job submit for node 69d3033c13dd9a9509893bf3 2026-04-08 00:50:06,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:50:06,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3033c13dd9a9509893bf3 HTTP/1.1" 200 None 2026-04-08 00:50:06,023 - lava_callback - DEBUG - Processing node 69d3033c13dd9a9509893bf3: baseline-arm-baylibre 2026-04-08 00:50:06,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3033c13dd9a9509893bf3 2026-04-08 00:50:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:50:06,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3033c13dd9a9509893bf3 HTTP/1.1" 200 None 2026-04-08 00:50:06,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:50:06,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:50:06,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:50:06,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3033c13dd9a9509893bf3 HTTP/1.1" 200 None 2026-04-08 00:50:06,079 - lava_callback - ERROR - Error processing callback for node 69d3033c13dd9a9509893bf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:50:25,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:50:25,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45856 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:51:01,877 - lava_callback - INFO - Received callback for node 69d5a1c234043de23ba13f25 INFO: 172.20.0.1:52922 - "POST /node/69d5a1c234043de23ba13f25 HTTP/1.0" 202 Accepted 2026-04-08 00:51:01,883 - lava_callback - INFO - Starting async job submit for node 69d5a1c234043de23ba13f25 2026-04-08 00:51:01,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:51:01,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a1c234043de23ba13f25 HTTP/1.1" 200 None 2026-04-08 00:51:01,922 - lava_callback - DEBUG - Processing node 69d5a1c234043de23ba13f25: baseline-arm 2026-04-08 00:51:02,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:51:02,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:51:02,279 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a1c234043de23ba13f25/log.txt.gz 2026-04-08 00:51:02,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:51:02,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:51:02,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a1c234043de23ba13f25/lava-logs.yaml 2026-04-08 00:51:02,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:51:02,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:51:02,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a1c234043de23ba13f25/lava_callback.json.gz 2026-04-08 00:51:02,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:51:02,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a1c234043de23ba13f25 HTTP/1.1" 200 None 2026-04-08 00:51:02,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:51:02,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9f34043de23ba13b4f HTTP/1.1" 200 None 2026-04-08 00:51:02,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:51:02,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a1c234043de23ba13f25 HTTP/1.1" 200 None 2026-04-08 00:51:02,841 - lava_callback - INFO - Completed processing callback for node 69d5a1c234043de23ba13f25 INFO: 172.20.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:51:25,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:51:25,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:52:09,977 - lava_callback - INFO - Received callback for node 69d303a613dd9a9509893c63 INFO: 172.20.0.1:38700 - "POST /node/69d303a613dd9a9509893c63 HTTP/1.0" 202 Accepted 2026-04-08 00:52:09,983 - lava_callback - INFO - Starting async job submit for node 69d303a613dd9a9509893c63 2026-04-08 00:52:09,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:09,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303a613dd9a9509893c63 HTTP/1.1" 200 None 2026-04-08 00:52:10,000 - lava_callback - DEBUG - Processing node 69d303a613dd9a9509893c63: baseline-arm-clabbe 2026-04-08 00:52:10,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303a613dd9a9509893c63 2026-04-08 00:52:10,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:10,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303a613dd9a9509893c63 HTTP/1.1" 200 None 2026-04-08 00:52:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:10,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:52:10,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:10,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303a613dd9a9509893c63 HTTP/1.1" 200 None 2026-04-08 00:52:10,067 - lava_callback - ERROR - Error processing callback for node 69d303a613dd9a9509893c63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:52:11,036 - lava_callback - INFO - Received callback for node 69d5a4ea34043de23ba140a5 INFO: 172.20.0.1:38716 - "POST /node/69d5a4ea34043de23ba140a5 HTTP/1.0" 202 Accepted 2026-04-08 00:52:11,043 - lava_callback - INFO - Starting async job submit for node 69d5a4ea34043de23ba140a5 2026-04-08 00:52:11,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:11,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ea34043de23ba140a5 HTTP/1.1" 200 None 2026-04-08 00:52:11,084 - lava_callback - DEBUG - Processing node 69d5a4ea34043de23ba140a5: ltp-ipc 2026-04-08 00:52:11,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:11,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:11,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d5a4ea34043de23ba140a5/log.txt.gz 2026-04-08 00:52:11,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:12,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:12,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d5a4ea34043de23ba140a5/lava-logs.yaml 2026-04-08 00:52:12,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:12,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:12,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d5a4ea34043de23ba140a5/lava_callback.json.gz 2026-04-08 00:52:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:12,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ea34043de23ba140a5 HTTP/1.1" 200 None 2026-04-08 00:52:12,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:12,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:52:12,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:12,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ea34043de23ba140a5 HTTP/1.1" 200 None 2026-04-08 00:52:12,638 - lava_callback - INFO - Completed processing callback for node 69d5a4ea34043de23ba140a5 INFO: 172.20.0.1:38730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38744 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:52:22,126 - lava_callback - INFO - Received callback for node 69d5a4e934043de23ba140a0 INFO: 172.20.0.1:58288 - "POST /node/69d5a4e934043de23ba140a0 HTTP/1.0" 202 Accepted 2026-04-08 00:52:22,135 - lava_callback - INFO - Starting async job submit for node 69d5a4e934043de23ba140a0 2026-04-08 00:52:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:22,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e934043de23ba140a0 HTTP/1.1" 200 None 2026-04-08 00:52:22,175 - lava_callback - DEBUG - Processing node 69d5a4e934043de23ba140a0: ltp-input 2026-04-08 00:52:22,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:22,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:22,770 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d5a4e934043de23ba140a0/log.txt.gz 2026-04-08 00:52:22,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:23,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:23,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d5a4e934043de23ba140a0/lava-logs.yaml 2026-04-08 00:52:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:52:23,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:52:23,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d5a4e934043de23ba140a0/lava_callback.json.gz 2026-04-08 00:52:23,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:23,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4e934043de23ba140a0 HTTP/1.1" 200 None 2026-04-08 00:52:23,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:23,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:52:23,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:23,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4e934043de23ba140a0 HTTP/1.1" 200 None 2026-04-08 00:52:23,555 - lava_callback - INFO - Completed processing callback for node 69d5a4e934043de23ba140a0 2026-04-08 00:52:25,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:25,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:52:29,911 - lava_callback - INFO - Received callback for node 69d303c913dd9a9509893cf4 INFO: 172.20.0.1:48216 - "POST /node/69d303c913dd9a9509893cf4 HTTP/1.0" 202 Accepted 2026-04-08 00:52:29,917 - lava_callback - INFO - Starting async job submit for node 69d303c913dd9a9509893cf4 2026-04-08 00:52:29,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:29,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c913dd9a9509893cf4 HTTP/1.1" 200 None 2026-04-08 00:52:29,934 - lava_callback - DEBUG - Processing node 69d303c913dd9a9509893cf4: baseline-arm-clabbe 2026-04-08 00:52:29,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303c913dd9a9509893cf4 2026-04-08 00:52:29,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:29,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303c913dd9a9509893cf4 HTTP/1.1" 200 None 2026-04-08 00:52:29,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:29,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:52:29,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:52:30,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303c913dd9a9509893cf4 HTTP/1.1" 200 None 2026-04-08 00:52:30,027 - lava_callback - ERROR - Error processing callback for node 69d303c913dd9a9509893cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:06,294 - lava_callback - INFO - Received callback for node 69d303dd13dd9a9509893d3f INFO: 172.20.0.1:39668 - "POST /node/69d303dd13dd9a9509893d3f HTTP/1.0" 202 Accepted 2026-04-08 00:53:06,303 - lava_callback - INFO - Starting async job submit for node 69d303dd13dd9a9509893d3f 2026-04-08 00:53:06,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:06,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303dd13dd9a9509893d3f HTTP/1.1" 200 None 2026-04-08 00:53:06,333 - lava_callback - DEBUG - Processing node 69d303dd13dd9a9509893d3f: baseline-arm64-baylibre 2026-04-08 00:53:06,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303dd13dd9a9509893d3f 2026-04-08 00:53:06,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:06,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303dd13dd9a9509893d3f HTTP/1.1" 200 None 2026-04-08 00:53:06,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:06,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303dd13dd9a9509893d3f HTTP/1.1" 200 None 2026-04-08 00:53:06,419 - lava_callback - ERROR - Error processing callback for node 69d303dd13dd9a9509893d3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:06,965 - lava_callback - INFO - Received callback for node 69d303df13dd9a9509893d42 INFO: 172.20.0.1:39682 - "POST /node/69d303df13dd9a9509893d42 HTTP/1.0" 202 Accepted 2026-04-08 00:53:06,979 - lava_callback - INFO - Starting async job submit for node 69d303df13dd9a9509893d42 2026-04-08 00:53:06,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303df13dd9a9509893d42 HTTP/1.1" 200 None 2026-04-08 00:53:07,006 - lava_callback - DEBUG - Processing node 69d303df13dd9a9509893d42: baseline-arm64-baylibre 2026-04-08 00:53:07,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303df13dd9a9509893d42 2026-04-08 00:53:07,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303df13dd9a9509893d42 HTTP/1.1" 200 None 2026-04-08 00:53:07,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:07,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303df13dd9a9509893d42 HTTP/1.1" 200 None 2026-04-08 00:53:07,100 - lava_callback - ERROR - Error processing callback for node 69d303df13dd9a9509893d42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:07,666 - lava_callback - INFO - Received callback for node 69d303e113dd9a9509893d45 INFO: 172.20.0.1:39688 - "POST /node/69d303e113dd9a9509893d45 HTTP/1.0" 202 Accepted 2026-04-08 00:53:07,675 - lava_callback - INFO - Starting async job submit for node 69d303e113dd9a9509893d45 2026-04-08 00:53:07,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e113dd9a9509893d45 HTTP/1.1" 200 None 2026-04-08 00:53:07,704 - lava_callback - DEBUG - Processing node 69d303e113dd9a9509893d45: baseline-arm64-baylibre 2026-04-08 00:53:07,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303e113dd9a9509893d45 2026-04-08 00:53:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e113dd9a9509893d45 HTTP/1.1" 200 None 2026-04-08 00:53:07,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:07,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:07,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303e113dd9a9509893d45 HTTP/1.1" 200 None 2026-04-08 00:53:07,797 - lava_callback - ERROR - Error processing callback for node 69d303e113dd9a9509893d45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:08,335 - lava_callback - INFO - Received callback for node 69d303e313dd9a9509893d4c INFO: 172.20.0.1:39702 - "POST /node/69d303e313dd9a9509893d4c HTTP/1.0" 202 Accepted 2026-04-08 00:53:08,345 - lava_callback - INFO - Starting async job submit for node 69d303e313dd9a9509893d4c 2026-04-08 00:53:08,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:08,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e313dd9a9509893d4c HTTP/1.1" 200 None 2026-04-08 00:53:08,375 - lava_callback - DEBUG - Processing node 69d303e313dd9a9509893d4c: baseline-arm64-baylibre 2026-04-08 00:53:08,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303e313dd9a9509893d4c 2026-04-08 00:53:08,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:08,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e313dd9a9509893d4c HTTP/1.1" 200 None 2026-04-08 00:53:08,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:08,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:08,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:08,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303e313dd9a9509893d4c HTTP/1.1" 200 None 2026-04-08 00:53:08,472 - lava_callback - ERROR - Error processing callback for node 69d303e313dd9a9509893d4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:09,043 - lava_callback - INFO - Received callback for node 69d303e513dd9a9509893d4f INFO: 172.20.0.1:39704 - "POST /node/69d303e513dd9a9509893d4f HTTP/1.0" 202 Accepted 2026-04-08 00:53:09,052 - lava_callback - INFO - Starting async job submit for node 69d303e513dd9a9509893d4f 2026-04-08 00:53:09,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e513dd9a9509893d4f HTTP/1.1" 200 None 2026-04-08 00:53:09,086 - lava_callback - DEBUG - Processing node 69d303e513dd9a9509893d4f: baseline-arm64-baylibre 2026-04-08 00:53:09,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303e513dd9a9509893d4f 2026-04-08 00:53:09,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e513dd9a9509893d4f HTTP/1.1" 200 None 2026-04-08 00:53:09,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:09,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303e513dd9a9509893d4f HTTP/1.1" 200 None 2026-04-08 00:53:09,185 - lava_callback - ERROR - Error processing callback for node 69d303e513dd9a9509893d4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:09,741 - lava_callback - INFO - Received callback for node 69d303e713dd9a9509893d52 INFO: 172.20.0.1:56996 - "POST /node/69d303e713dd9a9509893d52 HTTP/1.0" 202 Accepted 2026-04-08 00:53:09,751 - lava_callback - INFO - Starting async job submit for node 69d303e713dd9a9509893d52 2026-04-08 00:53:09,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e713dd9a9509893d52 HTTP/1.1" 200 None 2026-04-08 00:53:09,779 - lava_callback - DEBUG - Processing node 69d303e713dd9a9509893d52: baseline-arm64-baylibre 2026-04-08 00:53:09,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303e713dd9a9509893d52 2026-04-08 00:53:09,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303e713dd9a9509893d52 HTTP/1.1" 200 None 2026-04-08 00:53:09,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:09,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:09,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303e713dd9a9509893d52 HTTP/1.1" 200 None 2026-04-08 00:53:09,871 - lava_callback - ERROR - Error processing callback for node 69d303e713dd9a9509893d52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:30,037 - lava_callback - INFO - Received callback for node 69d303f813dd9a9509893db5 INFO: 172.20.0.1:40940 - "POST /node/69d303f813dd9a9509893db5 HTTP/1.0" 202 Accepted 2026-04-08 00:53:30,046 - lava_callback - INFO - Starting async job submit for node 69d303f813dd9a9509893db5 2026-04-08 00:53:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f813dd9a9509893db5 HTTP/1.1" 200 None 2026-04-08 00:53:30,075 - lava_callback - DEBUG - Processing node 69d303f813dd9a9509893db5: baseline-arm64-clabbe 2026-04-08 00:53:30,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303f813dd9a9509893db5 2026-04-08 00:53:30,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303f813dd9a9509893db5 HTTP/1.1" 200 None 2026-04-08 00:53:30,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:30,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303f813dd9a9509893db5 HTTP/1.1" 200 None 2026-04-08 00:53:30,166 - lava_callback - ERROR - Error processing callback for node 69d303f813dd9a9509893db5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:30,730 - lava_callback - INFO - Received callback for node 69d303fa13dd9a9509893db9 INFO: 172.20.0.1:40952 - "POST /node/69d303fa13dd9a9509893db9 HTTP/1.0" 202 Accepted 2026-04-08 00:53:30,739 - lava_callback - INFO - Starting async job submit for node 69d303fa13dd9a9509893db9 2026-04-08 00:53:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fa13dd9a9509893db9 HTTP/1.1" 200 None 2026-04-08 00:53:30,764 - lava_callback - DEBUG - Processing node 69d303fa13dd9a9509893db9: baseline-arm64-clabbe 2026-04-08 00:53:30,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fa13dd9a9509893db9 2026-04-08 00:53:30,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fa13dd9a9509893db9 HTTP/1.1" 200 None 2026-04-08 00:53:30,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:30,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:30,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fa13dd9a9509893db9 HTTP/1.1" 200 None 2026-04-08 00:53:30,838 - lava_callback - ERROR - Error processing callback for node 69d303fa13dd9a9509893db9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:31,032 - lava_callback - INFO - Received callback for node 69d5a4ed34043de23ba140ae INFO: 172.20.0.1:40954 - "POST /node/69d5a4ed34043de23ba140ae HTTP/1.0" 202 Accepted 2026-04-08 00:53:31,046 - lava_callback - INFO - Starting async job submit for node 69d5a4ed34043de23ba140ae 2026-04-08 00:53:31,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:31,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ed34043de23ba140ae HTTP/1.1" 200 None 2026-04-08 00:53:31,113 - lava_callback - DEBUG - Processing node 69d5a4ed34043de23ba140ae: ltp-sched 2026-04-08 00:53:31,419 - lava_callback - INFO - Received callback for node 69d303fa13dd9a9509893dbc INFO: 172.20.0.1:40958 - "POST /node/69d303fa13dd9a9509893dbc HTTP/1.0" 202 Accepted 2026-04-08 00:53:31,434 - lava_callback - INFO - Starting async job submit for node 69d303fa13dd9a9509893dbc 2026-04-08 00:53:31,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:31,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fa13dd9a9509893dbc HTTP/1.1" 200 None 2026-04-08 00:53:31,546 - lava_callback - DEBUG - Processing node 69d303fa13dd9a9509893dbc: baseline-arm64-clabbe 2026-04-08 00:53:31,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fa13dd9a9509893dbc 2026-04-08 00:53:31,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:31,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fa13dd9a9509893dbc HTTP/1.1" 200 None 2026-04-08 00:53:31,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:31,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:53:31,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:31,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:31,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fa13dd9a9509893dbc HTTP/1.1" 200 None 2026-04-08 00:53:31,783 - lava_callback - ERROR - Error processing callback for node 69d303fa13dd9a9509893dbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40968 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:32,107 - lava_callback - INFO - Received callback for node 69d303fb13dd9a9509893dbf INFO: 172.20.0.1:40984 - "POST /node/69d303fb13dd9a9509893dbf HTTP/1.0" 202 Accepted 2026-04-08 00:53:32,113 - lava_callback - INFO - Starting async job submit for node 69d303fb13dd9a9509893dbf 2026-04-08 00:53:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fb13dd9a9509893dbf HTTP/1.1" 200 None 2026-04-08 00:53:32,154 - lava_callback - DEBUG - Processing node 69d303fb13dd9a9509893dbf: baseline-arm64-clabbe 2026-04-08 00:53:32,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fb13dd9a9509893dbf 2026-04-08 00:53:32,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fb13dd9a9509893dbf HTTP/1.1" 200 None 2026-04-08 00:53:32,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:32,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fb13dd9a9509893dbf HTTP/1.1" 200 None 2026-04-08 00:53:32,251 - lava_callback - ERROR - Error processing callback for node 69d303fb13dd9a9509893dbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:32,787 - lava_callback - INFO - Received callback for node 69d303fc13dd9a9509893dc2 INFO: 172.20.0.1:41000 - "POST /node/69d303fc13dd9a9509893dc2 HTTP/1.0" 202 Accepted 2026-04-08 00:53:32,795 - lava_callback - INFO - Starting async job submit for node 69d303fc13dd9a9509893dc2 2026-04-08 00:53:32,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fc13dd9a9509893dc2 HTTP/1.1" 200 None 2026-04-08 00:53:32,817 - lava_callback - DEBUG - Processing node 69d303fc13dd9a9509893dc2: baseline-arm64-clabbe 2026-04-08 00:53:32,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fc13dd9a9509893dc2 2026-04-08 00:53:32,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:32,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d5a4ed34043de23ba140ae/log.txt.gz 2026-04-08 00:53:32,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fc13dd9a9509893dc2 HTTP/1.1" 200 None 2026-04-08 00:53:32,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:32,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:32,975 - lava_callback - INFO - Received callback for node 69d5a4ee34043de23ba140b1 2026-04-08 00:53:33,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,009 - lava_callback - INFO - Starting async job submit for node 69d5a4ee34043de23ba140b1 INFO: 172.20.0.1:41012 - "POST /node/69d5a4ee34043de23ba140b1 HTTP/1.0" 202 Accepted 2026-04-08 00:53:33,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fc13dd9a9509893dc2 HTTP/1.1" 200 None 2026-04-08 00:53:33,160 - lava_callback - ERROR - Error processing callback for node 69d303fc13dd9a9509893dc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ee34043de23ba140b1 HTTP/1.1" 200 None 2026-04-08 00:53:33,300 - lava_callback - DEBUG - Processing node 69d5a4ee34043de23ba140b1: ltp-smoke 2026-04-08 00:53:33,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:53:33,486 - lava_callback - INFO - Received callback for node 69d303fe13dd9a9509893dc8 INFO: 172.20.0.1:41028 - "POST /node/69d303fe13dd9a9509893dc8 HTTP/1.0" 202 Accepted 2026-04-08 00:53:33,506 - lava_callback - INFO - Starting async job submit for node 69d303fe13dd9a9509893dc8 2026-04-08 00:53:33,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fe13dd9a9509893dc8 HTTP/1.1" 200 None 2026-04-08 00:53:33,601 - lava_callback - DEBUG - Processing node 69d303fe13dd9a9509893dc8: baseline-arm64-clabbe 2026-04-08 00:53:33,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fe13dd9a9509893dc8 2026-04-08 00:53:33,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fe13dd9a9509893dc8 HTTP/1.1" 200 None 2026-04-08 00:53:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:33,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:33,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fe13dd9a9509893dc8 HTTP/1.1" 200 None 2026-04-08 00:53:33,894 - lava_callback - ERROR - Error processing callback for node 69d303fe13dd9a9509893dc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:33,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:53:34,224 - lava_callback - INFO - Received callback for node 69d303fd13dd9a9509893dc5 INFO: 172.20.0.1:41032 - "POST /node/69d303fd13dd9a9509893dc5 HTTP/1.0" 202 Accepted 2026-04-08 00:53:34,231 - lava_callback - INFO - Starting async job submit for node 69d303fd13dd9a9509893dc5 2026-04-08 00:53:34,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:34,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fd13dd9a9509893dc5 HTTP/1.1" 200 None 2026-04-08 00:53:34,254 - lava_callback - DEBUG - Processing node 69d303fd13dd9a9509893dc5: baseline-arm64-clabbe 2026-04-08 00:53:34,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d303fd13dd9a9509893dc5 2026-04-08 00:53:34,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d303fd13dd9a9509893dc5 HTTP/1.1" 200 None 2026-04-08 00:53:34,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:34,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 00:53:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:34,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d303fd13dd9a9509893dc5 HTTP/1.1" 200 None 2026-04-08 00:53:34,344 - lava_callback - ERROR - Error processing callback for node 69d303fd13dd9a9509893dc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:34,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:34,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d5a4ed34043de23ba140ae/lava-logs.yaml 2026-04-08 00:53:34,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:53:35,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:35,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a4ee34043de23ba140b1/log.txt.gz 2026-04-08 00:53:35,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:53:35,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:35,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d5a4ed34043de23ba140ae/lava_callback.json.gz 2026-04-08 00:53:35,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:35,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ed34043de23ba140ae HTTP/1.1" 200 None 2026-04-08 00:53:35,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:35,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:53:35,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:35,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ed34043de23ba140ae HTTP/1.1" 200 None 2026-04-08 00:53:35,861 - lava_callback - INFO - Completed processing callback for node 69d5a4ed34043de23ba140ae 2026-04-08 00:53:36,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:36,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a4ee34043de23ba140b1/lava-logs.yaml 2026-04-08 00:53:36,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41040 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:37,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:53:37,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a4ee34043de23ba140b1/lava_callback.json.gz 2026-04-08 00:53:37,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:37,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ee34043de23ba140b1 HTTP/1.1" 200 None 2026-04-08 00:53:37,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:37,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:53:37,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:37,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ee34043de23ba140b1 HTTP/1.1" 200 None 2026-04-08 00:53:37,284 - lava_callback - INFO - Completed processing callback for node 69d5a4ee34043de23ba140b1 INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:53:49,969 - lava_callback - INFO - Received callback for node 69d3040a13dd9a9509893e2b INFO: 172.20.0.1:48610 - "POST /node/69d3040a13dd9a9509893e2b HTTP/1.0" 202 Accepted 2026-04-08 00:53:49,979 - lava_callback - INFO - Starting async job submit for node 69d3040a13dd9a9509893e2b 2026-04-08 00:53:49,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040a13dd9a9509893e2b HTTP/1.1" 200 None 2026-04-08 00:53:50,016 - lava_callback - DEBUG - Processing node 69d3040a13dd9a9509893e2b: baseline-arm-clabbe 2026-04-08 00:53:50,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3040a13dd9a9509893e2b 2026-04-08 00:53:50,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:50,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3040a13dd9a9509893e2b HTTP/1.1" 200 None 2026-04-08 00:53:50,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:50,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:53:50,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:50,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3040a13dd9a9509893e2b HTTP/1.1" 200 None 2026-04-08 00:53:50,103 - lava_callback - ERROR - Error processing callback for node 69d3040a13dd9a9509893e2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 00:53:55,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:53:55,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:54:10,003 - lava_callback - INFO - Received callback for node 69d3042a13dd9a9509893e81 INFO: 172.20.0.1:52726 - "POST /node/69d3042a13dd9a9509893e81 HTTP/1.0" 202 Accepted 2026-04-08 00:54:10,013 - lava_callback - INFO - Starting async job submit for node 69d3042a13dd9a9509893e81 2026-04-08 00:54:10,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:10,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3042a13dd9a9509893e81 HTTP/1.1" 200 None 2026-04-08 00:54:10,036 - lava_callback - DEBUG - Processing node 69d3042a13dd9a9509893e81: baseline-arm-clabbe 2026-04-08 00:54:10,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3042a13dd9a9509893e81 2026-04-08 00:54:10,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:10,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3042a13dd9a9509893e81 HTTP/1.1" 200 None 2026-04-08 00:54:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:10,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:54:10,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:10,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3042a13dd9a9509893e81 HTTP/1.1" 200 None 2026-04-08 00:54:10,133 - lava_callback - ERROR - Error processing callback for node 69d3042a13dd9a9509893e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:54:50,083 - lava_callback - INFO - Received callback for node 69d3044e13dd9a9509893eab INFO: 172.20.0.1:59204 - "POST /node/69d3044e13dd9a9509893eab HTTP/1.0" 202 Accepted 2026-04-08 00:54:50,092 - lava_callback - INFO - Starting async job submit for node 69d3044e13dd9a9509893eab 2026-04-08 00:54:50,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:50,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3044e13dd9a9509893eab HTTP/1.1" 200 None 2026-04-08 00:54:50,113 - lava_callback - DEBUG - Processing node 69d3044e13dd9a9509893eab: baseline-arm-clabbe 2026-04-08 00:54:50,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3044e13dd9a9509893eab 2026-04-08 00:54:50,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:50,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3044e13dd9a9509893eab HTTP/1.1" 200 None 2026-04-08 00:54:50,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:50,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:54:50,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:54:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3044e13dd9a9509893eab HTTP/1.1" 200 None 2026-04-08 00:54:50,200 - lava_callback - ERROR - Error processing callback for node 69d3044e13dd9a9509893eab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56124 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:55:30,092 - lava_callback - INFO - Received callback for node 69d3047213dd9a9509893eff INFO: 172.20.0.1:35270 - "POST /node/69d3047213dd9a9509893eff HTTP/1.0" 202 Accepted 2026-04-08 00:55:30,098 - lava_callback - INFO - Starting async job submit for node 69d3047213dd9a9509893eff 2026-04-08 00:55:30,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:30,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3047213dd9a9509893eff HTTP/1.1" 200 None 2026-04-08 00:55:30,114 - lava_callback - DEBUG - Processing node 69d3047213dd9a9509893eff: baseline-arm-clabbe 2026-04-08 00:55:30,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3047213dd9a9509893eff 2026-04-08 00:55:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:30,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3047213dd9a9509893eff HTTP/1.1" 200 None 2026-04-08 00:55:30,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:30,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:55:30,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:30,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3047213dd9a9509893eff HTTP/1.1" 200 None 2026-04-08 00:55:30,178 - lava_callback - ERROR - Error processing callback for node 69d3047213dd9a9509893eff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50190 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:55:50,118 - lava_callback - INFO - Received callback for node 69d3048f13dd9a9509893f5d INFO: 172.20.0.1:41938 - "POST /node/69d3048f13dd9a9509893f5d HTTP/1.0" 202 Accepted 2026-04-08 00:55:50,124 - lava_callback - INFO - Starting async job submit for node 69d3048f13dd9a9509893f5d 2026-04-08 00:55:50,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:50,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3048f13dd9a9509893f5d HTTP/1.1" 200 None 2026-04-08 00:55:50,141 - lava_callback - DEBUG - Processing node 69d3048f13dd9a9509893f5d: baseline-arm-clabbe 2026-04-08 00:55:50,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3048f13dd9a9509893f5d 2026-04-08 00:55:50,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:50,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3048f13dd9a9509893f5d HTTP/1.1" 200 None 2026-04-08 00:55:50,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:50,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 00:55:50,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:55:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3048f13dd9a9509893f5d HTTP/1.1" 200 None 2026-04-08 00:55:50,198 - lava_callback - ERROR - Error processing callback for node 69d3048f13dd9a9509893f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46226 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:56:11,238 - lava_callback - INFO - Received callback for node 69d5a4f334043de23ba140be INFO: 172.20.0.1:47264 - "POST /node/69d5a4f334043de23ba140be HTTP/1.0" 202 Accepted 2026-04-08 00:56:11,249 - lava_callback - INFO - Starting async job submit for node 69d5a4f334043de23ba140be 2026-04-08 00:56:11,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:56:11,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f334043de23ba140be HTTP/1.1" 200 None 2026-04-08 00:56:11,328 - lava_callback - DEBUG - Processing node 69d5a4f334043de23ba140be: ltp-timers 2026-04-08 00:56:11,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:56:12,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:56:12,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d5a4f334043de23ba140be/log.txt.gz 2026-04-08 00:56:12,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:56:12,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:56:12,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d5a4f334043de23ba140be/lava-logs.yaml 2026-04-08 00:56:12,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:56:13,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:56:13,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d5a4f334043de23ba140be/lava_callback.json.gz 2026-04-08 00:56:13,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:56:13,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f334043de23ba140be HTTP/1.1" 200 None 2026-04-08 00:56:13,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:56:13,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:56:13,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:56:13,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4f334043de23ba140be HTTP/1.1" 200 None 2026-04-08 00:56:13,255 - lava_callback - INFO - Completed processing callback for node 69d5a4f334043de23ba140be INFO: 172.20.0.1:47272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:56:25,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:56:25,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET /node/69485e9a9214b49387168dd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60456 - "GET /node/6991f80101ff1e8e0859d4b1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET /node/691133abf15111fc8ce46825%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54362 - "GET /node/6940a96a1e3c24e95681a269%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:59:42,367 - lava_callback - INFO - Received callback for node 69d5a4f434043de23ba140c1 INFO: 172.20.0.1:35840 - "POST /node/69d5a4f434043de23ba140c1 HTTP/1.0" 202 Accepted 2026-04-08 00:59:42,373 - lava_callback - INFO - Starting async job submit for node 69d5a4f434043de23ba140c1 2026-04-08 00:59:42,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:59:42,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f434043de23ba140c1 HTTP/1.1" 200 None 2026-04-08 00:59:42,425 - lava_callback - DEBUG - Processing node 69d5a4f434043de23ba140c1: ltp-watchqueue 2026-04-08 00:59:42,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:59:43,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:59:43,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d5a4f434043de23ba140c1/log.txt.gz 2026-04-08 00:59:43,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:59:43,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:59:43,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d5a4f434043de23ba140c1/lava-logs.yaml 2026-04-08 00:59:43,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 00:59:43,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 00:59:43,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d5a4f434043de23ba140c1/lava_callback.json.gz 2026-04-08 00:59:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:59:43,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f434043de23ba140c1 HTTP/1.1" 200 None 2026-04-08 00:59:43,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:59:43,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 00:59:43,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:59:43,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4f434043de23ba140c1 HTTP/1.1" 200 None 2026-04-08 00:59:43,780 - lava_callback - INFO - Completed processing callback for node 69d5a4f434043de23ba140c1 INFO: 172.20.0.1:35842 - "GET / HTTP/1.0" 200 OK 2026-04-08 00:59:55,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 00:59:55,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET /node/6991865510b45da7d7d0fd58%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:01:17,593 - lava_callback - INFO - Received callback for node 69d5a4ad34043de23ba13f8f INFO: 172.20.0.1:60544 - "POST /node/69d5a4ad34043de23ba13f8f HTTP/1.0" 202 Accepted 2026-04-08 01:01:17,604 - lava_callback - INFO - Starting async job submit for node 69d5a4ad34043de23ba13f8f 2026-04-08 01:01:17,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:01:17,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ad34043de23ba13f8f HTTP/1.1" 200 None 2026-04-08 01:01:17,740 - lava_callback - DEBUG - Processing node 69d5a4ad34043de23ba13f8f: baseline-arm 2026-04-08 01:01:18,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:01:18,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:01:18,528 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ad34043de23ba13f8f/log.txt.gz 2026-04-08 01:01:19,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:01:19,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:01:19,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ad34043de23ba13f8f/lava-logs.yaml 2026-04-08 01:01:19,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:01:19,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:01:19,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a4ad34043de23ba13f8f/lava_callback.json.gz DEBUG: Setup failed for 69d5a4ad34043de23ba13f8f. Transitting job node result: incomplete -> fail 2026-04-08 01:01:19,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:01:19,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4ad34043de23ba13f8f HTTP/1.1" 200 None 2026-04-08 01:01:19,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:01:19,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:01:19,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:01:19,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4ad34043de23ba13f8f HTTP/1.1" 200 None 2026-04-08 01:01:19,901 - lava_callback - INFO - Completed processing callback for node 69d5a4ad34043de23ba13f8f 2026-04-08 01:01:25,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:01:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:03:05,636 - lava_callback - INFO - Received callback for node 69d5a93134043de23ba14504 INFO: 172.20.0.1:57404 - "POST /node/69d5a93134043de23ba14504 HTTP/1.0" 202 Accepted 2026-04-08 01:03:05,642 - lava_callback - INFO - Starting async job submit for node 69d5a93134043de23ba14504 2026-04-08 01:03:05,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:05,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a93134043de23ba14504 HTTP/1.1" 200 None 2026-04-08 01:03:05,661 - lava_callback - DEBUG - Processing node 69d5a93134043de23ba14504: baseline-arm 2026-04-08 01:03:05,667 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:03:05,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:03:05,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:03:05,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a93134043de23ba14504/lava-logs.yaml 2026-04-08 01:03:05,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:03:05,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:03:05,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5a93134043de23ba14504/lava_callback.json.gz 2026-04-08 01:03:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:05,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a93134043de23ba14504 HTTP/1.1" 200 None 2026-04-08 01:03:05,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:06,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:03:06,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:06,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a93134043de23ba14504 HTTP/1.1" 200 None 2026-04-08 01:03:06,064 - lava_callback - INFO - Completed processing callback for node 69d5a93134043de23ba14504 INFO: 172.20.0.1:57412 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:03:11,421 - lava_callback - INFO - Received callback for node 69d5a86434043de23ba14471 INFO: 172.20.0.1:46780 - "POST /node/69d5a86434043de23ba14471 HTTP/1.0" 202 Accepted 2026-04-08 01:03:11,427 - lava_callback - INFO - Starting async job submit for node 69d5a86434043de23ba14471 2026-04-08 01:03:11,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:11,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a86434043de23ba14471 HTTP/1.1" 200 None 2026-04-08 01:03:11,473 - lava_callback - DEBUG - Processing node 69d5a86434043de23ba14471: ltp-cap_bounds 2026-04-08 01:03:11,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:03:11,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:03:11,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d5a86434043de23ba14471/log.txt.gz 2026-04-08 01:03:12,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:03:12,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:03:12,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d5a86434043de23ba14471/lava-logs.yaml 2026-04-08 01:03:12,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:03:12,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:03:12,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d5a86434043de23ba14471/lava_callback.json.gz 2026-04-08 01:03:12,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:12,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a86434043de23ba14471 HTTP/1.1" 200 None 2026-04-08 01:03:12,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:03:12,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:12,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a86434043de23ba14471 HTTP/1.1" 200 None 2026-04-08 01:03:12,594 - lava_callback - INFO - Completed processing callback for node 69d5a86434043de23ba14471 INFO: 172.20.0.1:46782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:03:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:03:25,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35802 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:04:06,867 - lava_callback - INFO - Received callback for node 69d3067613dd9a95098941c2 INFO: 172.20.0.1:35806 - "POST /node/69d3067613dd9a95098941c2 HTTP/1.0" 202 Accepted 2026-04-08 01:04:06,873 - lava_callback - INFO - Starting async job submit for node 69d3067613dd9a95098941c2 2026-04-08 01:04:06,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:06,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3067613dd9a95098941c2 HTTP/1.1" 200 None 2026-04-08 01:04:06,889 - lava_callback - DEBUG - Processing node 69d3067613dd9a95098941c2: baseline-arm-baylibre 2026-04-08 01:04:06,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3067613dd9a95098941c2 2026-04-08 01:04:06,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:06,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3067613dd9a95098941c2 HTTP/1.1" 200 None 2026-04-08 01:04:06,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:06,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:04:06,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:06,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3067613dd9a95098941c2 HTTP/1.1" 200 None 2026-04-08 01:04:06,964 - lava_callback - ERROR - Error processing callback for node 69d3067613dd9a95098941c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:04:46,797 - lava_callback - INFO - Received callback for node 69d3069913dd9a95098941dc INFO: 172.20.0.1:41648 - "POST /node/69d3069913dd9a95098941dc HTTP/1.0" 202 Accepted 2026-04-08 01:04:46,805 - lava_callback - INFO - Starting async job submit for node 69d3069913dd9a95098941dc 2026-04-08 01:04:46,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:46,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3069913dd9a95098941dc HTTP/1.1" 200 None 2026-04-08 01:04:46,823 - lava_callback - DEBUG - Processing node 69d3069913dd9a95098941dc: baseline-arm-baylibre 2026-04-08 01:04:46,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3069913dd9a95098941dc 2026-04-08 01:04:46,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:46,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3069913dd9a95098941dc HTTP/1.1" 200 None 2026-04-08 01:04:46,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:46,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:04:46,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:04:46,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3069913dd9a95098941dc HTTP/1.1" 200 None 2026-04-08 01:04:46,878 - lava_callback - ERROR - Error processing callback for node 69d3069913dd9a95098941dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:05:02,587 - lava_callback - INFO - Received callback for node 69d5a8cd34043de23ba1449a INFO: 172.20.0.1:58568 - "POST /node/69d5a8cd34043de23ba1449a HTTP/1.0" 202 Accepted 2026-04-08 01:05:02,596 - lava_callback - INFO - Starting async job submit for node 69d5a8cd34043de23ba1449a 2026-04-08 01:05:02,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:05:02,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a8cd34043de23ba1449a HTTP/1.1" 200 None 2026-04-08 01:05:02,637 - lava_callback - DEBUG - Processing node 69d5a8cd34043de23ba1449a: ltp-pty 2026-04-08 01:05:02,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:05:03,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:05:03,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d5a8cd34043de23ba1449a/log.txt.gz 2026-04-08 01:05:03,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:05:03,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:05:03,519 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d5a8cd34043de23ba1449a/lava-logs.yaml 2026-04-08 01:05:03,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:05:03,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:05:03,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d5a8cd34043de23ba1449a/lava_callback.json.gz 2026-04-08 01:05:03,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:05:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a8cd34043de23ba1449a HTTP/1.1" 200 None 2026-04-08 01:05:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:05:03,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:05:03,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:05:03,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a8cd34043de23ba1449a HTTP/1.1" 200 None 2026-04-08 01:05:03,781 - lava_callback - INFO - Completed processing callback for node 69d5a8cd34043de23ba1449a INFO: 172.20.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET /node/699279ec98a8bdb31c3940cd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43888 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:05:25,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:05:25,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52878 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:01,639 - lava_callback - INFO - Received callback for node 69d5aad234043de23ba146c0 INFO: 172.20.0.1:45178 - "POST /node/69d5aad234043de23ba146c0 HTTP/1.0" 202 Accepted 2026-04-08 01:10:01,646 - lava_callback - INFO - Starting async job submit for node 69d5aad234043de23ba146c0 2026-04-08 01:10:01,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:01,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad234043de23ba146c0 HTTP/1.1" 200 None 2026-04-08 01:10:01,680 - lava_callback - DEBUG - Processing node 69d5aad234043de23ba146c0: baseline-arm64 2026-04-08 01:10:01,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:02,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:02,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad234043de23ba146c0/log.txt.gz 2026-04-08 01:10:02,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:02,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:02,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad234043de23ba146c0/lava-logs.yaml 2026-04-08 01:10:02,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:02,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:02,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad234043de23ba146c0/lava_callback.json.gz 2026-04-08 01:10:02,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:02,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad234043de23ba146c0 HTTP/1.1" 200 None 2026-04-08 01:10:02,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:02,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:02,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad234043de23ba146c0 HTTP/1.1" 200 None 2026-04-08 01:10:02,675 - lava_callback - INFO - Completed processing callback for node 69d5aad234043de23ba146c0 INFO: 172.20.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:25,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:27,146 - lava_callback - INFO - Received callback for node 69d307f313dd9a95098942e7 INFO: 172.20.0.1:57712 - "POST /node/69d307f313dd9a95098942e7 HTTP/1.0" 202 Accepted 2026-04-08 01:10:27,152 - lava_callback - INFO - Starting async job submit for node 69d307f313dd9a95098942e7 2026-04-08 01:10:27,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:27,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d307f313dd9a95098942e7 HTTP/1.1" 200 None 2026-04-08 01:10:27,172 - lava_callback - DEBUG - Processing node 69d307f313dd9a95098942e7: baseline-arm-baylibre 2026-04-08 01:10:27,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d307f313dd9a95098942e7 2026-04-08 01:10:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:27,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d307f313dd9a95098942e7 HTTP/1.1" 200 None 2026-04-08 01:10:27,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:10:27,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d307f313dd9a95098942e7 HTTP/1.1" 200 None 2026-04-08 01:10:27,237 - lava_callback - ERROR - Error processing callback for node 69d307f313dd9a95098942e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:10:30,091 - lava_callback - INFO - Received callback for node 69d5aad634043de23ba146cc INFO: 172.20.0.1:40846 - "POST /node/69d5aad634043de23ba146cc HTTP/1.0" 202 Accepted 2026-04-08 01:10:30,098 - lava_callback - INFO - Starting async job submit for node 69d5aad634043de23ba146cc 2026-04-08 01:10:30,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad634043de23ba146cc HTTP/1.1" 200 None 2026-04-08 01:10:30,152 - lava_callback - DEBUG - Processing node 69d5aad634043de23ba146cc: baseline-arm64 2026-04-08 01:10:30,415 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:10:30,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:30,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:30,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad634043de23ba146cc/lava-logs.yaml 2026-04-08 01:10:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:30,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:30,864 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad634043de23ba146cc/lava_callback.json.gz 2026-04-08 01:10:30,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:30,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad634043de23ba146cc HTTP/1.1" 200 None 2026-04-08 01:10:30,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:30,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:30,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:30,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad634043de23ba146cc HTTP/1.1" 200 None 2026-04-08 01:10:31,055 - lava_callback - INFO - Completed processing callback for node 69d5aad634043de23ba146cc 2026-04-08 01:10:31,144 - lava_callback - INFO - Received callback for node 69d5aad734043de23ba146cf INFO: 172.20.0.1:40862 - "POST /node/69d5aad734043de23ba146cf HTTP/1.0" 202 Accepted 2026-04-08 01:10:31,151 - lava_callback - INFO - Starting async job submit for node 69d5aad734043de23ba146cf 2026-04-08 01:10:31,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad734043de23ba146cf HTTP/1.1" 200 None 2026-04-08 01:10:31,212 - lava_callback - DEBUG - Processing node 69d5aad734043de23ba146cf: baseline-arm64 2026-04-08 01:10:31,328 - lava_callback - INFO - Received callback for node 69d5aaef34043de23ba1471c INFO: 172.20.0.1:40864 - "POST /node/69d5aaef34043de23ba1471c HTTP/1.0" 202 Accepted 2026-04-08 01:10:31,350 - lava_callback - INFO - Starting async job submit for node 69d5aaef34043de23ba1471c 2026-04-08 01:10:31,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,367 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:10:31,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaef34043de23ba1471c HTTP/1.1" 200 None 2026-04-08 01:10:31,445 - lava_callback - DEBUG - Processing node 69d5aaef34043de23ba1471c: baseline-nfs-arm64 2026-04-08 01:10:31,448 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:10:31,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:31,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:31,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:31,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaef34043de23ba1471c/lava-logs.yaml 2026-04-08 01:10:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:31,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:31,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad734043de23ba146cf/lava-logs.yaml 2026-04-08 01:10:31,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:31,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:31,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaef34043de23ba1471c/lava_callback.json.gz 2026-04-08 01:10:31,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaef34043de23ba1471c HTTP/1.1" 200 None 2026-04-08 01:10:31,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:31,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaef34043de23ba1471c HTTP/1.1" 200 None 2026-04-08 01:10:31,815 - lava_callback - INFO - Completed processing callback for node 69d5aaef34043de23ba1471c 2026-04-08 01:10:31,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:31,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad734043de23ba146cf/lava_callback.json.gz 2026-04-08 01:10:31,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad734043de23ba146cf HTTP/1.1" 200 None 2026-04-08 01:10:31,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:31,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:31,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:32,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad734043de23ba146cf HTTP/1.1" 200 None 2026-04-08 01:10:32,182 - lava_callback - INFO - Completed processing callback for node 69d5aad734043de23ba146cf INFO: 172.20.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:40,785 - lava_callback - INFO - Received callback for node 69d5aade34043de23ba146ee INFO: 172.20.0.1:58548 - "POST /node/69d5aade34043de23ba146ee HTTP/1.0" 202 Accepted 2026-04-08 01:10:40,791 - lava_callback - INFO - Starting async job submit for node 69d5aade34043de23ba146ee 2026-04-08 01:10:40,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:40,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aade34043de23ba146ee HTTP/1.1" 200 None 2026-04-08 01:10:40,826 - lava_callback - DEBUG - Processing node 69d5aade34043de23ba146ee: baseline-arm64 2026-04-08 01:10:40,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:41,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:41,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aade34043de23ba146ee/log.txt.gz 2026-04-08 01:10:41,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:41,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:41,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aade34043de23ba146ee/lava-logs.yaml 2026-04-08 01:10:41,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:41,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:41,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aade34043de23ba146ee/lava_callback.json.gz 2026-04-08 01:10:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:41,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aade34043de23ba146ee HTTP/1.1" 200 None 2026-04-08 01:10:41,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:41,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:41,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:41,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aade34043de23ba146ee HTTP/1.1" 200 None 2026-04-08 01:10:41,706 - lava_callback - INFO - Completed processing callback for node 69d5aade34043de23ba146ee INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:49,370 - lava_callback - INFO - Received callback for node 69d5aad334043de23ba146c6 INFO: 172.20.0.1:58560 - "POST /node/69d5aad334043de23ba146c6 HTTP/1.0" 202 Accepted 2026-04-08 01:10:49,376 - lava_callback - INFO - Starting async job submit for node 69d5aad334043de23ba146c6 2026-04-08 01:10:49,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:49,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad334043de23ba146c6 HTTP/1.1" 200 None 2026-04-08 01:10:49,417 - lava_callback - DEBUG - Processing node 69d5aad334043de23ba146c6: baseline-arm64 2026-04-08 01:10:49,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:49,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:49,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c6/log.txt.gz 2026-04-08 01:10:50,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:50,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:50,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c6/lava-logs.yaml 2026-04-08 01:10:50,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:50,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:50,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c6/lava_callback.json.gz 2026-04-08 01:10:50,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:50,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad334043de23ba146c6 HTTP/1.1" 200 None 2026-04-08 01:10:50,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:50,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:50,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:50,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad334043de23ba146c6 HTTP/1.1" 200 None 2026-04-08 01:10:50,649 - lava_callback - INFO - Completed processing callback for node 69d5aad334043de23ba146c6 2026-04-08 01:10:55,306 - lava_callback - INFO - Received callback for node 69d5aadb34043de23ba146e5 INFO: 172.20.0.1:45648 - "POST /node/69d5aadb34043de23ba146e5 HTTP/1.0" 202 Accepted 2026-04-08 01:10:55,313 - lava_callback - INFO - Starting async job submit for node 69d5aadb34043de23ba146e5 2026-04-08 01:10:55,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:55,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadb34043de23ba146e5 HTTP/1.1" 200 None 2026-04-08 01:10:55,359 - lava_callback - DEBUG - Processing node 69d5aadb34043de23ba146e5: baseline-arm64 2026-04-08 01:10:55,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:55,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-08 01:10:55,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:55,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:55,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadb34043de23ba146e5/log.txt.gz 2026-04-08 01:10:56,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:56,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:56,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadb34043de23ba146e5/lava-logs.yaml 2026-04-08 01:10:56,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:10:56,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:10:56,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadb34043de23ba146e5/lava_callback.json.gz 2026-04-08 01:10:56,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:56,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadb34043de23ba146e5 HTTP/1.1" 200 None 2026-04-08 01:10:56,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:10:56,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:10:56,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:10:56,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aadb34043de23ba146e5 HTTP/1.1" 200 None 2026-04-08 01:10:56,560 - lava_callback - INFO - Completed processing callback for node 69d5aadb34043de23ba146e5 2026-04-08 01:11:02,249 - lava_callback - INFO - Received callback for node 69d5aadf34043de23ba146f1 INFO: 172.20.0.1:55090 - "POST /node/69d5aadf34043de23ba146f1 HTTP/1.0" 202 Accepted 2026-04-08 01:11:02,255 - lava_callback - INFO - Starting async job submit for node 69d5aadf34043de23ba146f1 2026-04-08 01:11:02,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:02,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadf34043de23ba146f1 HTTP/1.1" 200 None 2026-04-08 01:11:02,291 - lava_callback - DEBUG - Processing node 69d5aadf34043de23ba146f1: baseline-arm64 2026-04-08 01:11:02,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:02,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:02,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadf34043de23ba146f1/log.txt.gz 2026-04-08 01:11:02,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:02,861 - lava_callback - INFO - Received callback for node 69d5aae334043de23ba146fb INFO: 172.20.0.1:55102 - "POST /node/69d5aae334043de23ba146fb HTTP/1.0" 202 Accepted 2026-04-08 01:11:02,871 - lava_callback - INFO - Starting async job submit for node 69d5aae334043de23ba146fb 2026-04-08 01:11:02,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:02,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae334043de23ba146fb HTTP/1.1" 200 None 2026-04-08 01:11:02,936 - lava_callback - DEBUG - Processing node 69d5aae334043de23ba146fb: baseline-arm64 2026-04-08 01:11:03,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:03,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadf34043de23ba146f1/lava-logs.yaml 2026-04-08 01:11:03,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:03,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:03,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:03,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadf34043de23ba146f1/lava_callback.json.gz 2026-04-08 01:11:03,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:03,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:03,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae334043de23ba146fb/log.txt.gz 2026-04-08 01:11:03,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadf34043de23ba146f1 HTTP/1.1" 200 None 2026-04-08 01:11:03,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:03,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:03,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:03,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:03,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aadf34043de23ba146f1 HTTP/1.1" 200 None 2026-04-08 01:11:03,576 - lava_callback - INFO - Completed processing callback for node 69d5aadf34043de23ba146f1 2026-04-08 01:11:03,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:03,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae334043de23ba146fb/lava-logs.yaml 2026-04-08 01:11:03,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:03,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:03,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae334043de23ba146fb/lava_callback.json.gz 2026-04-08 01:11:03,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:04,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae334043de23ba146fb HTTP/1.1" 200 None 2026-04-08 01:11:04,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:04,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:04,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:04,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae334043de23ba146fb HTTP/1.1" 200 None 2026-04-08 01:11:04,051 - lava_callback - INFO - Completed processing callback for node 69d5aae334043de23ba146fb 2026-04-08 01:11:05,305 - lava_callback - INFO - Received callback for node 69d5aad334043de23ba146c3 INFO: 172.20.0.1:55108 - "POST /node/69d5aad334043de23ba146c3 HTTP/1.0" 202 Accepted 2026-04-08 01:11:05,311 - lava_callback - INFO - Starting async job submit for node 69d5aad334043de23ba146c3 2026-04-08 01:11:05,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:05,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad334043de23ba146c3 HTTP/1.1" 200 None 2026-04-08 01:11:05,356 - lava_callback - DEBUG - Processing node 69d5aad334043de23ba146c3: baseline-arm64 2026-04-08 01:11:05,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:05,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:05,729 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c3/log.txt.gz 2026-04-08 01:11:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:06,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:06,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c3/lava-logs.yaml 2026-04-08 01:11:06,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:06,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:06,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad334043de23ba146c3/lava_callback.json.gz 2026-04-08 01:11:06,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:06,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad334043de23ba146c3 HTTP/1.1" 200 None 2026-04-08 01:11:06,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:06,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:06,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:06,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad334043de23ba146c3 HTTP/1.1" 200 None 2026-04-08 01:11:06,291 - lava_callback - INFO - Completed processing callback for node 69d5aad334043de23ba146c3 INFO: 172.20.0.1:55112 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:08,046 - lava_callback - INFO - Received callback for node 69d5aadc34043de23ba146e8 INFO: 172.20.0.1:55126 - "POST /node/69d5aadc34043de23ba146e8 HTTP/1.0" 202 Accepted 2026-04-08 01:11:08,053 - lava_callback - INFO - Starting async job submit for node 69d5aadc34043de23ba146e8 2026-04-08 01:11:08,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:08,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadc34043de23ba146e8 HTTP/1.1" 200 None 2026-04-08 01:11:08,087 - lava_callback - DEBUG - Processing node 69d5aadc34043de23ba146e8: baseline-arm64 2026-04-08 01:11:08,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:08,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:08,567 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadc34043de23ba146e8/log.txt.gz 2026-04-08 01:11:08,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:08,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:08,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadc34043de23ba146e8/lava-logs.yaml 2026-04-08 01:11:08,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:09,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:09,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadc34043de23ba146e8/lava_callback.json.gz 2026-04-08 01:11:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:09,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadc34043de23ba146e8 HTTP/1.1" 200 None 2026-04-08 01:11:09,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:09,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:09,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aadc34043de23ba146e8 HTTP/1.1" 200 None 2026-04-08 01:11:09,243 - lava_callback - INFO - Completed processing callback for node 69d5aadc34043de23ba146e8 INFO: 172.20.0.1:35372 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-08 01:11:16,075 - lava_callback - INFO - Received callback for node 69d5aad434043de23ba146c9 INFO: 172.20.0.1:35382 - "POST /node/69d5aad434043de23ba146c9 HTTP/1.0" 202 Accepted 2026-04-08 01:11:16,081 - lava_callback - INFO - Starting async job submit for node 69d5aad434043de23ba146c9 2026-04-08 01:11:16,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:16,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad434043de23ba146c9 HTTP/1.1" 200 None 2026-04-08 01:11:16,118 - lava_callback - DEBUG - Processing node 69d5aad434043de23ba146c9: baseline-arm64 2026-04-08 01:11:16,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:16,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:16,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad434043de23ba146c9/log.txt.gz INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:16,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:16,860 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad434043de23ba146c9/lava-logs.yaml 2026-04-08 01:11:16,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:17,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:17,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad434043de23ba146c9/lava_callback.json.gz 2026-04-08 01:11:17,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:17,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad434043de23ba146c9 HTTP/1.1" 200 None 2026-04-08 01:11:17,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:17,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:17,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:17,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad434043de23ba146c9 HTTP/1.1" 200 None 2026-04-08 01:11:17,184 - lava_callback - INFO - Completed processing callback for node 69d5aad434043de23ba146c9 2026-04-08 01:11:18,355 - lava_callback - INFO - Received callback for node 69d5aae234043de23ba146f8 INFO: 172.20.0.1:35400 - "POST /node/69d5aae234043de23ba146f8 HTTP/1.0" 202 Accepted 2026-04-08 01:11:18,361 - lava_callback - INFO - Starting async job submit for node 69d5aae234043de23ba146f8 2026-04-08 01:11:18,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:18,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae234043de23ba146f8 HTTP/1.1" 200 None 2026-04-08 01:11:18,398 - lava_callback - DEBUG - Processing node 69d5aae234043de23ba146f8: baseline-arm64 2026-04-08 01:11:18,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:18,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:18,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae234043de23ba146f8/log.txt.gz 2026-04-08 01:11:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:19,020 - lava_callback - INFO - Received callback for node 69d5aaed34043de23ba14714 INFO: 172.20.0.1:35408 - "POST /node/69d5aaed34043de23ba14714 HTTP/1.0" 202 Accepted 2026-04-08 01:11:19,026 - lava_callback - INFO - Starting async job submit for node 69d5aaed34043de23ba14714 2026-04-08 01:11:19,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:19,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaed34043de23ba14714 HTTP/1.1" 200 None 2026-04-08 01:11:19,069 - lava_callback - DEBUG - Processing node 69d5aaed34043de23ba14714: baseline-nfs-arm64 2026-04-08 01:11:19,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:19,240 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae234043de23ba146f8/lava-logs.yaml 2026-04-08 01:11:19,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:19,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:19,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae234043de23ba146f8/lava_callback.json.gz 2026-04-08 01:11:19,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:19,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae234043de23ba146f8 HTTP/1.1" 200 None 2026-04-08 01:11:19,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:19,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:19,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:19,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae234043de23ba146f8 HTTP/1.1" 200 None 2026-04-08 01:11:19,683 - lava_callback - INFO - Completed processing callback for node 69d5aae234043de23ba146f8 2026-04-08 01:11:19,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:19,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaed34043de23ba14714/log.txt.gz 2026-04-08 01:11:20,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:20,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:20,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaed34043de23ba14714/lava-logs.yaml 2026-04-08 01:11:20,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:20,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:20,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaed34043de23ba14714/lava_callback.json.gz 2026-04-08 01:11:20,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:20,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaed34043de23ba14714 HTTP/1.1" 200 None 2026-04-08 01:11:20,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:20,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:20,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:20,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaed34043de23ba14714 HTTP/1.1" 200 None 2026-04-08 01:11:20,627 - lava_callback - INFO - Completed processing callback for node 69d5aaed34043de23ba14714 2026-04-08 01:11:20,822 - lava_callback - INFO - Received callback for node 69d5aae434043de23ba146fe INFO: 172.20.0.1:42952 - "POST /node/69d5aae434043de23ba146fe HTTP/1.0" 202 Accepted 2026-04-08 01:11:20,829 - lava_callback - INFO - Starting async job submit for node 69d5aae434043de23ba146fe 2026-04-08 01:11:20,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:20,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae434043de23ba146fe HTTP/1.1" 200 None 2026-04-08 01:11:20,874 - lava_callback - DEBUG - Processing node 69d5aae434043de23ba146fe: baseline-arm64 2026-04-08 01:11:21,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:21,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:21,279 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae434043de23ba146fe/log.txt.gz 2026-04-08 01:11:21,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:21,531 - lava_callback - INFO - Received callback for node 69d5aad934043de23ba146e2 INFO: 172.20.0.1:42956 - "POST /node/69d5aad934043de23ba146e2 HTTP/1.0" 202 Accepted 2026-04-08 01:11:21,542 - lava_callback - INFO - Starting async job submit for node 69d5aad934043de23ba146e2 2026-04-08 01:11:21,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:21,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad934043de23ba146e2 HTTP/1.1" 200 None 2026-04-08 01:11:21,589 - lava_callback - DEBUG - Processing node 69d5aad934043de23ba146e2: baseline-arm64 2026-04-08 01:11:21,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:21,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae434043de23ba146fe/lava-logs.yaml 2026-04-08 01:11:21,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:21,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:22,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:22,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae434043de23ba146fe/lava_callback.json.gz 2026-04-08 01:11:22,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:22,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad934043de23ba146e2/log.txt.gz 2026-04-08 01:11:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae434043de23ba146fe HTTP/1.1" 200 None 2026-04-08 01:11:22,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:22,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:22,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae434043de23ba146fe HTTP/1.1" 200 None 2026-04-08 01:11:22,321 - lava_callback - INFO - Completed processing callback for node 69d5aae434043de23ba146fe 2026-04-08 01:11:22,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:22,524 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad934043de23ba146e2/lava-logs.yaml 2026-04-08 01:11:22,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:22,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:22,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad934043de23ba146e2/lava_callback.json.gz 2026-04-08 01:11:22,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad934043de23ba146e2 HTTP/1.1" 200 None 2026-04-08 01:11:22,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:22,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:22,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad934043de23ba146e2 HTTP/1.1" 200 None 2026-04-08 01:11:22,749 - lava_callback - INFO - Completed processing callback for node 69d5aad934043de23ba146e2 2026-04-08 01:11:25,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:25,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:42962 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:27,860 - lava_callback - INFO - Received callback for node 69d5aadd34043de23ba146eb INFO: 172.20.0.1:42974 - "POST /node/69d5aadd34043de23ba146eb HTTP/1.0" 202 Accepted 2026-04-08 01:11:27,867 - lava_callback - INFO - Starting async job submit for node 69d5aadd34043de23ba146eb 2026-04-08 01:11:27,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:27,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadd34043de23ba146eb HTTP/1.1" 200 None 2026-04-08 01:11:27,906 - lava_callback - DEBUG - Processing node 69d5aadd34043de23ba146eb: baseline-arm64 2026-04-08 01:11:28,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:28,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:28,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadd34043de23ba146eb/log.txt.gz 2026-04-08 01:11:28,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:28,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:28,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadd34043de23ba146eb/lava-logs.yaml 2026-04-08 01:11:28,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:29,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:29,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aadd34043de23ba146eb/lava_callback.json.gz 2026-04-08 01:11:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:29,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aadd34043de23ba146eb HTTP/1.1" 200 None 2026-04-08 01:11:29,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:29,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:29,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:29,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aadd34043de23ba146eb HTTP/1.1" 200 None 2026-04-08 01:11:29,318 - lava_callback - INFO - Completed processing callback for node 69d5aadd34043de23ba146eb INFO: 172.20.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:46,146 - lava_callback - INFO - Received callback for node 69d5aaee34043de23ba14717 INFO: 172.20.0.1:52806 - "POST /node/69d5aaee34043de23ba14717 HTTP/1.0" 202 Accepted 2026-04-08 01:11:46,153 - lava_callback - INFO - Starting async job submit for node 69d5aaee34043de23ba14717 2026-04-08 01:11:46,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:46,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaee34043de23ba14717 HTTP/1.1" 200 None 2026-04-08 01:11:46,194 - lava_callback - DEBUG - Processing node 69d5aaee34043de23ba14717: baseline-nfs-arm64 2026-04-08 01:11:46,434 - lava_callback - INFO - Received callback for node 69d5ab1c34043de23ba147f2 INFO: 172.20.0.1:52812 - "POST /node/69d5ab1c34043de23ba147f2 HTTP/1.0" 202 Accepted 2026-04-08 01:11:46,461 - lava_callback - INFO - Starting async job submit for node 69d5ab1c34043de23ba147f2 2026-04-08 01:11:46,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:52814 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:46,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1c34043de23ba147f2 HTTP/1.1" 200 None 2026-04-08 01:11:46,612 - lava_callback - DEBUG - Processing node 69d5ab1c34043de23ba147f2: baseline-arm64-foundriesio 2026-04-08 01:11:46,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:46,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:47,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:47,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1c34043de23ba147f2/log.txt.gz 2026-04-08 01:11:47,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:47,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:47,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaee34043de23ba14717/log.txt.gz 2026-04-08 01:11:47,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:47,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1c34043de23ba147f2/lava-logs.yaml 2026-04-08 01:11:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:47,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:47,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:47,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1c34043de23ba147f2/lava_callback.json.gz 2026-04-08 01:11:47,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1c34043de23ba147f2 HTTP/1.1" 200 None 2026-04-08 01:11:47,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:47,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:47,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:47,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1c34043de23ba147f2 HTTP/1.1" 200 None 2026-04-08 01:11:47,903 - lava_callback - INFO - Completed processing callback for node 69d5ab1c34043de23ba147f2 2026-04-08 01:11:47,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:47,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaee34043de23ba14717/lava-logs.yaml 2026-04-08 01:11:47,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:48,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:48,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaee34043de23ba14717/lava_callback.json.gz 2026-04-08 01:11:48,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:48,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaee34043de23ba14717 HTTP/1.1" 200 None 2026-04-08 01:11:48,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:48,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:48,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:48,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaee34043de23ba14717 HTTP/1.1" 200 None 2026-04-08 01:11:48,449 - lava_callback - INFO - Completed processing callback for node 69d5aaee34043de23ba14717 2026-04-08 01:11:49,193 - lava_callback - INFO - Received callback for node 69d5aaea34043de23ba1470a INFO: 172.20.0.1:52822 - "POST /node/69d5aaea34043de23ba1470a HTTP/1.0" 202 Accepted 2026-04-08 01:11:49,200 - lava_callback - INFO - Starting async job submit for node 69d5aaea34043de23ba1470a 2026-04-08 01:11:49,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:49,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaea34043de23ba1470a HTTP/1.1" 200 None 2026-04-08 01:11:49,248 - lava_callback - DEBUG - Processing node 69d5aaea34043de23ba1470a: baseline-nfs-arm64 2026-04-08 01:11:49,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:49,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:49,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaea34043de23ba1470a/log.txt.gz 2026-04-08 01:11:49,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:50,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:50,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaea34043de23ba1470a/lava-logs.yaml 2026-04-08 01:11:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:50,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:50,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaea34043de23ba1470a/lava_callback.json.gz 2026-04-08 01:11:50,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:50,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaea34043de23ba1470a HTTP/1.1" 200 None 2026-04-08 01:11:50,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:50,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:50,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaea34043de23ba1470a HTTP/1.1" 200 None 2026-04-08 01:11:50,464 - lava_callback - INFO - Completed processing callback for node 69d5aaea34043de23ba1470a 2026-04-08 01:11:51,046 - lava_callback - INFO - Received callback for node 69d5aaf434043de23ba1472a INFO: 172.20.0.1:42752 - "POST /node/69d5aaf434043de23ba1472a HTTP/1.0" 202 Accepted 2026-04-08 01:11:51,052 - lava_callback - INFO - Starting async job submit for node 69d5aaf434043de23ba1472a 2026-04-08 01:11:51,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:51,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf434043de23ba1472a HTTP/1.1" 200 None 2026-04-08 01:11:51,102 - lava_callback - DEBUG - Processing node 69d5aaf434043de23ba1472a: baseline-nfs-arm64 2026-04-08 01:11:51,295 - lava_callback - INFO - Received callback for node 69d5aaf334043de23ba14727 INFO: 172.20.0.1:42768 - "POST /node/69d5aaf334043de23ba14727 HTTP/1.0" 202 Accepted 2026-04-08 01:11:51,344 - lava_callback - INFO - Starting async job submit for node 69d5aaf334043de23ba14727 2026-04-08 01:11:51,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:51,455 - lava_callback - INFO - Received callback for node 69d5a4f134043de23ba140bb 2026-04-08 01:11:51,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf334043de23ba14727 HTTP/1.1" 200 None 2026-04-08 01:11:51,492 - lava_callback - DEBUG - Processing node 69d5aaf334043de23ba14727: baseline-nfs-arm64 INFO: 172.20.0.1:42778 - "POST /node/69d5a4f134043de23ba140bb HTTP/1.0" 202 Accepted 2026-04-08 01:11:51,554 - lava_callback - INFO - Starting async job submit for node 69d5a4f134043de23ba140bb 2026-04-08 01:11:51,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:51,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:51,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f134043de23ba140bb HTTP/1.1" 200 None 2026-04-08 01:11:51,744 - lava_callback - DEBUG - Processing node 69d5a4f134043de23ba140bb: ltp-syscalls-ipc 2026-04-08 01:11:51,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf434043de23ba1472a/log.txt.gz 2026-04-08 01:11:52,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5a4f134043de23ba140bb/log.txt.gz 2026-04-08 01:11:52,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf334043de23ba14727/log.txt.gz 2026-04-08 01:11:52,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5a4f134043de23ba140bb/lava-logs.yaml 2026-04-08 01:11:52,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,755 - lava_callback - INFO - Received callback for node 69d5aaf634043de23ba1472d 2026-04-08 01:11:52,772 - lava_callback - INFO - Starting async job submit for node 69d5aaf634043de23ba1472d INFO: 172.20.0.1:42782 - "POST /node/69d5aaf634043de23ba1472d HTTP/1.0" 202 Accepted 2026-04-08 01:11:52,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:52,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf434043de23ba1472a/lava-logs.yaml 2026-04-08 01:11:52,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:52,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf634043de23ba1472d HTTP/1.1" 200 None 2026-04-08 01:11:52,830 - lava_callback - DEBUG - Processing node 69d5aaf634043de23ba1472d: baseline-nfs-arm64 2026-04-08 01:11:52,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:52,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf334043de23ba14727/lava-logs.yaml 2026-04-08 01:11:52,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5a4f134043de23ba140bb/lava_callback.json.gz 2026-04-08 01:11:52,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:52,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:53,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf434043de23ba1472a/lava_callback.json.gz 2026-04-08 01:11:53,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:53,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a4f134043de23ba140bb HTTP/1.1" 200 None 2026-04-08 01:11:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:11:53,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf434043de23ba1472a HTTP/1.1" 200 None 2026-04-08 01:11:53,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:53,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:53,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a4f134043de23ba140bb HTTP/1.1" 200 None 2026-04-08 01:11:53,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:53,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf334043de23ba14727/lava_callback.json.gz 2026-04-08 01:11:53,512 - lava_callback - INFO - Completed processing callback for node 69d5a4f134043de23ba140bb 2026-04-08 01:11:53,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaf434043de23ba1472a HTTP/1.1" 200 None 2026-04-08 01:11:53,516 - lava_callback - INFO - Completed processing callback for node 69d5aaf434043de23ba1472a 2026-04-08 01:11:53,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf334043de23ba14727 HTTP/1.1" 200 None 2026-04-08 01:11:53,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:53,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:53,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaf334043de23ba14727 HTTP/1.1" 200 None 2026-04-08 01:11:53,688 - lava_callback - INFO - Completed processing callback for node 69d5aaf334043de23ba14727 2026-04-08 01:11:53,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf634043de23ba1472d/log.txt.gz 2026-04-08 01:11:54,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:54,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:54,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf634043de23ba1472d/lava-logs.yaml 2026-04-08 01:11:54,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:54,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:54,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf634043de23ba1472d/lava_callback.json.gz 2026-04-08 01:11:54,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:54,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf634043de23ba1472d HTTP/1.1" 200 None 2026-04-08 01:11:54,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:54,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:11:54,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:54,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaf634043de23ba1472d HTTP/1.1" 200 None 2026-04-08 01:11:54,491 - lava_callback - INFO - Completed processing callback for node 69d5aaf634043de23ba1472d 2026-04-08 01:11:55,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:55,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:42790 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:11:59,508 - lava_callback - INFO - Received callback for node 69d5ab1a34043de23ba147e8 INFO: 172.20.0.1:42792 - "POST /node/69d5ab1a34043de23ba147e8 HTTP/1.0" 202 Accepted 2026-04-08 01:11:59,514 - lava_callback - INFO - Starting async job submit for node 69d5ab1a34043de23ba147e8 2026-04-08 01:11:59,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:11:59,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1a34043de23ba147e8 HTTP/1.1" 200 None 2026-04-08 01:11:59,549 - lava_callback - DEBUG - Processing node 69d5ab1a34043de23ba147e8: baseline-arm64-pengutronix 2026-04-08 01:11:59,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:11:59,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:11:59,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1a34043de23ba147e8/log.txt.gz 2026-04-08 01:11:59,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:00,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:00,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1a34043de23ba147e8/lava-logs.yaml 2026-04-08 01:12:00,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:00,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:00,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1a34043de23ba147e8/lava_callback.json.gz 2026-04-08 01:12:00,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:00,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1a34043de23ba147e8 HTTP/1.1" 200 None 2026-04-08 01:12:00,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:00,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:00,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:00,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1a34043de23ba147e8 HTTP/1.1" 200 None 2026-04-08 01:12:00,395 - lava_callback - INFO - Completed processing callback for node 69d5ab1a34043de23ba147e8 2026-04-08 01:12:02,667 - lava_callback - INFO - Received callback for node 69d5ab0234043de23ba14775 INFO: 172.20.0.1:33314 - "POST /node/69d5ab0234043de23ba14775 HTTP/1.0" 202 Accepted 2026-04-08 01:12:02,675 - lava_callback - INFO - Starting async job submit for node 69d5ab0234043de23ba14775 2026-04-08 01:12:02,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:02,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0234043de23ba14775 HTTP/1.1" 200 None 2026-04-08 01:12:02,713 - lava_callback - DEBUG - Processing node 69d5ab0234043de23ba14775: baseline-arm64-broonie 2026-04-08 01:12:02,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:03,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:03,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0234043de23ba14775/log.txt.gz 2026-04-08 01:12:03,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:03,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:03,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0234043de23ba14775/lava-logs.yaml 2026-04-08 01:12:03,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:03,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:03,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0234043de23ba14775/lava_callback.json.gz 2026-04-08 01:12:03,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:03,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0234043de23ba14775 HTTP/1.1" 200 None 2026-04-08 01:12:03,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:03,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:03,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:03,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0234043de23ba14775 HTTP/1.1" 200 None 2026-04-08 01:12:03,594 - lava_callback - INFO - Completed processing callback for node 69d5ab0234043de23ba14775 2026-04-08 01:12:04,186 - lava_callback - INFO - Received callback for node 69d5ab0934043de23ba1478d INFO: 172.20.0.1:33318 - "POST /node/69d5ab0934043de23ba1478d HTTP/1.0" 202 Accepted 2026-04-08 01:12:04,192 - lava_callback - INFO - Starting async job submit for node 69d5ab0934043de23ba1478d 2026-04-08 01:12:04,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:04,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0934043de23ba1478d HTTP/1.1" 200 None 2026-04-08 01:12:04,234 - lava_callback - DEBUG - Processing node 69d5ab0934043de23ba1478d: baseline-arm64-broonie 2026-04-08 01:12:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:04,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:04,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0934043de23ba1478d/log.txt.gz 2026-04-08 01:12:04,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:04,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:04,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0934043de23ba1478d/lava-logs.yaml 2026-04-08 01:12:04,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:05,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:05,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0934043de23ba1478d/lava_callback.json.gz 2026-04-08 01:12:05,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:05,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0934043de23ba1478d HTTP/1.1" 200 None 2026-04-08 01:12:05,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:05,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:05,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:05,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0934043de23ba1478d HTTP/1.1" 200 None 2026-04-08 01:12:05,160 - lava_callback - INFO - Completed processing callback for node 69d5ab0934043de23ba1478d INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:12:07,260 - lava_callback - INFO - Received callback for node 69d3085913dd9a9509894334 INFO: 172.20.0.1:33346 - "POST /node/69d3085913dd9a9509894334 HTTP/1.0" 202 Accepted 2026-04-08 01:12:07,266 - lava_callback - INFO - Starting async job submit for node 69d3085913dd9a9509894334 2026-04-08 01:12:07,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:07,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3085913dd9a9509894334 HTTP/1.1" 200 None 2026-04-08 01:12:07,286 - lava_callback - DEBUG - Processing node 69d3085913dd9a9509894334: baseline-arm-baylibre 2026-04-08 01:12:07,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3085913dd9a9509894334 2026-04-08 01:12:07,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:07,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3085913dd9a9509894334 HTTP/1.1" 200 None 2026-04-08 01:12:07,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:07,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:12:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:07,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3085913dd9a9509894334 HTTP/1.1" 200 None 2026-04-08 01:12:07,347 - lava_callback - ERROR - Error processing callback for node 69d3085913dd9a9509894334: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:12:07,981 - lava_callback - INFO - Received callback for node 69d5ab1b34043de23ba147ef INFO: 172.20.0.1:33358 - "POST /node/69d5ab1b34043de23ba147ef HTTP/1.0" 202 Accepted 2026-04-08 01:12:07,987 - lava_callback - INFO - Starting async job submit for node 69d5ab1b34043de23ba147ef 2026-04-08 01:12:08,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1b34043de23ba147ef HTTP/1.1" 200 None 2026-04-08 01:12:08,025 - lava_callback - DEBUG - Processing node 69d5ab1b34043de23ba147ef: baseline-arm64-pengutronix 2026-04-08 01:12:08,055 - lava_callback - INFO - Received callback for node 69d5ab1734043de23ba147e2 INFO: 172.20.0.1:33368 - "POST /node/69d5ab1734043de23ba147e2 HTTP/1.0" 202 Accepted 2026-04-08 01:12:08,101 - lava_callback - INFO - Starting async job submit for node 69d5ab1734043de23ba147e2 2026-04-08 01:12:08,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:08,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1734043de23ba147e2 HTTP/1.1" 200 None 2026-04-08 01:12:08,263 - lava_callback - DEBUG - Processing node 69d5ab1734043de23ba147e2: baseline-arm64-kontron 2026-04-08 01:12:08,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:08,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:08,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1b34043de23ba147ef/log.txt.gz 2026-04-08 01:12:08,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:08,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1734043de23ba147e2/log.txt.gz 2026-04-08 01:12:08,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:08,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:08,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:08,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1b34043de23ba147ef/lava-logs.yaml 2026-04-08 01:12:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:09,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:09,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1734043de23ba147e2/lava-logs.yaml 2026-04-08 01:12:09,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:09,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:09,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d5ab1b34043de23ba147ef/lava_callback.json.gz 2026-04-08 01:12:09,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1b34043de23ba147ef HTTP/1.1" 200 None 2026-04-08 01:12:09,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:09,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:09,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1734043de23ba147e2/lava_callback.json.gz 2026-04-08 01:12:09,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1b34043de23ba147ef HTTP/1.1" 200 None 2026-04-08 01:12:09,225 - lava_callback - INFO - Completed processing callback for node 69d5ab1b34043de23ba147ef 2026-04-08 01:12:09,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1734043de23ba147e2 HTTP/1.1" 200 None 2026-04-08 01:12:09,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:09,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,325 - lava_callback - INFO - Received callback for node 69d5ab1834043de23ba147e5 2026-04-08 01:12:09,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1734043de23ba147e2 HTTP/1.1" 200 None 2026-04-08 01:12:09,357 - lava_callback - INFO - Completed processing callback for node 69d5ab1734043de23ba147e2 INFO: 172.20.0.1:33380 - "POST /node/69d5ab1834043de23ba147e5 HTTP/1.0" 202 Accepted 2026-04-08 01:12:09,363 - lava_callback - INFO - Starting async job submit for node 69d5ab1834043de23ba147e5 2026-04-08 01:12:09,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:09,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1834043de23ba147e5 HTTP/1.1" 200 None 2026-04-08 01:12:09,438 - lava_callback - DEBUG - Processing node 69d5ab1834043de23ba147e5: baseline-arm64-kontron 2026-04-08 01:12:09,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:09,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:09,947 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1834043de23ba147e5/log.txt.gz 2026-04-08 01:12:10,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:10,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:10,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1834043de23ba147e5/lava-logs.yaml 2026-04-08 01:12:10,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:10,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:10,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d5ab1834043de23ba147e5/lava_callback.json.gz 2026-04-08 01:12:10,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1834043de23ba147e5 HTTP/1.1" 200 None 2026-04-08 01:12:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:10,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:10,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:10,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1834043de23ba147e5 HTTP/1.1" 200 None 2026-04-08 01:12:10,517 - lava_callback - INFO - Completed processing callback for node 69d5ab1834043de23ba147e5 2026-04-08 01:12:11,896 - lava_callback - INFO - Received callback for node 69d5ab0d34043de23ba1479b INFO: 172.20.0.1:51572 - "POST /node/69d5ab0d34043de23ba1479b HTTP/1.0" 202 Accepted 2026-04-08 01:12:11,904 - lava_callback - INFO - Starting async job submit for node 69d5ab0d34043de23ba1479b 2026-04-08 01:12:11,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:11,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0d34043de23ba1479b HTTP/1.1" 200 None 2026-04-08 01:12:11,950 - lava_callback - DEBUG - Processing node 69d5ab0d34043de23ba1479b: baseline-arm64-broonie 2026-04-08 01:12:12,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:12,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:12,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0d34043de23ba1479b/log.txt.gz 2026-04-08 01:12:12,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:12,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:12,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0d34043de23ba1479b/lava-logs.yaml 2026-04-08 01:12:12,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:12,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:12,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0d34043de23ba1479b/lava_callback.json.gz 2026-04-08 01:12:12,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:12,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0d34043de23ba1479b HTTP/1.1" 200 None 2026-04-08 01:12:12,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:12,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:12,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:12,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0d34043de23ba1479b HTTP/1.1" 200 None 2026-04-08 01:12:12,881 - lava_callback - INFO - Completed processing callback for node 69d5ab0d34043de23ba1479b INFO: 172.20.0.1:51580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:12:25,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:25,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34974 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:12:31,674 - lava_callback - INFO - Received callback for node 69d5ab0634043de23ba14781 INFO: 172.20.0.1:45996 - "POST /node/69d5ab0634043de23ba14781 HTTP/1.0" 202 Accepted 2026-04-08 01:12:31,680 - lava_callback - INFO - Starting async job submit for node 69d5ab0634043de23ba14781 2026-04-08 01:12:31,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:31,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0634043de23ba14781 HTTP/1.1" 200 None 2026-04-08 01:12:31,717 - lava_callback - DEBUG - Processing node 69d5ab0634043de23ba14781: baseline-arm64-broonie 2026-04-08 01:12:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:32,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:32,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0634043de23ba14781/log.txt.gz 2026-04-08 01:12:32,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46008 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:12:32,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:32,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0634043de23ba14781/lava-logs.yaml 2026-04-08 01:12:32,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:12:32,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:12:32,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0634043de23ba14781/lava_callback.json.gz 2026-04-08 01:12:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:32,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0634043de23ba14781 HTTP/1.1" 200 None 2026-04-08 01:12:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:12:32,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:32,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0634043de23ba14781 HTTP/1.1" 200 None 2026-04-08 01:12:32,668 - lava_callback - INFO - Completed processing callback for node 69d5ab0634043de23ba14781 INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:12:47,243 - lava_callback - INFO - Received callback for node 69d3087c13dd9a9509894344 INFO: 172.20.0.1:40112 - "POST /node/69d3087c13dd9a9509894344 HTTP/1.0" 202 Accepted 2026-04-08 01:12:47,249 - lava_callback - INFO - Starting async job submit for node 69d3087c13dd9a9509894344 2026-04-08 01:12:47,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:47,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3087c13dd9a9509894344 HTTP/1.1" 200 None 2026-04-08 01:12:47,265 - lava_callback - DEBUG - Processing node 69d3087c13dd9a9509894344: baseline-arm-baylibre 2026-04-08 01:12:47,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3087c13dd9a9509894344 2026-04-08 01:12:47,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:47,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3087c13dd9a9509894344 HTTP/1.1" 200 None 2026-04-08 01:12:47,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:47,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:12:47,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:47,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3087c13dd9a9509894344 HTTP/1.1" 200 None 2026-04-08 01:12:47,325 - lava_callback - ERROR - Error processing callback for node 69d3087c13dd9a9509894344: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:12:55,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:12:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:13:07,285 - lava_callback - INFO - Received callback for node 69d308a013dd9a9509894360 INFO: 172.20.0.1:56318 - "POST /node/69d308a013dd9a9509894360 HTTP/1.0" 202 Accepted 2026-04-08 01:13:07,290 - lava_callback - INFO - Starting async job submit for node 69d308a013dd9a9509894360 2026-04-08 01:13:07,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:07,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d308a013dd9a9509894360 HTTP/1.1" 200 None 2026-04-08 01:13:07,307 - lava_callback - DEBUG - Processing node 69d308a013dd9a9509894360: baseline-arm-baylibre 2026-04-08 01:13:07,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d308a013dd9a9509894360 2026-04-08 01:13:07,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:07,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d308a013dd9a9509894360 HTTP/1.1" 200 None 2026-04-08 01:13:07,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:07,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:13:07,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:07,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d308a013dd9a9509894360 HTTP/1.1" 200 None 2026-04-08 01:13:07,365 - lava_callback - ERROR - Error processing callback for node 69d308a013dd9a9509894360: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:13:23,295 - lava_callback - INFO - Received callback for node 69d5ab0334043de23ba1477a INFO: 172.20.0.1:33880 - "POST /node/69d5ab0334043de23ba1477a HTTP/1.0" 202 Accepted 2026-04-08 01:13:23,301 - lava_callback - INFO - Starting async job submit for node 69d5ab0334043de23ba1477a 2026-04-08 01:13:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:23,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0334043de23ba1477a HTTP/1.1" 200 None 2026-04-08 01:13:23,339 - lava_callback - DEBUG - Processing node 69d5ab0334043de23ba1477a: baseline-arm64-broonie 2026-04-08 01:13:23,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:23,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:23,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0334043de23ba1477a/log.txt.gz 2026-04-08 01:13:23,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:24,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:24,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0334043de23ba1477a/lava-logs.yaml 2026-04-08 01:13:24,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:24,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:24,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0334043de23ba1477a/lava_callback.json.gz 2026-04-08 01:13:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:24,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0334043de23ba1477a HTTP/1.1" 200 None 2026-04-08 01:13:24,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:24,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:13:24,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:24,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0334043de23ba1477a HTTP/1.1" 200 None 2026-04-08 01:13:24,341 - lava_callback - INFO - Completed processing callback for node 69d5ab0334043de23ba1477a 2026-04-08 01:13:25,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:25,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55536 - "GET /node/6910ccc1699dbc4cda8e302e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55542 - "GET /node/69865330177ca0f097bd3d49%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-08 01:13:36,389 - lava_callback - INFO - Received callback for node 69d5aad834043de23ba146d2 INFO: 172.20.0.1:55550 - "POST /node/69d5aad834043de23ba146d2 HTTP/1.0" 202 Accepted 2026-04-08 01:13:36,396 - lava_callback - INFO - Starting async job submit for node 69d5aad834043de23ba146d2 2026-04-08 01:13:36,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:36,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad834043de23ba146d2 HTTP/1.1" 200 None 2026-04-08 01:13:36,452 - lava_callback - DEBUG - Processing node 69d5aad834043de23ba146d2: baseline-arm64 INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:13:36,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:36,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:36,928 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad834043de23ba146d2/log.txt.gz 2026-04-08 01:13:37,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:37,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:37,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad834043de23ba146d2/lava-logs.yaml 2026-04-08 01:13:37,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:13:37,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:13:37,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aad834043de23ba146d2/lava_callback.json.gz 2026-04-08 01:13:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:37,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aad834043de23ba146d2 HTTP/1.1" 200 None 2026-04-08 01:13:37,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:37,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:13:37,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:37,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aad834043de23ba146d2 HTTP/1.1" 200 None 2026-04-08 01:13:37,608 - lava_callback - INFO - Completed processing callback for node 69d5aad834043de23ba146d2 INFO: 172.20.0.1:58626 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:13:55,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:13:55,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44006 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:14:19,771 - lava_callback - INFO - Received callback for node 69d5aaf134043de23ba14720 INFO: 172.20.0.1:53580 - "POST /node/69d5aaf134043de23ba14720 HTTP/1.0" 202 Accepted 2026-04-08 01:14:19,777 - lava_callback - INFO - Starting async job submit for node 69d5aaf134043de23ba14720 2026-04-08 01:14:19,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:19,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf134043de23ba14720 HTTP/1.1" 200 None 2026-04-08 01:14:19,814 - lava_callback - DEBUG - Processing node 69d5aaf134043de23ba14720: baseline-nfs-arm64 2026-04-08 01:14:20,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:20,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:20,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf134043de23ba14720/log.txt.gz 2026-04-08 01:14:20,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:20,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:20,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf134043de23ba14720/lava-logs.yaml 2026-04-08 01:14:20,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:20,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:20,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf134043de23ba14720/lava_callback.json.gz 2026-04-08 01:14:20,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:20,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf134043de23ba14720 HTTP/1.1" 200 None 2026-04-08 01:14:20,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:20,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:14:20,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:20,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaf134043de23ba14720 HTTP/1.1" 200 None 2026-04-08 01:14:20,894 - lava_callback - INFO - Completed processing callback for node 69d5aaf134043de23ba14720 2026-04-08 01:14:22,724 - lava_callback - INFO - Received callback for node 69d5ab0734043de23ba14788 INFO: 172.20.0.1:53596 - "POST /node/69d5ab0734043de23ba14788 HTTP/1.0" 202 Accepted 2026-04-08 01:14:22,730 - lava_callback - INFO - Starting async job submit for node 69d5ab0734043de23ba14788 2026-04-08 01:14:22,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:22,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0734043de23ba14788 HTTP/1.1" 200 None 2026-04-08 01:14:22,767 - lava_callback - DEBUG - Processing node 69d5ab0734043de23ba14788: baseline-arm64-broonie 2026-04-08 01:14:23,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:23,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:23,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0734043de23ba14788/log.txt.gz 2026-04-08 01:14:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:23,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:23,469 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0734043de23ba14788/lava-logs.yaml 2026-04-08 01:14:23,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:23,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:23,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0734043de23ba14788/lava_callback.json.gz 2026-04-08 01:14:23,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:23,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0734043de23ba14788 HTTP/1.1" 200 None 2026-04-08 01:14:23,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:23,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:14:23,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:23,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0734043de23ba14788 HTTP/1.1" 200 None 2026-04-08 01:14:23,683 - lava_callback - INFO - Completed processing callback for node 69d5ab0734043de23ba14788 2026-04-08 01:14:25,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:25,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53598 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:14:28,934 - lava_callback - INFO - Received callback for node 69d5aae834043de23ba14707 INFO: 172.20.0.1:53612 - "POST /node/69d5aae834043de23ba14707 HTTP/1.0" 202 Accepted 2026-04-08 01:14:28,940 - lava_callback - INFO - Starting async job submit for node 69d5aae834043de23ba14707 2026-04-08 01:14:28,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:28,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae834043de23ba14707 HTTP/1.1" 200 None 2026-04-08 01:14:28,977 - lava_callback - DEBUG - Processing node 69d5aae834043de23ba14707: baseline-nfs-arm64 2026-04-08 01:14:29,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:29,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:29,558 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae834043de23ba14707/log.txt.gz 2026-04-08 01:14:29,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:30,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:30,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae834043de23ba14707/lava-logs.yaml 2026-04-08 01:14:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:30,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:30,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae834043de23ba14707/lava_callback.json.gz 2026-04-08 01:14:30,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:30,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae834043de23ba14707 HTTP/1.1" 200 None 2026-04-08 01:14:30,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:30,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:14:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:30,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae834043de23ba14707 HTTP/1.1" 200 None 2026-04-08 01:14:30,346 - lava_callback - INFO - Completed processing callback for node 69d5aae834043de23ba14707 INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38572 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:14:50,932 - lava_callback - INFO - Received callback for node 69d3090413dd9a95098943bc INFO: 172.20.0.1:56418 - "POST /node/69d3090413dd9a95098943bc HTTP/1.0" 202 Accepted 2026-04-08 01:14:50,939 - lava_callback - INFO - Starting async job submit for node 69d3090413dd9a95098943bc 2026-04-08 01:14:50,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:50,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3090413dd9a95098943bc HTTP/1.1" 200 None 2026-04-08 01:14:50,954 - lava_callback - DEBUG - Processing node 69d3090413dd9a95098943bc: baseline-arm-clabbe 2026-04-08 01:14:50,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3090413dd9a95098943bc 2026-04-08 01:14:50,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3090413dd9a95098943bc HTTP/1.1" 200 None 2026-04-08 01:14:50,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:50,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:14:50,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:51,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3090413dd9a95098943bc HTTP/1.1" 200 None 2026-04-08 01:14:51,013 - lava_callback - ERROR - Error processing callback for node 69d3090413dd9a95098943bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:14:53,642 - lava_callback - INFO - Received callback for node 69d5aae734043de23ba14704 INFO: 172.20.0.1:56430 - "POST /node/69d5aae734043de23ba14704 HTTP/1.0" 202 Accepted 2026-04-08 01:14:53,649 - lava_callback - INFO - Starting async job submit for node 69d5aae734043de23ba14704 2026-04-08 01:14:53,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:53,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae734043de23ba14704 HTTP/1.1" 200 None 2026-04-08 01:14:53,687 - lava_callback - DEBUG - Processing node 69d5aae734043de23ba14704: baseline-nfs-arm64 2026-04-08 01:14:54,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:54,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:54,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae734043de23ba14704/log.txt.gz 2026-04-08 01:14:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:54,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:54,560 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae734043de23ba14704/lava-logs.yaml 2026-04-08 01:14:54,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:14:54,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:14:54,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aae734043de23ba14704/lava_callback.json.gz 2026-04-08 01:14:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:54,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae734043de23ba14704 HTTP/1.1" 200 None 2026-04-08 01:14:54,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:54,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:14:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:54,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae734043de23ba14704 HTTP/1.1" 200 None 2026-04-08 01:14:54,774 - lava_callback - INFO - Completed processing callback for node 69d5aae734043de23ba14704 2026-04-08 01:14:55,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:14:55,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:15:30,909 - lava_callback - INFO - Received callback for node 69d3092613dd9a95098943cd INFO: 172.20.0.1:33480 - "POST /node/69d3092613dd9a95098943cd HTTP/1.0" 202 Accepted 2026-04-08 01:15:30,915 - lava_callback - INFO - Starting async job submit for node 69d3092613dd9a95098943cd 2026-04-08 01:15:30,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:15:30,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3092613dd9a95098943cd HTTP/1.1" 200 None 2026-04-08 01:15:30,930 - lava_callback - DEBUG - Processing node 69d3092613dd9a95098943cd: baseline-arm-clabbe 2026-04-08 01:15:30,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3092613dd9a95098943cd 2026-04-08 01:15:30,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:15:30,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3092613dd9a95098943cd HTTP/1.1" 200 None 2026-04-08 01:15:30,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:15:30,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:15:30,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:15:30,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3092613dd9a95098943cd HTTP/1.1" 200 None 2026-04-08 01:15:31,003 - lava_callback - ERROR - Error processing callback for node 69d3092613dd9a95098943cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51468 - "GET /node/699194ee10b45da7d7d117d9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:16:16,872 - lava_callback - INFO - Received callback for node 69d5ab1d34043de23ba147f5 INFO: 172.20.0.1:37026 - "POST /node/69d5ab1d34043de23ba147f5 HTTP/1.0" 202 Accepted 2026-04-08 01:16:16,881 - lava_callback - INFO - Starting async job submit for node 69d5ab1d34043de23ba147f5 2026-04-08 01:16:16,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:16,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1d34043de23ba147f5 HTTP/1.1" 200 None 2026-04-08 01:16:16,943 - lava_callback - DEBUG - Processing node 69d5ab1d34043de23ba147f5: baseline-arm64-foundriesio 2026-04-08 01:16:18,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:18,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:18,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1d34043de23ba147f5/log.txt.gz 2026-04-08 01:16:19,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:19,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:19,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1d34043de23ba147f5/lava-logs.yaml 2026-04-08 01:16:19,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:19,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:19,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5ab1d34043de23ba147f5/lava_callback.json.gz DEBUG: 69d5ab1d34043de23ba147f5 Transitting job node result: pass -> incomplete 2026-04-08 01:16:19,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab1d34043de23ba147f5 HTTP/1.1" 200 None 2026-04-08 01:16:19,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:19,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:16:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:19,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab1d34043de23ba147f5 HTTP/1.1" 200 None 2026-04-08 01:16:19,644 - lava_callback - INFO - Completed processing callback for node 69d5ab1d34043de23ba147f5 2026-04-08 01:16:25,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:25,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:16:43,261 - lava_callback - INFO - Received callback for node 69d5ab0c34043de23ba14798 INFO: 172.20.0.1:35460 - "POST /node/69d5ab0c34043de23ba14798 HTTP/1.0" 202 Accepted 2026-04-08 01:16:43,268 - lava_callback - INFO - Starting async job submit for node 69d5ab0c34043de23ba14798 2026-04-08 01:16:43,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0c34043de23ba14798 HTTP/1.1" 200 None 2026-04-08 01:16:43,320 - lava_callback - DEBUG - Processing node 69d5ab0c34043de23ba14798: baseline-arm64-broonie 2026-04-08 01:16:43,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:43,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:43,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0c34043de23ba14798/log.txt.gz 2026-04-08 01:16:43,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:44,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:44,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0c34043de23ba14798/lava-logs.yaml 2026-04-08 01:16:44,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:16:44,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:16:44,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5ab0c34043de23ba14798/lava_callback.json.gz 2026-04-08 01:16:44,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:44,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ab0c34043de23ba14798 HTTP/1.1" 200 None 2026-04-08 01:16:44,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:44,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:16:44,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:44,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ab0c34043de23ba14798 HTTP/1.1" 200 None 2026-04-08 01:16:44,477 - lava_callback - INFO - Completed processing callback for node 69d5ab0c34043de23ba14798 INFO: 172.20.0.1:35468 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:16:47,520 - lava_callback - INFO - Received callback for node 69d3096c13dd9a9509894417 INFO: 172.20.0.1:35482 - "POST /node/69d3096c13dd9a9509894417 HTTP/1.0" 202 Accepted 2026-04-08 01:16:47,532 - lava_callback - INFO - Starting async job submit for node 69d3096c13dd9a9509894417 2026-04-08 01:16:47,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:47,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3096c13dd9a9509894417 HTTP/1.1" 200 None 2026-04-08 01:16:47,596 - lava_callback - DEBUG - Processing node 69d3096c13dd9a9509894417: baseline-arm64-baylibre 2026-04-08 01:16:47,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3096c13dd9a9509894417 2026-04-08 01:16:47,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:47,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3096c13dd9a9509894417 HTTP/1.1" 200 None 2026-04-08 01:16:47,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:47,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:16:47,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:47,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3096c13dd9a9509894417 HTTP/1.1" 200 None 2026-04-08 01:16:47,661 - lava_callback - ERROR - Error processing callback for node 69d3096c13dd9a9509894417: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:16:55,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:16:55,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET /node/699040db985e4efca431ed6d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:17:20,294 - lava_callback - INFO - Received callback for node 69d5aae634043de23ba14701 INFO: 172.20.0.1:48706 - "POST /node/69d5aae634043de23ba14701 HTTP/1.0" 202 Accepted 2026-04-08 01:17:20,302 - lava_callback - INFO - Starting async job submit for node 69d5aae634043de23ba14701 2026-04-08 01:17:20,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:20,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae634043de23ba14701 HTTP/1.1" 200 None 2026-04-08 01:17:20,361 - lava_callback - DEBUG - Processing node 69d5aae634043de23ba14701: baseline-arm64 2026-04-08 01:17:20,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:17:21,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:17:21,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae634043de23ba14701/log.txt.gz 2026-04-08 01:17:21,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:17:21,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:17:21,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae634043de23ba14701/lava-logs.yaml 2026-04-08 01:17:21,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:17:22,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:17:22,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae634043de23ba14701/lava_callback.json.gz DEBUG: Setup failed for 69d5aae634043de23ba14701. Transitting job node result: incomplete -> fail 2026-04-08 01:17:22,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:22,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae634043de23ba14701 HTTP/1.1" 200 None 2026-04-08 01:17:22,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:22,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:17:22,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae634043de23ba14701 HTTP/1.1" 200 None 2026-04-08 01:17:22,369 - lava_callback - INFO - Completed processing callback for node 69d5aae634043de23ba14701 2026-04-08 01:17:25,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:17:47,478 - lava_callback - INFO - Received callback for node 69d309b413dd9a950989443e INFO: 172.20.0.1:57802 - "POST /node/69d309b413dd9a950989443e HTTP/1.0" 202 Accepted 2026-04-08 01:17:47,487 - lava_callback - INFO - Starting async job submit for node 69d309b413dd9a950989443e 2026-04-08 01:17:47,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:47,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d309b413dd9a950989443e HTTP/1.1" 200 None 2026-04-08 01:17:47,525 - lava_callback - DEBUG - Processing node 69d309b413dd9a950989443e: baseline-arm64-baylibre 2026-04-08 01:17:47,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d309b413dd9a950989443e 2026-04-08 01:17:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:47,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d309b413dd9a950989443e HTTP/1.1" 200 None 2026-04-08 01:17:47,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:47,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:17:47,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:17:47,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d309b413dd9a950989443e HTTP/1.1" 200 None 2026-04-08 01:17:47,626 - lava_callback - ERROR - Error processing callback for node 69d309b413dd9a950989443e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39608 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:18:47,624 - lava_callback - INFO - Received callback for node 69d309f613dd9a9509894477 INFO: 172.20.0.1:39616 - "POST /node/69d309f613dd9a9509894477 HTTP/1.0" 202 Accepted 2026-04-08 01:18:47,633 - lava_callback - INFO - Starting async job submit for node 69d309f613dd9a9509894477 2026-04-08 01:18:47,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:18:47,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d309f613dd9a9509894477 HTTP/1.1" 200 None 2026-04-08 01:18:47,669 - lava_callback - DEBUG - Processing node 69d309f613dd9a9509894477: baseline-arm64-baylibre 2026-04-08 01:18:47,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d309f613dd9a9509894477 2026-04-08 01:18:47,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:18:47,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d309f613dd9a9509894477 HTTP/1.1" 200 None 2026-04-08 01:18:47,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:18:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:18:47,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:18:47,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d309f613dd9a9509894477 HTTP/1.1" 200 None 2026-04-08 01:18:47,785 - lava_callback - ERROR - Error processing callback for node 69d309f613dd9a9509894477: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33626 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:20:07,726 - lava_callback - INFO - Received callback for node 69d30a3913dd9a9509894499 INFO: 172.20.0.1:33630 - "POST /node/69d30a3913dd9a9509894499 HTTP/1.0" 202 Accepted 2026-04-08 01:20:07,731 - lava_callback - INFO - Starting async job submit for node 69d30a3913dd9a9509894499 2026-04-08 01:20:07,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:07,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30a3913dd9a9509894499 HTTP/1.1" 200 None 2026-04-08 01:20:07,748 - lava_callback - DEBUG - Processing node 69d30a3913dd9a9509894499: baseline-arm64-baylibre 2026-04-08 01:20:07,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30a3913dd9a9509894499 2026-04-08 01:20:07,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30a3913dd9a9509894499 HTTP/1.1" 200 None 2026-04-08 01:20:07,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:07,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:20:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:07,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30a3913dd9a9509894499 HTTP/1.1" 200 None 2026-04-08 01:20:07,807 - lava_callback - ERROR - Error processing callback for node 69d30a3913dd9a9509894499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:20:11,297 - lava_callback - INFO - Received callback for node 69d5aae134043de23ba146f5 INFO: 172.20.0.1:37436 - "POST /node/69d5aae134043de23ba146f5 HTTP/1.0" 202 Accepted 2026-04-08 01:20:11,303 - lava_callback - INFO - Starting async job submit for node 69d5aae134043de23ba146f5 2026-04-08 01:20:11,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:11,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae134043de23ba146f5 HTTP/1.1" 200 None 2026-04-08 01:20:11,342 - lava_callback - DEBUG - Processing node 69d5aae134043de23ba146f5: baseline-arm64 2026-04-08 01:20:11,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:20:11,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:20:11,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae134043de23ba146f5/log.txt.gz 2026-04-08 01:20:12,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:20:12,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:20:12,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae134043de23ba146f5/lava-logs.yaml 2026-04-08 01:20:12,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:20:12,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:20:12,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5aae134043de23ba146f5/lava_callback.json.gz 2026-04-08 01:20:12,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:12,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aae134043de23ba146f5 HTTP/1.1" 200 None 2026-04-08 01:20:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:12,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:20:12,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:12,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aae134043de23ba146f5 HTTP/1.1" 200 None 2026-04-08 01:20:12,745 - lava_callback - INFO - Completed processing callback for node 69d5aae134043de23ba146f5 INFO: 172.20.0.1:37444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:20:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:20:25,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:21:07,682 - lava_callback - INFO - Received callback for node 69d30a7e13dd9a95098944e4 INFO: 172.20.0.1:60198 - "POST /node/69d30a7e13dd9a95098944e4 HTTP/1.0" 202 Accepted 2026-04-08 01:21:07,688 - lava_callback - INFO - Starting async job submit for node 69d30a7e13dd9a95098944e4 2026-04-08 01:21:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:07,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30a7e13dd9a95098944e4 HTTP/1.1" 200 None 2026-04-08 01:21:07,704 - lava_callback - DEBUG - Processing node 69d30a7e13dd9a95098944e4: baseline-arm64-baylibre 2026-04-08 01:21:07,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30a7e13dd9a95098944e4 2026-04-08 01:21:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:07,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30a7e13dd9a95098944e4 HTTP/1.1" 200 None 2026-04-08 01:21:07,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:07,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:21:07,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:07,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30a7e13dd9a95098944e4 HTTP/1.1" 200 None 2026-04-08 01:21:07,777 - lava_callback - ERROR - Error processing callback for node 69d30a7e13dd9a95098944e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53860 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:21:20,069 - lava_callback - INFO - Received callback for node 69d5aaf234043de23ba14724 INFO: 172.20.0.1:43474 - "POST /node/69d5aaf234043de23ba14724 HTTP/1.0" 202 Accepted 2026-04-08 01:21:20,076 - lava_callback - INFO - Starting async job submit for node 69d5aaf234043de23ba14724 2026-04-08 01:21:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf234043de23ba14724 HTTP/1.1" 200 None 2026-04-08 01:21:20,117 - lava_callback - DEBUG - Processing node 69d5aaf234043de23ba14724: baseline-nfs-arm64 2026-04-08 01:21:20,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:21:20,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:21:20,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf234043de23ba14724/log.txt.gz 2026-04-08 01:21:21,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:21:21,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:21:21,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf234043de23ba14724/lava-logs.yaml 2026-04-08 01:21:21,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:21:21,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:21:21,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaf234043de23ba14724/lava_callback.json.gz 2026-04-08 01:21:21,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:21,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaf234043de23ba14724 HTTP/1.1" 200 None 2026-04-08 01:21:21,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:21,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:21:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:21,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaf234043de23ba14724 HTTP/1.1" 200 None 2026-04-08 01:21:21,673 - lava_callback - INFO - Completed processing callback for node 69d5aaf234043de23ba14724 2026-04-08 01:21:25,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:21:25,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:22:23,199 - lava_callback - INFO - Received callback for node 69d5a9b034043de23ba145c1 INFO: 172.20.0.1:48926 - "POST /node/69d5a9b034043de23ba145c1 HTTP/1.0" 202 Accepted 2026-04-08 01:22:23,206 - lava_callback - INFO - Starting async job submit for node 69d5a9b034043de23ba145c1 2026-04-08 01:22:23,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:23,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a9b034043de23ba145c1 HTTP/1.1" 200 None 2026-04-08 01:22:23,279 - lava_callback - DEBUG - Processing node 69d5a9b034043de23ba145c1: ltp-smoke 2026-04-08 01:22:23,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:22:23,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:22:23,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a9b034043de23ba145c1/log.txt.gz 2026-04-08 01:22:24,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:22:24,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:22:24,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a9b034043de23ba145c1/lava-logs.yaml 2026-04-08 01:22:24,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:22:24,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:22:24,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5a9b034043de23ba145c1/lava_callback.json.gz 2026-04-08 01:22:25,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:25,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5a9b034043de23ba145c1 HTTP/1.1" 200 None 2026-04-08 01:22:25,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:25,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9f34043de23ba13b4f HTTP/1.1" 200 None 2026-04-08 01:22:25,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:25,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5a9b034043de23ba145c1 HTTP/1.1" 200 None 2026-04-08 01:22:25,239 - lava_callback - INFO - Completed processing callback for node 69d5a9b034043de23ba145c1 2026-04-08 01:22:25,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:25,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48938 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:22:31,310 - lava_callback - INFO - Received callback for node 69d30ac713dd9a950989450f INFO: 172.20.0.1:39108 - "POST /node/69d30ac713dd9a950989450f HTTP/1.0" 202 Accepted 2026-04-08 01:22:31,316 - lava_callback - INFO - Starting async job submit for node 69d30ac713dd9a950989450f 2026-04-08 01:22:31,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:31,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30ac713dd9a950989450f HTTP/1.1" 200 None 2026-04-08 01:22:31,331 - lava_callback - DEBUG - Processing node 69d30ac713dd9a950989450f: baseline-arm64-clabbe 2026-04-08 01:22:31,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30ac713dd9a950989450f 2026-04-08 01:22:31,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:31,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30ac713dd9a950989450f HTTP/1.1" 200 None 2026-04-08 01:22:31,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:31,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:22:31,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:22:31,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30ac713dd9a950989450f HTTP/1.1" 200 None 2026-04-08 01:22:31,392 - lava_callback - ERROR - Error processing callback for node 69d30ac713dd9a950989450f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:23:31,304 - lava_callback - INFO - Received callback for node 69d30b0813dd9a9509894552 INFO: 172.20.0.1:50672 - "POST /node/69d30b0813dd9a9509894552 HTTP/1.0" 202 Accepted 2026-04-08 01:23:31,310 - lava_callback - INFO - Starting async job submit for node 69d30b0813dd9a9509894552 2026-04-08 01:23:31,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:23:31,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b0813dd9a9509894552 HTTP/1.1" 200 None 2026-04-08 01:23:31,326 - lava_callback - DEBUG - Processing node 69d30b0813dd9a9509894552: baseline-arm64-clabbe 2026-04-08 01:23:31,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30b0813dd9a9509894552 2026-04-08 01:23:31,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:23:31,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b0813dd9a9509894552 HTTP/1.1" 200 None 2026-04-08 01:23:31,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:23:31,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:23:31,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:23:31,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30b0813dd9a9509894552 HTTP/1.1" 200 None 2026-04-08 01:23:31,384 - lava_callback - ERROR - Error processing callback for node 69d30b0813dd9a9509894552: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:24:31,291 - lava_callback - INFO - Received callback for node 69d30b3f13dd9a9509894587 INFO: 172.20.0.1:41438 - "POST /node/69d30b3f13dd9a9509894587 HTTP/1.0" 202 Accepted 2026-04-08 01:24:31,297 - lava_callback - INFO - Starting async job submit for node 69d30b3f13dd9a9509894587 2026-04-08 01:24:31,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:24:31,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b3f13dd9a9509894587 HTTP/1.1" 200 None 2026-04-08 01:24:31,313 - lava_callback - DEBUG - Processing node 69d30b3f13dd9a9509894587: baseline-arm-clabbe 2026-04-08 01:24:31,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30b3f13dd9a9509894587 2026-04-08 01:24:31,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:24:31,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30b3f13dd9a9509894587 HTTP/1.1" 200 None 2026-04-08 01:24:31,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:24:31,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:24:31,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:24:31,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30b3f13dd9a9509894587 HTTP/1.1" 200 None 2026-04-08 01:24:31,369 - lava_callback - ERROR - Error processing callback for node 69d30b3f13dd9a9509894587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:26:31,453 - lava_callback - INFO - Received callback for node 69d30bb513dd9a95098945c6 INFO: 172.20.0.1:54062 - "POST /node/69d30bb513dd9a95098945c6 HTTP/1.0" 202 Accepted 2026-04-08 01:26:31,461 - lava_callback - INFO - Starting async job submit for node 69d30bb513dd9a95098945c6 2026-04-08 01:26:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:26:31,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30bb513dd9a95098945c6 HTTP/1.1" 200 None 2026-04-08 01:26:31,477 - lava_callback - DEBUG - Processing node 69d30bb513dd9a95098945c6: baseline-arm64-clabbe 2026-04-08 01:26:31,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30bb513dd9a95098945c6 2026-04-08 01:26:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:26:31,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30bb513dd9a95098945c6 HTTP/1.1" 200 None 2026-04-08 01:26:31,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:26:31,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:26:31,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:26:31,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30bb513dd9a95098945c6 HTTP/1.1" 200 None 2026-04-08 01:26:31,544 - lava_callback - ERROR - Error processing callback for node 69d30bb513dd9a95098945c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:27:31,482 - lava_callback - INFO - Received callback for node 69d30bf213dd9a9509894634 INFO: 172.20.0.1:34630 - "POST /node/69d30bf213dd9a9509894634 HTTP/1.0" 202 Accepted 2026-04-08 01:27:31,491 - lava_callback - INFO - Starting async job submit for node 69d30bf213dd9a9509894634 2026-04-08 01:27:31,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:27:31,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30bf213dd9a9509894634 HTTP/1.1" 200 None 2026-04-08 01:27:31,508 - lava_callback - DEBUG - Processing node 69d30bf213dd9a9509894634: baseline-arm64-clabbe 2026-04-08 01:27:31,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30bf213dd9a9509894634 2026-04-08 01:27:31,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:27:31,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30bf213dd9a9509894634 HTTP/1.1" 200 None 2026-04-08 01:27:31,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:27:31,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:27:31,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:27:31,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30bf213dd9a9509894634 HTTP/1.1" 200 None 2026-04-08 01:27:31,560 - lava_callback - ERROR - Error processing callback for node 69d30bf213dd9a9509894634: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:28:31,542 - lava_callback - INFO - Received callback for node 69d30c3a13dd9a950989464f INFO: 172.20.0.1:34236 - "POST /node/69d30c3a13dd9a950989464f HTTP/1.0" 202 Accepted 2026-04-08 01:28:31,547 - lava_callback - INFO - Starting async job submit for node 69d30c3a13dd9a950989464f 2026-04-08 01:28:31,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:28:31,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30c3a13dd9a950989464f HTTP/1.1" 200 None 2026-04-08 01:28:31,565 - lava_callback - DEBUG - Processing node 69d30c3a13dd9a950989464f: baseline-arm64-clabbe 2026-04-08 01:28:31,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30c3a13dd9a950989464f 2026-04-08 01:28:31,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:28:31,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30c3a13dd9a950989464f HTTP/1.1" 200 None 2026-04-08 01:28:31,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:28:31,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:28:31,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:28:31,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30c3a13dd9a950989464f HTTP/1.1" 200 None 2026-04-08 01:28:31,623 - lava_callback - ERROR - Error processing callback for node 69d30c3a13dd9a950989464f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:29:27,691 - lava_callback - INFO - Received callback for node 69d5af6434043de23ba14c67 INFO: 172.20.0.1:54262 - "POST /node/69d5af6434043de23ba14c67 HTTP/1.0" 202 Accepted 2026-04-08 01:29:27,697 - lava_callback - INFO - Starting async job submit for node 69d5af6434043de23ba14c67 2026-04-08 01:29:27,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:27,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5af6434043de23ba14c67 HTTP/1.1" 200 None 2026-04-08 01:29:27,723 - lava_callback - DEBUG - Processing node 69d5af6434043de23ba14c67: baseline-arm 2026-04-08 01:29:27,731 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:29:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:29:28,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:29:28,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5af6434043de23ba14c67/lava-logs.yaml 2026-04-08 01:29:28,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:29:28,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:29:28,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5af6434043de23ba14c67/lava_callback.json.gz 2026-04-08 01:29:28,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:28,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5af6434043de23ba14c67 HTTP/1.1" 200 None 2026-04-08 01:29:28,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:29:28,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:28,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5af6434043de23ba14c67 HTTP/1.1" 200 None 2026-04-08 01:29:28,358 - lava_callback - INFO - Completed processing callback for node 69d5af6434043de23ba14c67 INFO: 172.20.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:29:51,536 - lava_callback - INFO - Received callback for node 69d30c8113dd9a9509894674 INFO: 172.20.0.1:52636 - "POST /node/69d30c8113dd9a9509894674 HTTP/1.0" 202 Accepted 2026-04-08 01:29:51,545 - lava_callback - INFO - Starting async job submit for node 69d30c8113dd9a9509894674 2026-04-08 01:29:51,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:51,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30c8113dd9a9509894674 HTTP/1.1" 200 None 2026-04-08 01:29:51,570 - lava_callback - DEBUG - Processing node 69d30c8113dd9a9509894674: baseline-arm64-clabbe 2026-04-08 01:29:51,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30c8113dd9a9509894674 2026-04-08 01:29:51,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:51,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30c8113dd9a9509894674 HTTP/1.1" 200 None 2026-04-08 01:29:51,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:51,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 01:29:51,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:51,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30c8113dd9a9509894674 HTTP/1.1" 200 None 2026-04-08 01:29:51,675 - lava_callback - ERROR - Error processing callback for node 69d30c8113dd9a9509894674: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:29:54,114 - lava_callback - INFO - Received callback for node 69d5aaeb34043de23ba14711 INFO: 172.20.0.1:52638 - "POST /node/69d5aaeb34043de23ba14711 HTTP/1.0" 202 Accepted 2026-04-08 01:29:54,123 - lava_callback - INFO - Starting async job submit for node 69d5aaeb34043de23ba14711 2026-04-08 01:29:54,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:54,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaeb34043de23ba14711 HTTP/1.1" 200 None 2026-04-08 01:29:54,194 - lava_callback - DEBUG - Processing node 69d5aaeb34043de23ba14711: baseline-nfs-arm64 2026-04-08 01:29:55,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:29:55,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:55,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-08 01:29:56,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:29:56,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaeb34043de23ba14711/log.txt.gz INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:29:57,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:29:57,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:29:57,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaeb34043de23ba14711/lava-logs.yaml 2026-04-08 01:29:57,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:29:58,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:29:58,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5aaeb34043de23ba14711/lava_callback.json.gz DEBUG: Setup failed for 69d5aaeb34043de23ba14711. Transitting job node result: incomplete -> fail 2026-04-08 01:29:58,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:58,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5aaeb34043de23ba14711 HTTP/1.1" 200 None 2026-04-08 01:29:58,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:58,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:29:58,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:29:58,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5aaeb34043de23ba14711 HTTP/1.1" 200 None 2026-04-08 01:29:58,758 - lava_callback - INFO - Completed processing callback for node 69d5aaeb34043de23ba14711 INFO: 172.20.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:30:25,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:30:25,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:30:51,737 - lava_callback - INFO - Received callback for node 69d30cb913dd9a950989469a INFO: 172.20.0.1:44836 - "POST /node/69d30cb913dd9a950989469a HTTP/1.0" 202 Accepted 2026-04-08 01:30:51,742 - lava_callback - INFO - Starting async job submit for node 69d30cb913dd9a950989469a 2026-04-08 01:30:51,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:30:51,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cb913dd9a950989469a HTTP/1.1" 200 None 2026-04-08 01:30:51,758 - lava_callback - DEBUG - Processing node 69d30cb913dd9a950989469a: baseline-arm-clabbe 2026-04-08 01:30:51,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30cb913dd9a950989469a 2026-04-08 01:30:51,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:30:51,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cb913dd9a950989469a HTTP/1.1" 200 None 2026-04-08 01:30:51,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:30:51,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:30:51,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:30:51,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30cb913dd9a950989469a HTTP/1.1" 200 None 2026-04-08 01:30:51,816 - lava_callback - ERROR - Error processing callback for node 69d30cb913dd9a950989469a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42396 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:31:11,577 - lava_callback - INFO - Received callback for node 69d30cd913dd9a95098946bd INFO: 172.20.0.1:55908 - "POST /node/69d30cd913dd9a95098946bd HTTP/1.0" 202 Accepted 2026-04-08 01:31:11,583 - lava_callback - INFO - Starting async job submit for node 69d30cd913dd9a95098946bd 2026-04-08 01:31:11,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:11,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cd913dd9a95098946bd HTTP/1.1" 200 None 2026-04-08 01:31:11,599 - lava_callback - DEBUG - Processing node 69d30cd913dd9a95098946bd: baseline-arm-clabbe 2026-04-08 01:31:11,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30cd913dd9a95098946bd 2026-04-08 01:31:11,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:11,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cd913dd9a95098946bd HTTP/1.1" 200 None 2026-04-08 01:31:11,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:11,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:31:11,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:11,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30cd913dd9a95098946bd HTTP/1.1" 200 None 2026-04-08 01:31:11,658 - lava_callback - ERROR - Error processing callback for node 69d30cd913dd9a95098946bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41556 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:31:51,621 - lava_callback - INFO - Received callback for node 69d30cfb13dd9a95098946d3 INFO: 172.20.0.1:49876 - "POST /node/69d30cfb13dd9a95098946d3 HTTP/1.0" 202 Accepted 2026-04-08 01:31:51,627 - lava_callback - INFO - Starting async job submit for node 69d30cfb13dd9a95098946d3 2026-04-08 01:31:51,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:51,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cfb13dd9a95098946d3 HTTP/1.1" 200 None 2026-04-08 01:31:51,643 - lava_callback - DEBUG - Processing node 69d30cfb13dd9a95098946d3: baseline-arm-clabbe 2026-04-08 01:31:51,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d30cfb13dd9a95098946d3 2026-04-08 01:31:51,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:51,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d30cfb13dd9a95098946d3 HTTP/1.1" 200 None 2026-04-08 01:31:51,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:51,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 01:31:51,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:31:51,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d30cfb13dd9a95098946d3 HTTP/1.1" 200 None 2026-04-08 01:31:51,702 - lava_callback - ERROR - Error processing callback for node 69d30cfb13dd9a95098946d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34984 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:34:55,432 - lava_callback - INFO - Received callback for node 69d5b08b34043de23ba14dc1 INFO: 172.20.0.1:57036 - "POST /node/69d5b08b34043de23ba14dc1 HTTP/1.0" 202 Accepted 2026-04-08 01:34:55,439 - lava_callback - INFO - Starting async job submit for node 69d5b08b34043de23ba14dc1 2026-04-08 01:34:55,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:34:55,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b08b34043de23ba14dc1 HTTP/1.1" 200 None 2026-04-08 01:34:55,494 - lava_callback - DEBUG - Processing node 69d5b08b34043de23ba14dc1: baseline-arm64 2026-04-08 01:34:55,661 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:34:55,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:34:55,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:34:55,947 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b08b34043de23ba14dc1/lava-logs.yaml 2026-04-08 01:34:55,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:34:56,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:34:56,096 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b08b34043de23ba14dc1/lava_callback.json.gz 2026-04-08 01:34:56,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:34:56,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b08b34043de23ba14dc1 HTTP/1.1" 200 None 2026-04-08 01:34:56,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:34:56,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:34:56,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:34:56,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b08b34043de23ba14dc1 HTTP/1.1" 200 None 2026-04-08 01:34:56,247 - lava_callback - INFO - Completed processing callback for node 69d5b08b34043de23ba14dc1 INFO: 172.20.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:35:12,555 - lava_callback - INFO - Received callback for node 69d5b05534043de23ba14d97 INFO: 172.20.0.1:36818 - "POST /node/69d5b05534043de23ba14d97 HTTP/1.0" 202 Accepted 2026-04-08 01:35:12,562 - lava_callback - INFO - Starting async job submit for node 69d5b05534043de23ba14d97 2026-04-08 01:35:12,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:12,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b05534043de23ba14d97 HTTP/1.1" 200 None 2026-04-08 01:35:12,603 - lava_callback - DEBUG - Processing node 69d5b05534043de23ba14d97: baseline-arm64-broonie 2026-04-08 01:35:12,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:35:13,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:35:13,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b05534043de23ba14d97/log.txt.gz 2026-04-08 01:35:13,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:35:13,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:35:13,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b05534043de23ba14d97/lava-logs.yaml 2026-04-08 01:35:13,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:35:13,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:35:13,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b05534043de23ba14d97/lava_callback.json.gz 2026-04-08 01:35:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:13,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b05534043de23ba14d97 HTTP/1.1" 200 None 2026-04-08 01:35:13,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:13,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:35:13,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:13,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b05534043de23ba14d97 HTTP/1.1" 200 None 2026-04-08 01:35:13,742 - lava_callback - INFO - Completed processing callback for node 69d5b05534043de23ba14d97 INFO: 172.20.0.1:36828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:35:25,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:25,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44186 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:35:52,072 - lava_callback - INFO - Received callback for node 69d5b0dd34043de23ba14df0 INFO: 172.20.0.1:37388 - "POST /node/69d5b0dd34043de23ba14df0 HTTP/1.0" 202 Accepted 2026-04-08 01:35:52,078 - lava_callback - INFO - Starting async job submit for node 69d5b0dd34043de23ba14df0 2026-04-08 01:35:52,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b0dd34043de23ba14df0 HTTP/1.1" 200 None 2026-04-08 01:35:52,112 - lava_callback - DEBUG - Processing node 69d5b0dd34043de23ba14df0: baseline-nfs-arm64 2026-04-08 01:35:52,113 - lava_callback - WARNING - Failed to upload log 2026-04-08 01:35:52,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:35:52,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:35:52,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b0dd34043de23ba14df0/lava-logs.yaml 2026-04-08 01:35:52,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:35:52,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:35:52,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b0dd34043de23ba14df0/lava_callback.json.gz 2026-04-08 01:35:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:52,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b0dd34043de23ba14df0 HTTP/1.1" 200 None 2026-04-08 01:35:52,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:52,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:35:52,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:52,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b0dd34043de23ba14df0 HTTP/1.1" 200 None 2026-04-08 01:35:52,426 - lava_callback - INFO - Completed processing callback for node 69d5b0dd34043de23ba14df0 2026-04-08 01:35:55,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:35:56,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52610 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:37:29,239 - lava_callback - INFO - Received callback for node 69d5b11e34043de23ba14e01 INFO: 172.20.0.1:52620 - "POST /node/69d5b11e34043de23ba14e01 HTTP/1.0" 202 Accepted 2026-04-08 01:37:29,246 - lava_callback - INFO - Starting async job submit for node 69d5b11e34043de23ba14e01 2026-04-08 01:37:29,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:37:29,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b11e34043de23ba14e01 HTTP/1.1" 200 None 2026-04-08 01:37:29,304 - lava_callback - DEBUG - Processing node 69d5b11e34043de23ba14e01: baseline-arm64 2026-04-08 01:37:29,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:37:29,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:37:29,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b11e34043de23ba14e01/log.txt.gz 2026-04-08 01:37:29,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:37:29,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:37:29,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b11e34043de23ba14e01/lava-logs.yaml 2026-04-08 01:37:29,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:37:30,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:37:30,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b11e34043de23ba14e01/lava_callback.json.gz 2026-04-08 01:37:30,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:37:30,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b11e34043de23ba14e01 HTTP/1.1" 200 None 2026-04-08 01:37:30,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:37:30,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:37:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:37:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b11e34043de23ba14e01 HTTP/1.1" 200 None 2026-04-08 01:37:30,198 - lava_callback - INFO - Completed processing callback for node 69d5b11e34043de23ba14e01 INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:37:56,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:37:56,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42014 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:39:52,673 - lava_callback - INFO - Received callback for node 69d5b17534043de23ba14e4a INFO: 172.20.0.1:50788 - "POST /node/69d5b17534043de23ba14e4a HTTP/1.0" 202 Accepted 2026-04-08 01:39:52,679 - lava_callback - INFO - Starting async job submit for node 69d5b17534043de23ba14e4a 2026-04-08 01:39:52,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:39:52,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b17534043de23ba14e4a HTTP/1.1" 200 None 2026-04-08 01:39:52,716 - lava_callback - DEBUG - Processing node 69d5b17534043de23ba14e4a: baseline-arm64-broonie 2026-04-08 01:39:52,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:39:53,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:39:53,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b17534043de23ba14e4a/log.txt.gz 2026-04-08 01:39:53,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:39:53,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:39:53,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b17534043de23ba14e4a/lava-logs.yaml 2026-04-08 01:39:53,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:39:53,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:39:53,687 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b17534043de23ba14e4a/lava_callback.json.gz 2026-04-08 01:39:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:39:53,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b17534043de23ba14e4a HTTP/1.1" 200 None 2026-04-08 01:39:53,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:39:53,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:39:53,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:39:53,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b17534043de23ba14e4a HTTP/1.1" 200 None 2026-04-08 01:39:53,796 - lava_callback - INFO - Completed processing callback for node 69d5b17534043de23ba14e4a 2026-04-08 01:39:56,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:39:56,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:42:24,196 - lava_callback - INFO - Received callback for node 69d5b20a34043de23ba14e9c INFO: 172.20.0.1:40828 - "POST /node/69d5b20a34043de23ba14e9c HTTP/1.0" 202 Accepted 2026-04-08 01:42:24,202 - lava_callback - INFO - Starting async job submit for node 69d5b20a34043de23ba14e9c 2026-04-08 01:42:24,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:42:24,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b20a34043de23ba14e9c HTTP/1.1" 200 None 2026-04-08 01:42:24,240 - lava_callback - DEBUG - Processing node 69d5b20a34043de23ba14e9c: baseline-arm64-broonie 2026-04-08 01:42:24,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:42:24,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:42:24,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b20a34043de23ba14e9c/log.txt.gz 2026-04-08 01:42:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:42:25,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:42:25,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b20a34043de23ba14e9c/lava-logs.yaml 2026-04-08 01:42:25,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:42:25,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:42:25,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d5b20a34043de23ba14e9c/lava_callback.json.gz 2026-04-08 01:42:25,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:42:25,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b20a34043de23ba14e9c HTTP/1.1" 200 None 2026-04-08 01:42:25,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:42:25,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:42:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:42:25,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b20a34043de23ba14e9c HTTP/1.1" 200 None 2026-04-08 01:42:25,346 - lava_callback - INFO - Completed processing callback for node 69d5b20a34043de23ba14e9c 2026-04-08 01:42:26,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:42:26,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37774 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:43:31,705 - lava_callback - INFO - Received callback for node 69d5b28534043de23ba14ef6 INFO: 172.20.0.1:50668 - "POST /node/69d5b28534043de23ba14ef6 HTTP/1.0" 202 Accepted 2026-04-08 01:43:31,713 - lava_callback - INFO - Starting async job submit for node 69d5b28534043de23ba14ef6 2026-04-08 01:43:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:43:31,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b28534043de23ba14ef6 HTTP/1.1" 200 None 2026-04-08 01:43:31,755 - lava_callback - DEBUG - Processing node 69d5b28534043de23ba14ef6: baseline-arm64 2026-04-08 01:43:32,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:43:32,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:43:32,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b28534043de23ba14ef6/log.txt.gz 2026-04-08 01:43:32,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:43:32,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:43:32,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b28534043de23ba14ef6/lava-logs.yaml 2026-04-08 01:43:32,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:43:33,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:43:33,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b28534043de23ba14ef6/lava_callback.json.gz 2026-04-08 01:43:33,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:43:33,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b28534043de23ba14ef6 HTTP/1.1" 200 None 2026-04-08 01:43:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:43:33,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:43:33,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:43:33,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b28534043de23ba14ef6 HTTP/1.1" 200 None 2026-04-08 01:43:33,232 - lava_callback - INFO - Completed processing callback for node 69d5b28534043de23ba14ef6 INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:43:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:43:56,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60338 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:44:43,404 - lava_callback - INFO - Received callback for node 69d5af2334043de23ba14c48 INFO: 172.20.0.1:48034 - "POST /node/69d5af2334043de23ba14c48 HTTP/1.0" 202 Accepted 2026-04-08 01:44:43,412 - lava_callback - INFO - Starting async job submit for node 69d5af2334043de23ba14c48 2026-04-08 01:44:43,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:44:43,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5af2334043de23ba14c48 HTTP/1.1" 200 None 2026-04-08 01:44:43,492 - lava_callback - DEBUG - Processing node 69d5af2334043de23ba14c48: baseline-arm 2026-04-08 01:44:44,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:44:44,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:44:44,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5af2334043de23ba14c48/log.txt.gz 2026-04-08 01:44:44,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:44:44,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:44:44,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5af2334043de23ba14c48/lava-logs.yaml 2026-04-08 01:44:44,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:44:44,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:44:44,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5af2334043de23ba14c48/lava_callback.json.gz DEBUG: Setup failed for 69d5af2334043de23ba14c48. Transitting job node result: incomplete -> fail 2026-04-08 01:44:45,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:44:45,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5af2334043de23ba14c48 HTTP/1.1" 200 None 2026-04-08 01:44:45,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:44:45,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:44:45,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:44:45,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5af2334043de23ba14c48 HTTP/1.1" 200 None 2026-04-08 01:44:45,302 - lava_callback - INFO - Completed processing callback for node 69d5af2334043de23ba14c48 INFO: 172.20.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:44:56,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:44:56,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53302 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48220 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:47:49,224 - lava_callback - INFO - Received callback for node 69d310b513dd9a950989491d INFO: 172.20.0.1:48226 - "POST /node/69d310b513dd9a950989491d HTTP/1.0" 202 Accepted 2026-04-08 01:47:49,233 - lava_callback - INFO - Starting async job submit for node 69d310b513dd9a950989491d 2026-04-08 01:47:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:47:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d310b513dd9a950989491d HTTP/1.1" 200 None 2026-04-08 01:47:49,249 - lava_callback - DEBUG - Processing node 69d310b513dd9a950989491d: baseline-arm-baylibre 2026-04-08 01:47:49,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d310b513dd9a950989491d 2026-04-08 01:47:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:47:49,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d310b513dd9a950989491d HTTP/1.1" 200 None 2026-04-08 01:47:49,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:47:49,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:47:49,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:47:49,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d310b513dd9a950989491d HTTP/1.1" 200 None 2026-04-08 01:47:49,320 - lava_callback - ERROR - Error processing callback for node 69d310b513dd9a950989491d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38750 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:48:04,406 - lava_callback - INFO - Received callback for node 69d5b2e634043de23ba14f38 INFO: 172.20.0.1:57780 - "POST /node/69d5b2e634043de23ba14f38 HTTP/1.0" 202 Accepted 2026-04-08 01:48:04,412 - lava_callback - INFO - Starting async job submit for node 69d5b2e634043de23ba14f38 2026-04-08 01:48:04,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:48:04,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b2e634043de23ba14f38 HTTP/1.1" 200 None 2026-04-08 01:48:04,461 - lava_callback - DEBUG - Processing node 69d5b2e634043de23ba14f38: ltp-syscalls-ipc 2026-04-08 01:48:04,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:48:05,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:48:05,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5b2e634043de23ba14f38/log.txt.gz 2026-04-08 01:48:05,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:48:05,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:48:05,508 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5b2e634043de23ba14f38/lava-logs.yaml 2026-04-08 01:48:05,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:48:05,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:48:05,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d5b2e634043de23ba14f38/lava_callback.json.gz 2026-04-08 01:48:05,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:48:05,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b2e634043de23ba14f38 HTTP/1.1" 200 None 2026-04-08 01:48:05,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:48:05,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 01:48:05,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:48:05,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b2e634043de23ba14f38 HTTP/1.1" 200 None 2026-04-08 01:48:05,788 - lava_callback - INFO - Completed processing callback for node 69d5b2e634043de23ba14f38 INFO: 172.20.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44940 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:48:26,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:48:26,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:49:07,139 - lava_callback - INFO - Received callback for node 69d5b34d34043de23ba14fb4 INFO: 172.20.0.1:60916 - "POST /node/69d5b34d34043de23ba14fb4 HTTP/1.0" 202 Accepted 2026-04-08 01:49:07,148 - lava_callback - INFO - Starting async job submit for node 69d5b34d34043de23ba14fb4 2026-04-08 01:49:07,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:49:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b34d34043de23ba14fb4 HTTP/1.1" 200 None 2026-04-08 01:49:07,191 - lava_callback - DEBUG - Processing node 69d5b34d34043de23ba14fb4: baseline-arm64 2026-04-08 01:49:07,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:49:07,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:49:07,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b34d34043de23ba14fb4/log.txt.gz 2026-04-08 01:49:07,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:49:08,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:49:08,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b34d34043de23ba14fb4/lava-logs.yaml 2026-04-08 01:49:08,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:49:08,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:49:08,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b34d34043de23ba14fb4/lava_callback.json.gz 2026-04-08 01:49:08,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:49:08,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b34d34043de23ba14fb4 HTTP/1.1" 200 None 2026-04-08 01:49:08,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:49:08,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:49:08,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:49:08,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b34d34043de23ba14fb4 HTTP/1.1" 200 None 2026-04-08 01:49:08,314 - lava_callback - INFO - Completed processing callback for node 69d5b34d34043de23ba14fb4 INFO: 172.20.0.1:32964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:49:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:49:26,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:50:29,523 - lava_callback - INFO - Received callback for node 69d3115c13dd9a9509894995 INFO: 172.20.0.1:38028 - "POST /node/69d3115c13dd9a9509894995 HTTP/1.0" 202 Accepted 2026-04-08 01:50:29,531 - lava_callback - INFO - Starting async job submit for node 69d3115c13dd9a9509894995 2026-04-08 01:50:29,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:50:29,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3115c13dd9a9509894995 HTTP/1.1" 200 None 2026-04-08 01:50:29,548 - lava_callback - DEBUG - Processing node 69d3115c13dd9a9509894995: baseline-arm-baylibre 2026-04-08 01:50:29,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3115c13dd9a9509894995 2026-04-08 01:50:29,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:50:29,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3115c13dd9a9509894995 HTTP/1.1" 200 None 2026-04-08 01:50:29,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:50:29,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:50:29,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:50:29,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3115c13dd9a9509894995 HTTP/1.1" 200 None 2026-04-08 01:50:29,599 - lava_callback - ERROR - Error processing callback for node 69d3115c13dd9a9509894995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39238 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:51:09,274 - lava_callback - INFO - Received callback for node 69d3117f13dd9a95098949bf INFO: 172.20.0.1:39244 - "POST /node/69d3117f13dd9a95098949bf HTTP/1.0" 202 Accepted 2026-04-08 01:51:09,279 - lava_callback - INFO - Starting async job submit for node 69d3117f13dd9a95098949bf 2026-04-08 01:51:09,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:09,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3117f13dd9a95098949bf HTTP/1.1" 200 None 2026-04-08 01:51:09,294 - lava_callback - DEBUG - Processing node 69d3117f13dd9a95098949bf: baseline-arm-baylibre 2026-04-08 01:51:09,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3117f13dd9a95098949bf 2026-04-08 01:51:09,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:09,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3117f13dd9a95098949bf HTTP/1.1" 200 None 2026-04-08 01:51:09,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:09,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:51:09,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:09,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3117f13dd9a95098949bf HTTP/1.1" 200 None 2026-04-08 01:51:09,345 - lava_callback - ERROR - Error processing callback for node 69d3117f13dd9a95098949bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42934 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:51:32,481 - lava_callback - INFO - Received callback for node 69d5b3ee34043de23ba15016 INFO: 172.20.0.1:35396 - "POST /node/69d5b3ee34043de23ba15016 HTTP/1.0" 202 Accepted 2026-04-08 01:51:32,490 - lava_callback - INFO - Starting async job submit for node 69d5b3ee34043de23ba15016 2026-04-08 01:51:32,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:32,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b3ee34043de23ba15016 HTTP/1.1" 200 None 2026-04-08 01:51:32,573 - lava_callback - DEBUG - Processing node 69d5b3ee34043de23ba15016: baseline-arm64-foundriesio INFO: 172.20.0.1:35400 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:51:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:51:33,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:51:33,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5b3ee34043de23ba15016/log.txt.gz 2026-04-08 01:51:34,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:51:34,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:51:34,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5b3ee34043de23ba15016/lava-logs.yaml 2026-04-08 01:51:34,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:51:34,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:51:34,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5b3ee34043de23ba15016/lava_callback.json.gz DEBUG: 69d5b3ee34043de23ba15016 Transitting job node result: pass -> incomplete 2026-04-08 01:51:34,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:34,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b3ee34043de23ba15016 HTTP/1.1" 200 None 2026-04-08 01:51:34,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:34,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:51:34,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:34,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b3ee34043de23ba15016 HTTP/1.1" 200 None 2026-04-08 01:51:34,648 - lava_callback - INFO - Completed processing callback for node 69d5b3ee34043de23ba15016 INFO: 172.20.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:51:49,394 - lava_callback - INFO - Received callback for node 69d311a313dd9a95098949d0 INFO: 172.20.0.1:55308 - "POST /node/69d311a313dd9a95098949d0 HTTP/1.0" 202 Accepted 2026-04-08 01:51:49,401 - lava_callback - INFO - Starting async job submit for node 69d311a313dd9a95098949d0 2026-04-08 01:51:49,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:49,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311a313dd9a95098949d0 HTTP/1.1" 200 None 2026-04-08 01:51:49,417 - lava_callback - DEBUG - Processing node 69d311a313dd9a95098949d0: baseline-arm-baylibre 2026-04-08 01:51:49,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d311a313dd9a95098949d0 2026-04-08 01:51:49,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:49,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311a313dd9a95098949d0 HTTP/1.1" 200 None 2026-04-08 01:51:49,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:49,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:51:49,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:49,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d311a313dd9a95098949d0 HTTP/1.1" 200 None 2026-04-08 01:51:49,493 - lava_callback - ERROR - Error processing callback for node 69d311a313dd9a95098949d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 01:51:56,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:51:56,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:52:32,446 - lava_callback - INFO - Received callback for node 69d311ca13dd9a95098949e5 INFO: 172.20.0.1:34338 - "POST /node/69d311ca13dd9a95098949e5 HTTP/1.0" 202 Accepted 2026-04-08 01:52:32,451 - lava_callback - INFO - Starting async job submit for node 69d311ca13dd9a95098949e5 2026-04-08 01:52:32,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:32,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311ca13dd9a95098949e5 HTTP/1.1" 200 None 2026-04-08 01:52:32,482 - lava_callback - DEBUG - Processing node 69d311ca13dd9a95098949e5: baseline-arm-clabbe 2026-04-08 01:52:32,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d311ca13dd9a95098949e5 2026-04-08 01:52:32,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311ca13dd9a95098949e5 HTTP/1.1" 200 None 2026-04-08 01:52:32,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:32,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:52:32,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:32,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d311ca13dd9a95098949e5 HTTP/1.1" 200 None 2026-04-08 01:52:32,544 - lava_callback - ERROR - Error processing callback for node 69d311ca13dd9a95098949e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:52:49,392 - lava_callback - INFO - Received callback for node 69d311eb13dd9a95098949fd INFO: 172.20.0.1:41202 - "POST /node/69d311eb13dd9a95098949fd HTTP/1.0" 202 Accepted 2026-04-08 01:52:49,397 - lava_callback - INFO - Starting async job submit for node 69d311eb13dd9a95098949fd 2026-04-08 01:52:49,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:49,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311eb13dd9a95098949fd HTTP/1.1" 200 None 2026-04-08 01:52:49,413 - lava_callback - DEBUG - Processing node 69d311eb13dd9a95098949fd: baseline-arm-baylibre 2026-04-08 01:52:49,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d311eb13dd9a95098949fd 2026-04-08 01:52:49,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:49,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d311eb13dd9a95098949fd HTTP/1.1" 200 None 2026-04-08 01:52:49,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:49,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:52:49,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:52:49,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d311eb13dd9a95098949fd HTTP/1.1" 200 None 2026-04-08 01:52:49,479 - lava_callback - ERROR - Error processing callback for node 69d311eb13dd9a95098949fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:53:29,465 - lava_callback - INFO - Received callback for node 69d3120c13dd9a9509894a18 INFO: 172.20.0.1:45452 - "POST /node/69d3120c13dd9a9509894a18 HTTP/1.0" 202 Accepted 2026-04-08 01:53:29,471 - lava_callback - INFO - Starting async job submit for node 69d3120c13dd9a9509894a18 2026-04-08 01:53:29,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:53:29,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3120c13dd9a9509894a18 HTTP/1.1" 200 None 2026-04-08 01:53:29,488 - lava_callback - DEBUG - Processing node 69d3120c13dd9a9509894a18: baseline-arm-baylibre 2026-04-08 01:53:29,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3120c13dd9a9509894a18 2026-04-08 01:53:29,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:53:29,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3120c13dd9a9509894a18 HTTP/1.1" 200 None 2026-04-08 01:53:29,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:53:29,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 01:53:29,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:53:29,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3120c13dd9a9509894a18 HTTP/1.1" 200 None 2026-04-08 01:53:29,541 - lava_callback - ERROR - Error processing callback for node 69d3120c13dd9a9509894a18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57778 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:54:09,461 - lava_callback - INFO - Received callback for node 69d3123613dd9a9509894a28 INFO: 172.20.0.1:57782 - "POST /node/69d3123613dd9a9509894a28 HTTP/1.0" 202 Accepted 2026-04-08 01:54:09,470 - lava_callback - INFO - Starting async job submit for node 69d3123613dd9a9509894a28 2026-04-08 01:54:09,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:54:09,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3123613dd9a9509894a28 HTTP/1.1" 200 None 2026-04-08 01:54:09,492 - lava_callback - DEBUG - Processing node 69d3123613dd9a9509894a28: baseline-arm64-baylibre 2026-04-08 01:54:09,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3123613dd9a9509894a28 2026-04-08 01:54:09,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:54:09,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3123613dd9a9509894a28 HTTP/1.1" 200 None 2026-04-08 01:54:09,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:54:09,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:54:09,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:54:09,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3123613dd9a9509894a28 HTTP/1.1" 200 None 2026-04-08 01:54:09,570 - lava_callback - ERROR - Error processing callback for node 69d3123613dd9a9509894a28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43262 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:55:09,565 - lava_callback - INFO - Received callback for node 69d3127a13dd9a9509894a6f INFO: 172.20.0.1:43266 - "POST /node/69d3127a13dd9a9509894a6f HTTP/1.0" 202 Accepted 2026-04-08 01:55:09,571 - lava_callback - INFO - Starting async job submit for node 69d3127a13dd9a9509894a6f 2026-04-08 01:55:09,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:55:09,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3127a13dd9a9509894a6f HTTP/1.1" 200 None 2026-04-08 01:55:09,594 - lava_callback - DEBUG - Processing node 69d3127a13dd9a9509894a6f: baseline-arm64-baylibre 2026-04-08 01:55:09,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3127a13dd9a9509894a6f 2026-04-08 01:55:09,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:55:09,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3127a13dd9a9509894a6f HTTP/1.1" 200 None 2026-04-08 01:55:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:55:09,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:55:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:55:09,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3127a13dd9a9509894a6f HTTP/1.1" 200 None 2026-04-08 01:55:09,660 - lava_callback - ERROR - Error processing callback for node 69d3127a13dd9a9509894a6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:56:29,588 - lava_callback - INFO - Received callback for node 69d312ba13dd9a9509894ab9 INFO: 172.20.0.1:33880 - "POST /node/69d312ba13dd9a9509894ab9 HTTP/1.0" 202 Accepted 2026-04-08 01:56:29,595 - lava_callback - INFO - Starting async job submit for node 69d312ba13dd9a9509894ab9 2026-04-08 01:56:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:56:29,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d312ba13dd9a9509894ab9 HTTP/1.1" 200 None 2026-04-08 01:56:29,614 - lava_callback - DEBUG - Processing node 69d312ba13dd9a9509894ab9: baseline-arm64-baylibre 2026-04-08 01:56:29,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d312ba13dd9a9509894ab9 2026-04-08 01:56:29,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:56:29,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d312ba13dd9a9509894ab9 HTTP/1.1" 200 None 2026-04-08 01:56:29,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:56:29,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:56:29,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:56:29,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d312ba13dd9a9509894ab9 HTTP/1.1" 200 None 2026-04-08 01:56:29,671 - lava_callback - ERROR - Error processing callback for node 69d312ba13dd9a9509894ab9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47944 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:57:29,612 - lava_callback - INFO - Received callback for node 69d312fa13dd9a9509894b0f INFO: 172.20.0.1:47956 - "POST /node/69d312fa13dd9a9509894b0f HTTP/1.0" 202 Accepted 2026-04-08 01:57:29,618 - lava_callback - INFO - Starting async job submit for node 69d312fa13dd9a9509894b0f 2026-04-08 01:57:29,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:57:29,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d312fa13dd9a9509894b0f HTTP/1.1" 200 None 2026-04-08 01:57:29,647 - lava_callback - DEBUG - Processing node 69d312fa13dd9a9509894b0f: baseline-arm64-baylibre 2026-04-08 01:57:29,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d312fa13dd9a9509894b0f 2026-04-08 01:57:29,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:57:29,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d312fa13dd9a9509894b0f HTTP/1.1" 200 None 2026-04-08 01:57:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:57:29,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:57:29,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:57:29,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d312fa13dd9a9509894b0f HTTP/1.1" 200 None 2026-04-08 01:57:29,700 - lava_callback - ERROR - Error processing callback for node 69d312fa13dd9a9509894b0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:58:29,748 - lava_callback - INFO - Received callback for node 69d3134013dd9a9509894b29 INFO: 172.20.0.1:37526 - "POST /node/69d3134013dd9a9509894b29 HTTP/1.0" 202 Accepted 2026-04-08 01:58:29,754 - lava_callback - INFO - Starting async job submit for node 69d3134013dd9a9509894b29 2026-04-08 01:58:29,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:58:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3134013dd9a9509894b29 HTTP/1.1" 200 None 2026-04-08 01:58:29,770 - lava_callback - DEBUG - Processing node 69d3134013dd9a9509894b29: baseline-arm64-baylibre 2026-04-08 01:58:29,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3134013dd9a9509894b29 2026-04-08 01:58:29,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:58:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3134013dd9a9509894b29 HTTP/1.1" 200 None 2026-04-08 01:58:29,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:58:29,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:58:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:58:29,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3134013dd9a9509894b29 HTTP/1.1" 200 None 2026-04-08 01:58:29,832 - lava_callback - ERROR - Error processing callback for node 69d3134013dd9a9509894b29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58056 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:59:00,647 - lava_callback - INFO - Received callback for node 69d5b4a934043de23ba150b5 INFO: 172.20.0.1:36070 - "POST /node/69d5b4a934043de23ba150b5 HTTP/1.0" 202 Accepted 2026-04-08 01:59:00,655 - lava_callback - INFO - Starting async job submit for node 69d5b4a934043de23ba150b5 2026-04-08 01:59:00,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:00,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b4a934043de23ba150b5 HTTP/1.1" 200 None 2026-04-08 01:59:00,705 - lava_callback - DEBUG - Processing node 69d5b4a934043de23ba150b5: baseline-arm64 2026-04-08 01:59:01,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:59:01,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:59:01,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b4a934043de23ba150b5/log.txt.gz 2026-04-08 01:59:01,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:59:01,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:59:01,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b4a934043de23ba150b5/lava-logs.yaml 2026-04-08 01:59:01,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 01:59:01,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 01:59:01,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b4a934043de23ba150b5/lava_callback.json.gz DEBUG: Setup failed for 69d5b4a934043de23ba150b5. Transitting job node result: incomplete -> fail 2026-04-08 01:59:01,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b4a934043de23ba150b5 HTTP/1.1" 200 None 2026-04-08 01:59:01,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:01,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 01:59:01,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:01,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b4a934043de23ba150b5 HTTP/1.1" 200 None 2026-04-08 01:59:02,086 - lava_callback - INFO - Completed processing callback for node 69d5b4a934043de23ba150b5 INFO: 172.20.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51022 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:59:26,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:26,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK 2026-04-08 01:59:49,917 - lava_callback - INFO - Received callback for node 69d3138313dd9a9509894b5b INFO: 172.20.0.1:52762 - "POST /node/69d3138313dd9a9509894b5b HTTP/1.0" 202 Accepted 2026-04-08 01:59:49,923 - lava_callback - INFO - Starting async job submit for node 69d3138313dd9a9509894b5b 2026-04-08 01:59:49,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:49,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3138313dd9a9509894b5b HTTP/1.1" 200 None 2026-04-08 01:59:49,940 - lava_callback - DEBUG - Processing node 69d3138313dd9a9509894b5b: baseline-arm64-baylibre 2026-04-08 01:59:49,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3138313dd9a9509894b5b 2026-04-08 01:59:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:49,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3138313dd9a9509894b5b HTTP/1.1" 200 None 2026-04-08 01:59:49,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:49,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 01:59:49,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 01:59:49,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3138313dd9a9509894b5b HTTP/1.1" 200 None 2026-04-08 01:59:49,995 - lava_callback - ERROR - Error processing callback for node 69d3138313dd9a9509894b5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:00:52,886 - lava_callback - INFO - Received callback for node 69d313d013dd9a9509894b91 INFO: 172.20.0.1:33704 - "POST /node/69d313d013dd9a9509894b91 HTTP/1.0" 202 Accepted 2026-04-08 02:00:52,892 - lava_callback - INFO - Starting async job submit for node 69d313d013dd9a9509894b91 2026-04-08 02:00:52,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:00:52,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d313d013dd9a9509894b91 HTTP/1.1" 200 None 2026-04-08 02:00:52,908 - lava_callback - DEBUG - Processing node 69d313d013dd9a9509894b91: baseline-arm64-clabbe 2026-04-08 02:00:52,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d313d013dd9a9509894b91 2026-04-08 02:00:52,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:00:52,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d313d013dd9a9509894b91 HTTP/1.1" 200 None 2026-04-08 02:00:52,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:00:52,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:00:52,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:00:52,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d313d013dd9a9509894b91 HTTP/1.1" 200 None 2026-04-08 02:00:52,966 - lava_callback - ERROR - Error processing callback for node 69d313d013dd9a9509894b91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42934 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:01:52,893 - lava_callback - INFO - Received callback for node 69d3140d13dd9a9509894bea INFO: 172.20.0.1:38100 - "POST /node/69d3140d13dd9a9509894bea HTTP/1.0" 202 Accepted 2026-04-08 02:01:52,902 - lava_callback - INFO - Starting async job submit for node 69d3140d13dd9a9509894bea 2026-04-08 02:01:52,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:01:52,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3140d13dd9a9509894bea HTTP/1.1" 200 None 2026-04-08 02:01:52,921 - lava_callback - DEBUG - Processing node 69d3140d13dd9a9509894bea: baseline-arm64-clabbe 2026-04-08 02:01:52,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3140d13dd9a9509894bea 2026-04-08 02:01:52,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:01:52,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3140d13dd9a9509894bea HTTP/1.1" 200 None 2026-04-08 02:01:52,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:01:52,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:01:52,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:01:52,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3140d13dd9a9509894bea HTTP/1.1" 200 None 2026-04-08 02:01:52,993 - lava_callback - ERROR - Error processing callback for node 69d3140d13dd9a9509894bea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39512 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:03:13,033 - lava_callback - INFO - Received callback for node 69d3144b13dd9a9509894c4e INFO: 172.20.0.1:41644 - "POST /node/69d3144b13dd9a9509894c4e HTTP/1.0" 202 Accepted 2026-04-08 02:03:13,039 - lava_callback - INFO - Starting async job submit for node 69d3144b13dd9a9509894c4e 2026-04-08 02:03:13,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:03:13,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3144b13dd9a9509894c4e HTTP/1.1" 200 None 2026-04-08 02:03:13,059 - lava_callback - DEBUG - Processing node 69d3144b13dd9a9509894c4e: baseline-arm64-clabbe 2026-04-08 02:03:13,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3144b13dd9a9509894c4e 2026-04-08 02:03:13,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:03:13,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3144b13dd9a9509894c4e HTTP/1.1" 200 None 2026-04-08 02:03:13,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:03:13,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:03:13,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:03:13,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3144b13dd9a9509894c4e HTTP/1.1" 200 None 2026-04-08 02:03:13,114 - lava_callback - ERROR - Error processing callback for node 69d3144b13dd9a9509894c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:04:12,989 - lava_callback - INFO - Received callback for node 69d3148e13dd9a9509894c7c INFO: 172.20.0.1:32800 - "POST /node/69d3148e13dd9a9509894c7c HTTP/1.0" 202 Accepted 2026-04-08 02:04:12,995 - lava_callback - INFO - Starting async job submit for node 69d3148e13dd9a9509894c7c 2026-04-08 02:04:12,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:13,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3148e13dd9a9509894c7c HTTP/1.1" 200 None 2026-04-08 02:04:13,011 - lava_callback - DEBUG - Processing node 69d3148e13dd9a9509894c7c: baseline-arm64-clabbe 2026-04-08 02:04:13,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3148e13dd9a9509894c7c 2026-04-08 02:04:13,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:13,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3148e13dd9a9509894c7c HTTP/1.1" 200 None 2026-04-08 02:04:13,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:13,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:04:13,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:13,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3148e13dd9a9509894c7c HTTP/1.1" 200 None 2026-04-08 02:04:13,074 - lava_callback - ERROR - Error processing callback for node 69d3148e13dd9a9509894c7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:04:25,370 - lava_callback - INFO - Received callback for node 69d5b24034043de23ba14ead INFO: 172.20.0.1:37778 - "POST /node/69d5b24034043de23ba14ead HTTP/1.0" 202 Accepted 2026-04-08 02:04:25,376 - lava_callback - INFO - Starting async job submit for node 69d5b24034043de23ba14ead 2026-04-08 02:04:25,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:25,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b24034043de23ba14ead HTTP/1.1" 200 None 2026-04-08 02:04:25,414 - lava_callback - DEBUG - Processing node 69d5b24034043de23ba14ead: baseline-arm64 2026-04-08 02:04:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:04:25,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:04:25,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b24034043de23ba14ead/log.txt.gz 2026-04-08 02:04:25,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:04:26,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:04:26,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b24034043de23ba14ead/lava-logs.yaml 2026-04-08 02:04:26,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:04:26,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:04:26,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b24034043de23ba14ead/lava_callback.json.gz 2026-04-08 02:04:26,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:26,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b24034043de23ba14ead HTTP/1.1" 200 None 2026-04-08 02:04:26,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:26,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:04:26,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:26,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b24034043de23ba14ead HTTP/1.1" 200 None 2026-04-08 02:04:26,410 - lava_callback - INFO - Completed processing callback for node 69d5b24034043de23ba14ead INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:04:56,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:04:56,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:06:33,091 - lava_callback - INFO - Received callback for node 69d3151413dd9a9509894cbc INFO: 172.20.0.1:56754 - "POST /node/69d3151413dd9a9509894cbc HTTP/1.0" 202 Accepted 2026-04-08 02:06:33,096 - lava_callback - INFO - Starting async job submit for node 69d3151413dd9a9509894cbc 2026-04-08 02:06:33,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:06:33,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3151413dd9a9509894cbc HTTP/1.1" 200 None 2026-04-08 02:06:33,119 - lava_callback - DEBUG - Processing node 69d3151413dd9a9509894cbc: baseline-arm64-clabbe 2026-04-08 02:06:33,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3151413dd9a9509894cbc 2026-04-08 02:06:33,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:06:33,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3151413dd9a9509894cbc HTTP/1.1" 200 None 2026-04-08 02:06:33,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56764 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:06:33,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:06:33,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:06:33,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3151413dd9a9509894cbc HTTP/1.1" 200 None 2026-04-08 02:06:33,189 - lava_callback - ERROR - Error processing callback for node 69d3151413dd9a9509894cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:07:11,177 - lava_callback - INFO - Received callback for node 69d5b5cb34043de23ba15145 INFO: 172.20.0.1:34542 - "POST /node/69d5b5cb34043de23ba15145 HTTP/1.0" 202 Accepted 2026-04-08 02:07:11,184 - lava_callback - INFO - Starting async job submit for node 69d5b5cb34043de23ba15145 2026-04-08 02:07:11,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:11,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b5cb34043de23ba15145 HTTP/1.1" 200 None 2026-04-08 02:07:11,223 - lava_callback - DEBUG - Processing node 69d5b5cb34043de23ba15145: baseline-arm64 2026-04-08 02:07:11,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:07:12,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:07:12,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b5cb34043de23ba15145/log.txt.gz 2026-04-08 02:07:12,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:07:12,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:07:12,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b5cb34043de23ba15145/lava-logs.yaml 2026-04-08 02:07:12,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:07:12,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:07:12,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b5cb34043de23ba15145/lava_callback.json.gz 2026-04-08 02:07:12,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:12,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b5cb34043de23ba15145 HTTP/1.1" 200 None 2026-04-08 02:07:12,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:12,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:07:12,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:12,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b5cb34043de23ba15145 HTTP/1.1" 200 None 2026-04-08 02:07:12,904 - lava_callback - INFO - Completed processing callback for node 69d5b5cb34043de23ba15145 INFO: 172.20.0.1:34556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:07:26,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:26,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36022 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:07:33,163 - lava_callback - INFO - Received callback for node 69d3155c13dd9a9509894cf4 INFO: 172.20.0.1:36038 - "POST /node/69d3155c13dd9a9509894cf4 HTTP/1.0" 202 Accepted 2026-04-08 02:07:33,169 - lava_callback - INFO - Starting async job submit for node 69d3155c13dd9a9509894cf4 2026-04-08 02:07:33,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:33,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3155c13dd9a9509894cf4 HTTP/1.1" 200 None 2026-04-08 02:07:33,185 - lava_callback - DEBUG - Processing node 69d3155c13dd9a9509894cf4: baseline-arm64-clabbe 2026-04-08 02:07:33,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3155c13dd9a9509894cf4 2026-04-08 02:07:33,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:33,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3155c13dd9a9509894cf4 HTTP/1.1" 200 None 2026-04-08 02:07:33,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-08 02:07:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:07:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3155c13dd9a9509894cf4 HTTP/1.1" 200 None 2026-04-08 02:07:33,241 - lava_callback - ERROR - Error processing callback for node 69d3155c13dd9a9509894cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:08:33,176 - lava_callback - INFO - Received callback for node 69d3159413dd9a9509894d26 INFO: 172.20.0.1:53598 - "POST /node/69d3159413dd9a9509894d26 HTTP/1.0" 202 Accepted 2026-04-08 02:08:33,185 - lava_callback - INFO - Starting async job submit for node 69d3159413dd9a9509894d26 2026-04-08 02:08:33,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:08:33,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3159413dd9a9509894d26 HTTP/1.1" 200 None 2026-04-08 02:08:33,214 - lava_callback - DEBUG - Processing node 69d3159413dd9a9509894d26: baseline-arm-clabbe 2026-04-08 02:08:33,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3159413dd9a9509894d26 2026-04-08 02:08:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:08:33,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3159413dd9a9509894d26 HTTP/1.1" 200 None 2026-04-08 02:08:33,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:08:33,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 02:08:33,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:08:33,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3159413dd9a9509894d26 HTTP/1.1" 200 None 2026-04-08 02:08:33,286 - lava_callback - ERROR - Error processing callback for node 69d3159413dd9a9509894d26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:09:13,167 - lava_callback - INFO - Received callback for node 69d315b913dd9a9509894d34 INFO: 172.20.0.1:59050 - "POST /node/69d315b913dd9a9509894d34 HTTP/1.0" 202 Accepted 2026-04-08 02:09:13,172 - lava_callback - INFO - Starting async job submit for node 69d315b913dd9a9509894d34 2026-04-08 02:09:13,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:13,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315b913dd9a9509894d34 HTTP/1.1" 200 None 2026-04-08 02:09:13,191 - lava_callback - DEBUG - Processing node 69d315b913dd9a9509894d34: baseline-arm-clabbe 2026-04-08 02:09:13,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d315b913dd9a9509894d34 2026-04-08 02:09:13,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:13,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315b913dd9a9509894d34 HTTP/1.1" 200 None 2026-04-08 02:09:13,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:13,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 02:09:13,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:13,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d315b913dd9a9509894d34 HTTP/1.1" 200 None 2026-04-08 02:09:13,249 - lava_callback - ERROR - Error processing callback for node 69d315b913dd9a9509894d34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:09:53,102 - lava_callback - INFO - Received callback for node 69d5b66034043de23ba151a0 INFO: 172.20.0.1:48422 - "POST /node/69d5b66034043de23ba151a0 HTTP/1.0" 202 Accepted 2026-04-08 02:09:53,112 - lava_callback - INFO - Starting async job submit for node 69d5b66034043de23ba151a0 2026-04-08 02:09:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:53,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b66034043de23ba151a0 HTTP/1.1" 200 None 2026-04-08 02:09:53,157 - lava_callback - DEBUG - Processing node 69d5b66034043de23ba151a0: baseline-nfs-arm64 2026-04-08 02:09:53,247 - lava_callback - INFO - Received callback for node 69d315dc13dd9a9509894d4b INFO: 172.20.0.1:48436 - "POST /node/69d315dc13dd9a9509894d4b HTTP/1.0" 202 Accepted 2026-04-08 02:09:53,257 - lava_callback - INFO - Starting async job submit for node 69d315dc13dd9a9509894d4b 2026-04-08 02:09:53,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:53,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315dc13dd9a9509894d4b HTTP/1.1" 200 None 2026-04-08 02:09:53,347 - lava_callback - DEBUG - Processing node 69d315dc13dd9a9509894d4b: baseline-arm-clabbe 2026-04-08 02:09:53,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d315dc13dd9a9509894d4b 2026-04-08 02:09:53,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:53,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d315dc13dd9a9509894d4b HTTP/1.1" 200 None 2026-04-08 02:09:53,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:53,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 02:09:53,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:53,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d315dc13dd9a9509894d4b HTTP/1.1" 200 None 2026-04-08 02:09:53,672 - lava_callback - ERROR - Error processing callback for node 69d315dc13dd9a9509894d4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 02:09:53,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:09:53,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:09:53,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b66034043de23ba151a0/log.txt.gz 2026-04-08 02:09:54,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:09:54,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:09:54,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b66034043de23ba151a0/lava-logs.yaml 2026-04-08 02:09:54,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:09:54,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:09:54,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b66034043de23ba151a0/lava_callback.json.gz 2026-04-08 02:09:54,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b66034043de23ba151a0 HTTP/1.1" 200 None 2026-04-08 02:09:54,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:54,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:09:54,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:54,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b66034043de23ba151a0 HTTP/1.1" 200 None 2026-04-08 02:09:54,759 - lava_callback - INFO - Completed processing callback for node 69d5b66034043de23ba151a0 2026-04-08 02:09:56,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:09:56,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60500 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:11:33,281 - lava_callback - INFO - Received callback for node 69d3164413dd9a9509894d88 INFO: 172.20.0.1:60508 - "POST /node/69d3164413dd9a9509894d88 HTTP/1.0" 202 Accepted 2026-04-08 02:11:33,287 - lava_callback - INFO - Starting async job submit for node 69d3164413dd9a9509894d88 2026-04-08 02:11:33,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:11:33,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3164413dd9a9509894d88 HTTP/1.1" 200 None 2026-04-08 02:11:33,303 - lava_callback - DEBUG - Processing node 69d3164413dd9a9509894d88: baseline-arm-clabbe 2026-04-08 02:11:33,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3164413dd9a9509894d88 2026-04-08 02:11:33,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:11:33,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3164413dd9a9509894d88 HTTP/1.1" 200 None 2026-04-08 02:11:33,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:11:33,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-08 02:11:33,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:11:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3164413dd9a9509894d88 HTTP/1.1" 200 None 2026-04-08 02:11:33,372 - lava_callback - ERROR - Error processing callback for node 69d3164413dd9a9509894d88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49428 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:14:04,369 - lava_callback - INFO - Received callback for node 69d5b9b634043de23ba15406 INFO: 172.20.0.1:47860 - "POST /node/69d5b9b634043de23ba15406 HTTP/1.0" 202 Accepted 2026-04-08 02:14:04,376 - lava_callback - INFO - Starting async job submit for node 69d5b9b634043de23ba15406 2026-04-08 02:14:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:04,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b9b634043de23ba15406 HTTP/1.1" 200 None 2026-04-08 02:14:04,421 - lava_callback - DEBUG - Processing node 69d5b9b634043de23ba15406: baseline-arm64 2026-04-08 02:14:04,572 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:14:04,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:14:04,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:14:04,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b9b634043de23ba15406/lava-logs.yaml 2026-04-08 02:14:04,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:14:04,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:14:04,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5b9b634043de23ba15406/lava_callback.json.gz 2026-04-08 02:14:04,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:04,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b9b634043de23ba15406 HTTP/1.1" 200 None 2026-04-08 02:14:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:05,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:14:05,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b9b634043de23ba15406 HTTP/1.1" 200 None 2026-04-08 02:14:05,128 - lava_callback - INFO - Completed processing callback for node 69d5b9b634043de23ba15406 INFO: 172.20.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:14:26,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:26,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:14:40,442 - lava_callback - INFO - Received callback for node 69d5ba0034043de23ba1546c INFO: 172.20.0.1:37930 - "POST /node/69d5ba0034043de23ba1546c HTTP/1.0" 202 Accepted 2026-04-08 02:14:40,448 - lava_callback - INFO - Starting async job submit for node 69d5ba0034043de23ba1546c 2026-04-08 02:14:40,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:40,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba0034043de23ba1546c HTTP/1.1" 200 None 2026-04-08 02:14:40,465 - lava_callback - DEBUG - Processing node 69d5ba0034043de23ba1546c: baseline-nfs-arm64 2026-04-08 02:14:40,466 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:14:40,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:14:40,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:14:40,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5ba0034043de23ba1546c/lava-logs.yaml 2026-04-08 02:14:40,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:14:40,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:14:40,895 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5ba0034043de23ba1546c/lava_callback.json.gz 2026-04-08 02:14:40,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:40,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba0034043de23ba1546c HTTP/1.1" 200 None 2026-04-08 02:14:40,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:40,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:14:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:40,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ba0034043de23ba1546c HTTP/1.1" 200 None 2026-04-08 02:14:40,961 - lava_callback - INFO - Completed processing callback for node 69d5ba0034043de23ba1546c INFO: 172.20.0.1:37942 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:14:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:14:56,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:16:24,064 - lava_callback - INFO - Received callback for node 69d5ba3c34043de23ba154a2 INFO: 172.20.0.1:48290 - "POST /node/69d5ba3c34043de23ba154a2 HTTP/1.0" 202 Accepted 2026-04-08 02:16:24,071 - lava_callback - INFO - Starting async job submit for node 69d5ba3c34043de23ba154a2 2026-04-08 02:16:24,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba3c34043de23ba154a2 HTTP/1.1" 200 None 2026-04-08 02:16:24,116 - lava_callback - DEBUG - Processing node 69d5ba3c34043de23ba154a2: baseline-arm64 2026-04-08 02:16:24,316 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:16:24,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:16:24,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:16:24,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5ba3c34043de23ba154a2/lava-logs.yaml 2026-04-08 02:16:24,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:16:24,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:16:24,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5ba3c34043de23ba154a2/lava_callback.json.gz 2026-04-08 02:16:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:24,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba3c34043de23ba154a2 HTTP/1.1" 200 None 2026-04-08 02:16:24,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:24,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:16:24,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:24,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ba3c34043de23ba154a2 HTTP/1.1" 200 None 2026-04-08 02:16:24,963 - lava_callback - INFO - Completed processing callback for node 69d5ba3c34043de23ba154a2 2026-04-08 02:16:26,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:26,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48304 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:16:30,714 - lava_callback - INFO - Received callback for node 69d3177813dd9a9509894e86 INFO: 172.20.0.1:54930 - "POST /node/69d3177813dd9a9509894e86 HTTP/1.0" 202 Accepted 2026-04-08 02:16:30,720 - lava_callback - INFO - Starting async job submit for node 69d3177813dd9a9509894e86 2026-04-08 02:16:30,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:30,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3177813dd9a9509894e86 HTTP/1.1" 200 None 2026-04-08 02:16:30,742 - lava_callback - DEBUG - Processing node 69d3177813dd9a9509894e86: baseline-arm64-baylibre 2026-04-08 02:16:30,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3177813dd9a9509894e86 2026-04-08 02:16:30,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:30,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3177813dd9a9509894e86 HTTP/1.1" 200 None 2026-04-08 02:16:30,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:30,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:16:30,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:16:30,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3177813dd9a9509894e86 HTTP/1.1" 200 None 2026-04-08 02:16:30,797 - lava_callback - ERROR - Error processing callback for node 69d3177813dd9a9509894e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:18:45,967 - lava_callback - INFO - Received callback for node 69d5bab934043de23ba154fd INFO: 172.20.0.1:56612 - "POST /node/69d5bab934043de23ba154fd HTTP/1.0" 202 Accepted 2026-04-08 02:18:45,975 - lava_callback - INFO - Starting async job submit for node 69d5bab934043de23ba154fd 2026-04-08 02:18:46,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:18:46,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bab934043de23ba154fd HTTP/1.1" 200 None 2026-04-08 02:18:46,019 - lava_callback - DEBUG - Processing node 69d5bab934043de23ba154fd: baseline-arm64-foundriesio 2026-04-08 02:18:46,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56618 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:18:46,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:18:46,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5bab934043de23ba154fd/log.txt.gz 2026-04-08 02:18:47,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:18:47,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:18:47,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5bab934043de23ba154fd/lava-logs.yaml 2026-04-08 02:18:47,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:18:47,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:18:47,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d5bab934043de23ba154fd/lava_callback.json.gz 2026-04-08 02:18:47,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:18:47,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bab934043de23ba154fd HTTP/1.1" 200 None 2026-04-08 02:18:47,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:18:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:18:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:18:47,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5bab934043de23ba154fd HTTP/1.1" 200 None 2026-04-08 02:18:47,559 - lava_callback - INFO - Completed processing callback for node 69d5bab934043de23ba154fd 2026-04-08 02:18:56,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:18:56,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:19:10,826 - lava_callback - INFO - Received callback for node 69d3181313dd9a9509894f2a INFO: 172.20.0.1:49600 - "POST /node/69d3181313dd9a9509894f2a HTTP/1.0" 202 Accepted 2026-04-08 02:19:10,832 - lava_callback - INFO - Starting async job submit for node 69d3181313dd9a9509894f2a 2026-04-08 02:19:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:19:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3181313dd9a9509894f2a HTTP/1.1" 200 None 2026-04-08 02:19:10,848 - lava_callback - DEBUG - Processing node 69d3181313dd9a9509894f2a: baseline-arm64-baylibre 2026-04-08 02:19:10,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3181313dd9a9509894f2a 2026-04-08 02:19:10,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:19:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3181313dd9a9509894f2a HTTP/1.1" 200 None 2026-04-08 02:19:10,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:19:10,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:19:10,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:19:10,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3181313dd9a9509894f2a HTTP/1.1" 200 None 2026-04-08 02:19:10,932 - lava_callback - ERROR - Error processing callback for node 69d3181313dd9a9509894f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33450 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:20:30,866 - lava_callback - INFO - Received callback for node 69d3185c13dd9a9509894f82 INFO: 172.20.0.1:49614 - "POST /node/69d3185c13dd9a9509894f82 HTTP/1.0" 202 Accepted 2026-04-08 02:20:30,872 - lava_callback - INFO - Starting async job submit for node 69d3185c13dd9a9509894f82 2026-04-08 02:20:30,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:20:30,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3185c13dd9a9509894f82 HTTP/1.1" 200 None 2026-04-08 02:20:30,890 - lava_callback - DEBUG - Processing node 69d3185c13dd9a9509894f82: baseline-arm64-baylibre 2026-04-08 02:20:30,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3185c13dd9a9509894f82 2026-04-08 02:20:30,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:20:30,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3185c13dd9a9509894f82 HTTP/1.1" 200 None 2026-04-08 02:20:30,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:20:30,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:20:30,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:20:30,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3185c13dd9a9509894f82 HTTP/1.1" 200 None 2026-04-08 02:20:30,942 - lava_callback - ERROR - Error processing callback for node 69d3185c13dd9a9509894f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:21:30,903 - lava_callback - INFO - Received callback for node 69d318a713dd9a9509894f8e INFO: 172.20.0.1:39562 - "POST /node/69d318a713dd9a9509894f8e HTTP/1.0" 202 Accepted 2026-04-08 02:21:30,909 - lava_callback - INFO - Starting async job submit for node 69d318a713dd9a9509894f8e 2026-04-08 02:21:30,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:21:30,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d318a713dd9a9509894f8e HTTP/1.1" 200 None 2026-04-08 02:21:30,929 - lava_callback - DEBUG - Processing node 69d318a713dd9a9509894f8e: baseline-arm64-baylibre 2026-04-08 02:21:30,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d318a713dd9a9509894f8e 2026-04-08 02:21:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:21:30,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d318a713dd9a9509894f8e HTTP/1.1" 200 None 2026-04-08 02:21:30,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:21:30,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:21:30,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:21:30,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d318a713dd9a9509894f8e HTTP/1.1" 200 None 2026-04-08 02:21:30,990 - lava_callback - ERROR - Error processing callback for node 69d318a713dd9a9509894f8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45010 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:22:54,031 - lava_callback - INFO - Received callback for node 69d318ea13dd9a9509894ffa INFO: 172.20.0.1:48246 - "POST /node/69d318ea13dd9a9509894ffa HTTP/1.0" 202 Accepted 2026-04-08 02:22:54,036 - lava_callback - INFO - Starting async job submit for node 69d318ea13dd9a9509894ffa 2026-04-08 02:22:54,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:22:54,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d318ea13dd9a9509894ffa HTTP/1.1" 200 None 2026-04-08 02:22:54,053 - lava_callback - DEBUG - Processing node 69d318ea13dd9a9509894ffa: baseline-arm64-clabbe 2026-04-08 02:22:54,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d318ea13dd9a9509894ffa 2026-04-08 02:22:54,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:22:54,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d318ea13dd9a9509894ffa HTTP/1.1" 200 None 2026-04-08 02:22:54,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:22:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:22:54,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:22:54,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d318ea13dd9a9509894ffa HTTP/1.1" 200 None 2026-04-08 02:22:54,115 - lava_callback - ERROR - Error processing callback for node 69d318ea13dd9a9509894ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47676 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:24:53,893 - lava_callback - INFO - Received callback for node 69d3196f13dd9a950989505f INFO: 172.20.0.1:53630 - "POST /node/69d3196f13dd9a950989505f HTTP/1.0" 202 Accepted 2026-04-08 02:24:53,898 - lava_callback - INFO - Starting async job submit for node 69d3196f13dd9a950989505f 2026-04-08 02:24:53,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:24:53,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3196f13dd9a950989505f HTTP/1.1" 200 None 2026-04-08 02:24:53,914 - lava_callback - DEBUG - Processing node 69d3196f13dd9a950989505f: baseline-arm64-clabbe 2026-04-08 02:24:53,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3196f13dd9a950989505f 2026-04-08 02:24:53,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:24:53,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3196f13dd9a950989505f HTTP/1.1" 200 None 2026-04-08 02:24:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:24:53,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:24:53,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:24:53,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3196f13dd9a950989505f HTTP/1.1" 200 None 2026-04-08 02:24:53,982 - lava_callback - ERROR - Error processing callback for node 69d3196f13dd9a950989505f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35986 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:27:13,982 - lava_callback - INFO - Received callback for node 69d319f813dd9a95098950c1 INFO: 172.20.0.1:40866 - "POST /node/69d319f813dd9a95098950c1 HTTP/1.0" 202 Accepted 2026-04-08 02:27:13,988 - lava_callback - INFO - Starting async job submit for node 69d319f813dd9a95098950c1 2026-04-08 02:27:13,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:27:14,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d319f813dd9a95098950c1 HTTP/1.1" 200 None 2026-04-08 02:27:14,007 - lava_callback - DEBUG - Processing node 69d319f813dd9a95098950c1: baseline-arm64-clabbe 2026-04-08 02:27:14,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d319f813dd9a95098950c1 2026-04-08 02:27:14,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:27:14,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d319f813dd9a95098950c1 HTTP/1.1" 200 None 2026-04-08 02:27:14,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:27:14,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:27:14,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:27:14,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d319f813dd9a95098950c1 HTTP/1.1" 200 None 2026-04-08 02:27:14,062 - lava_callback - ERROR - Error processing callback for node 69d319f813dd9a95098950c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33756 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:28:14,018 - lava_callback - INFO - Received callback for node 69d31a3b13dd9a95098950ef INFO: 172.20.0.1:42452 - "POST /node/69d31a3b13dd9a95098950ef HTTP/1.0" 202 Accepted 2026-04-08 02:28:14,023 - lava_callback - INFO - Starting async job submit for node 69d31a3b13dd9a95098950ef 2026-04-08 02:28:14,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:28:14,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31a3b13dd9a95098950ef HTTP/1.1" 200 None 2026-04-08 02:28:14,040 - lava_callback - DEBUG - Processing node 69d31a3b13dd9a95098950ef: baseline-arm64-clabbe 2026-04-08 02:28:14,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31a3b13dd9a95098950ef 2026-04-08 02:28:14,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:28:14,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31a3b13dd9a95098950ef HTTP/1.1" 200 None 2026-04-08 02:28:14,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:28:14,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:28:14,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:28:14,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31a3b13dd9a95098950ef HTTP/1.1" 200 None 2026-04-08 02:28:14,115 - lava_callback - ERROR - Error processing callback for node 69d31a3b13dd9a95098950ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58726 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:29:03,336 - lava_callback - INFO - Received callback for node 69d5b8d034043de23ba15379 INFO: 172.20.0.1:50764 - "POST /node/69d5b8d034043de23ba15379 HTTP/1.0" 202 Accepted 2026-04-08 02:29:03,344 - lava_callback - INFO - Starting async job submit for node 69d5b8d034043de23ba15379 2026-04-08 02:29:03,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:03,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b8d034043de23ba15379 HTTP/1.1" 200 None 2026-04-08 02:29:03,408 - lava_callback - DEBUG - Processing node 69d5b8d034043de23ba15379: baseline-nfs-arm64 2026-04-08 02:29:04,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:29:04,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:29:04,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b8d034043de23ba15379/log.txt.gz 2026-04-08 02:29:05,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:29:05,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:29:05,577 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b8d034043de23ba15379/lava-logs.yaml 2026-04-08 02:29:05,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:29:05,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:29:05,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5b8d034043de23ba15379/lava_callback.json.gz DEBUG: Setup failed for 69d5b8d034043de23ba15379. Transitting job node result: incomplete -> fail 2026-04-08 02:29:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:05,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5b8d034043de23ba15379 HTTP/1.1" 200 None 2026-04-08 02:29:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:05,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:29:05,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:05,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5b8d034043de23ba15379 HTTP/1.1" 200 None 2026-04-08 02:29:06,016 - lava_callback - INFO - Completed processing callback for node 69d5b8d034043de23ba15379 INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57814 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:29:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:26,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59130 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:29:34,162 - lava_callback - INFO - Received callback for node 69d31a8013dd9a950989511f INFO: 172.20.0.1:59142 - "POST /node/69d31a8013dd9a950989511f HTTP/1.0" 202 Accepted 2026-04-08 02:29:34,168 - lava_callback - INFO - Starting async job submit for node 69d31a8013dd9a950989511f 2026-04-08 02:29:34,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:34,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31a8013dd9a950989511f HTTP/1.1" 200 None 2026-04-08 02:29:34,183 - lava_callback - DEBUG - Processing node 69d31a8013dd9a950989511f: baseline-arm64-clabbe 2026-04-08 02:29:34,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31a8013dd9a950989511f 2026-04-08 02:29:34,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:34,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31a8013dd9a950989511f HTTP/1.1" 200 None 2026-04-08 02:29:34,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:34,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:29:34,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:29:34,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31a8013dd9a950989511f HTTP/1.1" 200 None 2026-04-08 02:29:34,248 - lava_callback - ERROR - Error processing callback for node 69d31a8013dd9a950989511f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38162 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-08 02:30:15,910 - lava_callback - INFO - Received callback for node 69d5bc5b34043de23ba155a6 INFO: 172.20.0.1:38172 - "POST /node/69d5bc5b34043de23ba155a6 HTTP/1.0" 202 Accepted 2026-04-08 02:30:15,917 - lava_callback - INFO - Starting async job submit for node 69d5bc5b34043de23ba155a6 2026-04-08 02:30:15,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:15,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bc5b34043de23ba155a6 HTTP/1.1" 200 None 2026-04-08 02:30:15,967 - lava_callback - DEBUG - Processing node 69d5bc5b34043de23ba155a6: baseline-arm64 2026-04-08 02:30:16,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:30:16,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:30:16,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5bc5b34043de23ba155a6/log.txt.gz INFO: 172.20.0.1:38184 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:30:16,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:30:16,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:30:16,933 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5bc5b34043de23ba155a6/lava-logs.yaml 2026-04-08 02:30:16,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:30:17,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:30:17,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5bc5b34043de23ba155a6/lava_callback.json.gz DEBUG: Setup failed for 69d5bc5b34043de23ba155a6. Transitting job node result: incomplete -> fail 2026-04-08 02:30:17,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:17,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bc5b34043de23ba155a6 HTTP/1.1" 200 None 2026-04-08 02:30:17,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:17,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:30:17,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:17,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5bc5b34043de23ba155a6 HTTP/1.1" 200 None 2026-04-08 02:30:17,306 - lava_callback - INFO - Completed processing callback for node 69d5bc5b34043de23ba155a6 2026-04-08 02:30:26,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:26,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:30:34,149 - lava_callback - INFO - Received callback for node 69d31ac513dd9a950989514f INFO: 172.20.0.1:57184 - "POST /node/69d31ac513dd9a950989514f HTTP/1.0" 202 Accepted 2026-04-08 02:30:34,154 - lava_callback - INFO - Starting async job submit for node 69d31ac513dd9a950989514f 2026-04-08 02:30:34,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:34,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ac513dd9a950989514f HTTP/1.1" 200 None 2026-04-08 02:30:34,170 - lava_callback - DEBUG - Processing node 69d31ac513dd9a950989514f: baseline-arm64-clabbe 2026-04-08 02:30:34,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31ac513dd9a950989514f 2026-04-08 02:30:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:34,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ac513dd9a950989514f HTTP/1.1" 200 None 2026-04-08 02:30:34,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:34,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-08 02:30:34,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:30:34,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31ac513dd9a950989514f HTTP/1.1" 200 None 2026-04-08 02:30:34,252 - lava_callback - ERROR - Error processing callback for node 69d31ac513dd9a950989514f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45358 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:33:13,806 - lava_callback - INFO - Received callback for node 69d5ba8334043de23ba154cc INFO: 172.20.0.1:43690 - "POST /node/69d5ba8334043de23ba154cc HTTP/1.0" 202 Accepted 2026-04-08 02:33:13,813 - lava_callback - INFO - Starting async job submit for node 69d5ba8334043de23ba154cc 2026-04-08 02:33:13,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:33:13,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba8334043de23ba154cc HTTP/1.1" 200 None 2026-04-08 02:33:13,881 - lava_callback - DEBUG - Processing node 69d5ba8334043de23ba154cc: baseline-arm 2026-04-08 02:33:14,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:33:14,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:33:14,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5ba8334043de23ba154cc/log.txt.gz 2026-04-08 02:33:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-08 02:33:15,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:33:15,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5ba8334043de23ba154cc/lava-logs.yaml 2026-04-08 02:33:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:33:15,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:33:15,432 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5ba8334043de23ba154cc/lava_callback.json.gz DEBUG: Setup failed for 69d5ba8334043de23ba154cc. Transitting job node result: incomplete -> fail 2026-04-08 02:33:15,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:33:15,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5ba8334043de23ba154cc HTTP/1.1" 200 None 2026-04-08 02:33:15,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:33:15,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 02:33:15,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:33:15,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5ba8334043de23ba154cc HTTP/1.1" 200 None 2026-04-08 02:33:15,726 - lava_callback - INFO - Completed processing callback for node 69d5ba8334043de23ba154cc INFO: 172.20.0.1:43704 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:33:26,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:33:26,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:38:37,467 - lava_callback - INFO - Received callback for node 69d5bf6f34043de23ba15757 INFO: 172.20.0.1:42918 - "POST /node/69d5bf6f34043de23ba15757 HTTP/1.0" 202 Accepted 2026-04-08 02:38:37,474 - lava_callback - INFO - Starting async job submit for node 69d5bf6f34043de23ba15757 2026-04-08 02:38:37,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:38:37,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bf6f34043de23ba15757 HTTP/1.1" 200 None 2026-04-08 02:38:37,519 - lava_callback - DEBUG - Processing node 69d5bf6f34043de23ba15757: baseline-arm64 2026-04-08 02:38:37,652 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:38:37,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:38:37,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:38:37,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5bf6f34043de23ba15757/lava-logs.yaml 2026-04-08 02:38:37,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:38:38,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:38:38,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5bf6f34043de23ba15757/lava_callback.json.gz 2026-04-08 02:38:38,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:38:38,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bf6f34043de23ba15757 HTTP/1.1" 200 None 2026-04-08 02:38:38,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:38:38,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:38:38,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:38:38,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5bf6f34043de23ba15757 HTTP/1.1" 200 None 2026-04-08 02:38:38,223 - lava_callback - INFO - Completed processing callback for node 69d5bf6f34043de23ba15757 INFO: 172.20.0.1:58374 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:38:56,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:38:56,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:39:20,727 - lava_callback - INFO - Received callback for node 69d5bfbf34043de23ba1577a INFO: 172.20.0.1:38984 - "POST /node/69d5bfbf34043de23ba1577a HTTP/1.0" 202 Accepted 2026-04-08 02:39:20,733 - lava_callback - INFO - Starting async job submit for node 69d5bfbf34043de23ba1577a 2026-04-08 02:39:20,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:39:20,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bfbf34043de23ba1577a HTTP/1.1" 200 None 2026-04-08 02:39:20,750 - lava_callback - DEBUG - Processing node 69d5bfbf34043de23ba1577a: baseline-nfs-arm64 2026-04-08 02:39:20,752 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:39:20,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:39:20,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:39:20,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5bfbf34043de23ba1577a/lava-logs.yaml 2026-04-08 02:39:20,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:39:21,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:39:21,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5bfbf34043de23ba1577a/lava_callback.json.gz 2026-04-08 02:39:21,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:39:21,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bfbf34043de23ba1577a HTTP/1.1" 200 None 2026-04-08 02:39:21,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:39:21,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:39:21,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:39:21,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5bfbf34043de23ba1577a HTTP/1.1" 200 None 2026-04-08 02:39:21,065 - lava_callback - INFO - Completed processing callback for node 69d5bfbf34043de23ba1577a 2026-04-08 02:39:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:39:26,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45822 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:40:51,143 - lava_callback - INFO - Received callback for node 69d5c00134043de23ba1579a INFO: 172.20.0.1:57130 - "POST /node/69d5c00134043de23ba1579a HTTP/1.0" 202 Accepted 2026-04-08 02:40:51,150 - lava_callback - INFO - Starting async job submit for node 69d5c00134043de23ba1579a 2026-04-08 02:40:51,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:40:51,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c00134043de23ba1579a HTTP/1.1" 200 None 2026-04-08 02:40:51,203 - lava_callback - DEBUG - Processing node 69d5c00134043de23ba1579a: baseline-arm64 2026-04-08 02:40:51,342 - lava_callback - WARNING - Failed to upload log 2026-04-08 02:40:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:40:51,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:40:51,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c00134043de23ba1579a/lava-logs.yaml 2026-04-08 02:40:51,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:40:51,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:40:51,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c00134043de23ba1579a/lava_callback.json.gz 2026-04-08 02:40:51,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:40:51,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c00134043de23ba1579a HTTP/1.1" 200 None 2026-04-08 02:40:51,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:40:51,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:40:51,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:40:51,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c00134043de23ba1579a HTTP/1.1" 200 None 2026-04-08 02:40:51,888 - lava_callback - INFO - Completed processing callback for node 69d5c00134043de23ba1579a 2026-04-08 02:40:56,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:40:56,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:41:32,105 - lava_callback - INFO - Received callback for node 69d31d4e13dd9a9509895349 INFO: 172.20.0.1:39312 - "POST /node/69d31d4e13dd9a9509895349 HTTP/1.0" 202 Accepted 2026-04-08 02:41:32,111 - lava_callback - INFO - Starting async job submit for node 69d31d4e13dd9a9509895349 2026-04-08 02:41:32,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:41:32,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31d4e13dd9a9509895349 HTTP/1.1" 200 None 2026-04-08 02:41:32,128 - lava_callback - DEBUG - Processing node 69d31d4e13dd9a9509895349: baseline-arm-baylibre 2026-04-08 02:41:32,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31d4e13dd9a9509895349 2026-04-08 02:41:32,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:41:32,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31d4e13dd9a9509895349 HTTP/1.1" 200 None 2026-04-08 02:41:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:41:32,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:41:32,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:41:32,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31d4e13dd9a9509895349 HTTP/1.1" 200 None 2026-04-08 02:41:32,181 - lava_callback - ERROR - Error processing callback for node 69d31d4e13dd9a9509895349: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:43:12,413 - lava_callback - INFO - Received callback for node 69d5be4d34043de23ba156d7 INFO: 172.20.0.1:45196 - "POST /node/69d5be4d34043de23ba156d7 HTTP/1.0" 202 Accepted 2026-04-08 02:43:12,420 - lava_callback - INFO - Starting async job submit for node 69d5be4d34043de23ba156d7 2026-04-08 02:43:12,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:43:12,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5be4d34043de23ba156d7 HTTP/1.1" 200 None 2026-04-08 02:43:12,476 - lava_callback - DEBUG - Processing node 69d5be4d34043de23ba156d7: baseline-arm64 2026-04-08 02:43:12,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:43:13,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:43:13,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5be4d34043de23ba156d7/log.txt.gz 2026-04-08 02:43:13,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:43:13,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:43:13,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5be4d34043de23ba156d7/lava-logs.yaml 2026-04-08 02:43:13,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:43:13,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:43:13,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5be4d34043de23ba156d7/lava_callback.json.gz 2026-04-08 02:43:13,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:43:13,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5be4d34043de23ba156d7 HTTP/1.1" 200 None 2026-04-08 02:43:13,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:43:14,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:43:14,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:43:14,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5be4d34043de23ba156d7 HTTP/1.1" 200 None 2026-04-08 02:43:14,085 - lava_callback - INFO - Completed processing callback for node 69d5be4d34043de23ba156d7 INFO: 172.20.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:43:26,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:43:26,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59098 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:44:26,104 - lava_callback - INFO - Received callback for node 69d5bce634043de23ba155e2 INFO: 172.20.0.1:47572 - "POST /node/69d5bce634043de23ba155e2 HTTP/1.0" 202 Accepted 2026-04-08 02:44:26,110 - lava_callback - INFO - Starting async job submit for node 69d5bce634043de23ba155e2 2026-04-08 02:44:26,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:44:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bce634043de23ba155e2 HTTP/1.1" 200 None 2026-04-08 02:44:26,196 - lava_callback - DEBUG - Processing node 69d5bce634043de23ba155e2: ltp-smoke INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:44:26,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:44:26,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:44:26,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5bce634043de23ba155e2/log.txt.gz 2026-04-08 02:44:27,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:44:27,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:44:27,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5bce634043de23ba155e2/lava-logs.yaml 2026-04-08 02:44:27,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:44:27,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:44:27,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d5bce634043de23ba155e2/lava_callback.json.gz 2026-04-08 02:44:27,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:44:27,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5bce634043de23ba155e2 HTTP/1.1" 200 None 2026-04-08 02:44:27,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:44:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9f34043de23ba13b4f HTTP/1.1" 200 None 2026-04-08 02:44:27,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:44:27,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5bce634043de23ba155e2 HTTP/1.1" 200 None 2026-04-08 02:44:27,748 - lava_callback - INFO - Completed processing callback for node 69d5bce634043de23ba155e2 INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51154 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:44:56,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:44:56,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:45:38,114 - lava_callback - INFO - Received callback for node 69d5beec34043de23ba15700 INFO: 172.20.0.1:53074 - "POST /node/69d5beec34043de23ba15700 HTTP/1.0" 202 Accepted 2026-04-08 02:45:38,121 - lava_callback - INFO - Starting async job submit for node 69d5beec34043de23ba15700 2026-04-08 02:45:38,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:45:38,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5beec34043de23ba15700 HTTP/1.1" 200 None 2026-04-08 02:45:38,191 - lava_callback - DEBUG - Processing node 69d5beec34043de23ba15700: baseline-nfs-arm64 2026-04-08 02:45:38,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:45:38,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:45:38,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5beec34043de23ba15700/log.txt.gz 2026-04-08 02:45:39,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:45:39,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:45:39,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5beec34043de23ba15700/lava-logs.yaml 2026-04-08 02:45:39,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:45:39,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:45:39,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5beec34043de23ba15700/lava_callback.json.gz 2026-04-08 02:45:39,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:45:39,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5beec34043de23ba15700 HTTP/1.1" 200 None 2026-04-08 02:45:39,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:45:39,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:45:39,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:45:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5beec34043de23ba15700 HTTP/1.1" 200 None 2026-04-08 02:45:39,853 - lava_callback - INFO - Completed processing callback for node 69d5beec34043de23ba15700 INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53134 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:45:56,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:45:56,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:46:34,927 - lava_callback - INFO - Received callback for node 69d31e8213dd9a950989539c INFO: 172.20.0.1:57380 - "POST /node/69d31e8213dd9a950989539c HTTP/1.0" 202 Accepted 2026-04-08 02:46:34,932 - lava_callback - INFO - Starting async job submit for node 69d31e8213dd9a950989539c 2026-04-08 02:46:34,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:46:34,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31e8213dd9a950989539c HTTP/1.1" 200 None 2026-04-08 02:46:34,949 - lava_callback - DEBUG - Processing node 69d31e8213dd9a950989539c: baseline-arm-clabbe 2026-04-08 02:46:34,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31e8213dd9a950989539c 2026-04-08 02:46:34,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:46:34,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31e8213dd9a950989539c HTTP/1.1" 200 None 2026-04-08 02:46:34,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:46:34,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:46:34,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:46:35,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31e8213dd9a950989539c HTTP/1.1" 200 None 2026-04-08 02:46:35,014 - lava_callback - ERROR - Error processing callback for node 69d31e8213dd9a950989539c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:47:14,888 - lava_callback - INFO - Received callback for node 69d31ea613dd9a95098953a7 INFO: 172.20.0.1:45128 - "POST /node/69d31ea613dd9a95098953a7 HTTP/1.0" 202 Accepted 2026-04-08 02:47:14,893 - lava_callback - INFO - Starting async job submit for node 69d31ea613dd9a95098953a7 2026-04-08 02:47:14,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:14,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ea613dd9a95098953a7 HTTP/1.1" 200 None 2026-04-08 02:47:14,909 - lava_callback - DEBUG - Processing node 69d31ea613dd9a95098953a7: baseline-arm-clabbe 2026-04-08 02:47:14,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31ea613dd9a95098953a7 2026-04-08 02:47:14,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:14,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ea613dd9a95098953a7 HTTP/1.1" 200 None 2026-04-08 02:47:14,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:14,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:47:14,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:14,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31ea613dd9a95098953a7 HTTP/1.1" 200 None 2026-04-08 02:47:14,970 - lava_callback - ERROR - Error processing callback for node 69d31ea613dd9a95098953a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36696 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:47:34,964 - lava_callback - INFO - Received callback for node 69d31ec413dd9a95098953c3 INFO: 172.20.0.1:36712 - "POST /node/69d31ec413dd9a95098953c3 HTTP/1.0" 202 Accepted 2026-04-08 02:47:34,970 - lava_callback - INFO - Starting async job submit for node 69d31ec413dd9a95098953c3 2026-04-08 02:47:34,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:34,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ec413dd9a95098953c3 HTTP/1.1" 200 None 2026-04-08 02:47:34,986 - lava_callback - DEBUG - Processing node 69d31ec413dd9a95098953c3: baseline-arm-clabbe 2026-04-08 02:47:34,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31ec413dd9a95098953c3 2026-04-08 02:47:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:34,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ec413dd9a95098953c3 HTTP/1.1" 200 None 2026-04-08 02:47:35,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:35,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:47:35,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:47:35,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31ec413dd9a95098953c3 HTTP/1.1" 200 None 2026-04-08 02:47:35,050 - lava_callback - ERROR - Error processing callback for node 69d31ec413dd9a95098953c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:48:14,951 - lava_callback - INFO - Received callback for node 69d31ee713dd9a95098953fd INFO: 172.20.0.1:53994 - "POST /node/69d31ee713dd9a95098953fd HTTP/1.0" 202 Accepted 2026-04-08 02:48:14,956 - lava_callback - INFO - Starting async job submit for node 69d31ee713dd9a95098953fd 2026-04-08 02:48:14,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:14,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ee713dd9a95098953fd HTTP/1.1" 200 None 2026-04-08 02:48:14,973 - lava_callback - DEBUG - Processing node 69d31ee713dd9a95098953fd: baseline-arm-clabbe 2026-04-08 02:48:14,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31ee713dd9a95098953fd 2026-04-08 02:48:14,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:14,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31ee713dd9a95098953fd HTTP/1.1" 200 None 2026-04-08 02:48:14,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:15,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:48:15,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:15,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31ee713dd9a95098953fd HTTP/1.1" 200 None 2026-04-08 02:48:15,029 - lava_callback - ERROR - Error processing callback for node 69d31ee713dd9a95098953fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37668 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:48:55,012 - lava_callback - INFO - Received callback for node 69d31f0413dd9a9509895433 INFO: 172.20.0.1:42098 - "POST /node/69d31f0413dd9a9509895433 HTTP/1.0" 202 Accepted 2026-04-08 02:48:55,017 - lava_callback - INFO - Starting async job submit for node 69d31f0413dd9a9509895433 2026-04-08 02:48:55,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:55,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f0413dd9a9509895433 HTTP/1.1" 200 None 2026-04-08 02:48:55,042 - lava_callback - DEBUG - Processing node 69d31f0413dd9a9509895433: baseline-arm-clabbe 2026-04-08 02:48:55,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31f0413dd9a9509895433 2026-04-08 02:48:55,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:55,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f0413dd9a9509895433 HTTP/1.1" 200 None 2026-04-08 02:48:55,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:48:55,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:48:55,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31f0413dd9a9509895433 HTTP/1.1" 200 None 2026-04-08 02:48:55,118 - lava_callback - ERROR - Error processing callback for node 69d31f0413dd9a9509895433: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:49:34,991 - lava_callback - INFO - Received callback for node 69d31f2c13dd9a950989546d INFO: 172.20.0.1:34834 - "POST /node/69d31f2c13dd9a950989546d HTTP/1.0" 202 Accepted 2026-04-08 02:49:34,996 - lava_callback - INFO - Starting async job submit for node 69d31f2c13dd9a950989546d 2026-04-08 02:49:34,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:35,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f2c13dd9a950989546d HTTP/1.1" 200 None 2026-04-08 02:49:35,012 - lava_callback - DEBUG - Processing node 69d31f2c13dd9a950989546d: baseline-arm-clabbe 2026-04-08 02:49:35,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31f2c13dd9a950989546d 2026-04-08 02:49:35,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:35,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f2c13dd9a950989546d HTTP/1.1" 200 None 2026-04-08 02:49:35,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:35,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:49:35,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31f2c13dd9a950989546d HTTP/1.1" 200 None 2026-04-08 02:49:35,088 - lava_callback - ERROR - Error processing callback for node 69d31f2c13dd9a950989546d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:49:55,029 - lava_callback - INFO - Received callback for node 69d31f4d13dd9a950989547d INFO: 172.20.0.1:60590 - "POST /node/69d31f4d13dd9a950989547d HTTP/1.0" 202 Accepted 2026-04-08 02:49:55,034 - lava_callback - INFO - Starting async job submit for node 69d31f4d13dd9a950989547d 2026-04-08 02:49:55,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:55,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f4d13dd9a950989547d HTTP/1.1" 200 None 2026-04-08 02:49:55,052 - lava_callback - DEBUG - Processing node 69d31f4d13dd9a950989547d: baseline-arm-clabbe 2026-04-08 02:49:55,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31f4d13dd9a950989547d 2026-04-08 02:49:55,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:55,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f4d13dd9a950989547d HTTP/1.1" 200 None 2026-04-08 02:49:55,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:55,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:49:55,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:55,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31f4d13dd9a950989547d HTTP/1.1" 200 None 2026-04-08 02:49:55,122 - lava_callback - ERROR - Error processing callback for node 69d31f4d13dd9a950989547d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-08 02:49:55,172 - lava_callback - INFO - Received callback for node 69d5c09134043de23ba1580b INFO: 172.20.0.1:60598 - "POST /node/69d5c09134043de23ba1580b HTTP/1.0" 202 Accepted 2026-04-08 02:49:55,183 - lava_callback - INFO - Starting async job submit for node 69d5c09134043de23ba1580b 2026-04-08 02:49:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:55,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c09134043de23ba1580b HTTP/1.1" 200 None 2026-04-08 02:49:55,273 - lava_callback - DEBUG - Processing node 69d5c09134043de23ba1580b: baseline-arm64 2026-04-08 02:49:55,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:49:55,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:49:55,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c09134043de23ba1580b/log.txt.gz 2026-04-08 02:49:56,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:49:56,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:49:56,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c09134043de23ba1580b/lava-logs.yaml 2026-04-08 02:49:56,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60614 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:49:56,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:49:56,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c09134043de23ba1580b/lava_callback.json.gz DEBUG: Setup failed for 69d5c09134043de23ba1580b. Transitting job node result: incomplete -> fail 2026-04-08 02:49:56,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:56,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c09134043de23ba1580b HTTP/1.1" 200 None 2026-04-08 02:49:56,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:56,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:49:56,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:49:56,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c09134043de23ba1580b HTTP/1.1" 200 None 2026-04-08 02:49:56,809 - lava_callback - INFO - Completed processing callback for node 69d5c09134043de23ba1580b INFO: 172.20.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:50:26,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:50:26,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:50:35,051 - lava_callback - INFO - Received callback for node 69d31f7213dd9a950989549b INFO: 172.20.0.1:49000 - "POST /node/69d31f7213dd9a950989549b HTTP/1.0" 202 Accepted 2026-04-08 02:50:35,056 - lava_callback - INFO - Starting async job submit for node 69d31f7213dd9a950989549b 2026-04-08 02:50:35,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:50:35,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f7213dd9a950989549b HTTP/1.1" 200 None 2026-04-08 02:50:35,073 - lava_callback - DEBUG - Processing node 69d31f7213dd9a950989549b: baseline-arm-clabbe 2026-04-08 02:50:35,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31f7213dd9a950989549b 2026-04-08 02:50:35,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:50:35,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f7213dd9a950989549b HTTP/1.1" 200 None 2026-04-08 02:50:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:50:35,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:50:35,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:50:35,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31f7213dd9a950989549b HTTP/1.1" 200 None 2026-04-08 02:50:35,137 - lava_callback - ERROR - Error processing callback for node 69d31f7213dd9a950989549b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:51:15,129 - lava_callback - INFO - Received callback for node 69d31f9413dd9a95098954a8 INFO: 172.20.0.1:58748 - "POST /node/69d31f9413dd9a95098954a8 HTTP/1.0" 202 Accepted 2026-04-08 02:51:15,135 - lava_callback - INFO - Starting async job submit for node 69d31f9413dd9a95098954a8 2026-04-08 02:51:15,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:51:15,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f9413dd9a95098954a8 HTTP/1.1" 200 None 2026-04-08 02:51:15,152 - lava_callback - DEBUG - Processing node 69d31f9413dd9a95098954a8: baseline-arm-clabbe 2026-04-08 02:51:15,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d31f9413dd9a95098954a8 2026-04-08 02:51:15,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:58754 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-08 02:51:15,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d31f9413dd9a95098954a8 HTTP/1.1" 200 None 2026-04-08 02:51:15,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:51:15,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-08 02:51:15,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:51:15,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d31f9413dd9a95098954a8 HTTP/1.1" 200 None 2026-04-08 02:51:15,220 - lava_callback - ERROR - Error processing callback for node 69d31f9413dd9a95098954a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:58:13,506 - lava_callback - INFO - Received callback for node 69d5c1cb34043de23ba158fe INFO: 172.20.0.1:58956 - "POST /node/69d5c1cb34043de23ba158fe HTTP/1.0" 202 Accepted 2026-04-08 02:58:13,513 - lava_callback - INFO - Starting async job submit for node 69d5c1cb34043de23ba158fe 2026-04-08 02:58:13,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:58:13,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c1cb34043de23ba158fe HTTP/1.1" 200 None 2026-04-08 02:58:13,553 - lava_callback - DEBUG - Processing node 69d5c1cb34043de23ba158fe: baseline-arm64 2026-04-08 02:58:14,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:58:14,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:58:14,229 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c1cb34043de23ba158fe/log.txt.gz 2026-04-08 02:58:14,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:58:14,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:58:14,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c1cb34043de23ba158fe/lava-logs.yaml 2026-04-08 02:58:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 02:58:14,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 02:58:14,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d5c1cb34043de23ba158fe/lava_callback.json.gz 2026-04-08 02:58:14,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:58:14,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c1cb34043de23ba158fe HTTP/1.1" 200 None 2026-04-08 02:58:14,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:58:14,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 02:58:14,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:58:14,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c1cb34043de23ba158fe HTTP/1.1" 200 None 2026-04-08 02:58:15,014 - lava_callback - INFO - Completed processing callback for node 69d5c1cb34043de23ba158fe INFO: 172.20.0.1:58966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK 2026-04-08 02:58:26,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 02:58:26,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:01:21,303 - lava_callback - INFO - Received callback for node 69d5c04f34043de23ba157cb INFO: 172.20.0.1:35284 - "POST /node/69d5c04f34043de23ba157cb HTTP/1.0" 202 Accepted 2026-04-08 03:01:21,311 - lava_callback - INFO - Starting async job submit for node 69d5c04f34043de23ba157cb 2026-04-08 03:01:21,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:21,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c04f34043de23ba157cb HTTP/1.1" 200 None 2026-04-08 03:01:21,382 - lava_callback - DEBUG - Processing node 69d5c04f34043de23ba157cb: baseline-nfs-arm64 2026-04-08 03:01:22,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:01:22,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:22,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c04f34043de23ba157cb/log.txt.gz 2026-04-08 03:01:23,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:01:23,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:23,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c04f34043de23ba157cb/lava-logs.yaml 2026-04-08 03:01:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:01:23,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:23,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c04f34043de23ba157cb/lava_callback.json.gz DEBUG: Setup failed for 69d5c04f34043de23ba157cb. Transitting job node result: incomplete -> fail 2026-04-08 03:01:23,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:23,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c04f34043de23ba157cb HTTP/1.1" 200 None 2026-04-08 03:01:23,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:23,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 03:01:23,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:23,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c04f34043de23ba157cb HTTP/1.1" 200 None 2026-04-08 03:01:24,016 - lava_callback - INFO - Completed processing callback for node 69d5c04f34043de23ba157cb 2026-04-08 03:01:25,385 - lava_callback - INFO - Received callback for node 69d5c28234043de23ba1596f INFO: 172.20.0.1:35290 - "POST /node/69d5c28234043de23ba1596f HTTP/1.0" 202 Accepted 2026-04-08 03:01:25,392 - lava_callback - INFO - Starting async job submit for node 69d5c28234043de23ba1596f 2026-04-08 03:01:25,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:25,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c28234043de23ba1596f HTTP/1.1" 200 None 2026-04-08 03:01:25,433 - lava_callback - DEBUG - Processing node 69d5c28234043de23ba1596f: baseline-nfs-arm64 2026-04-08 03:01:25,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:01:26,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:26,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c28234043de23ba1596f/log.txt.gz 2026-04-08 03:01:26,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:01:26,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:26,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c28234043de23ba1596f/lava-logs.yaml 2026-04-08 03:01:26,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:01:26,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:26,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-08 03:01:26,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:01:26,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c28234043de23ba1596f/lava_callback.json.gz 2026-04-08 03:01:26,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:26,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c28234043de23ba1596f HTTP/1.1" 200 None 2026-04-08 03:01:26,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:26,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 03:01:26,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:26,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c28234043de23ba1596f HTTP/1.1" 200 None 2026-04-08 03:01:26,853 - lava_callback - INFO - Completed processing callback for node 69d5c28234043de23ba1596f INFO: 172.20.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42870 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:01:56,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:01:56,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36880 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:03:04,083 - lava_callback - INFO - Received callback for node 69d5c0d234043de23ba1582d INFO: 172.20.0.1:45996 - "POST /node/69d5c0d234043de23ba1582d HTTP/1.0" 202 Accepted 2026-04-08 03:03:04,089 - lava_callback - INFO - Starting async job submit for node 69d5c0d234043de23ba1582d 2026-04-08 03:03:04,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:03:04,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c0d234043de23ba1582d HTTP/1.1" 200 None 2026-04-08 03:03:04,154 - lava_callback - DEBUG - Processing node 69d5c0d234043de23ba1582d: baseline-arm 2026-04-08 03:03:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:03:04,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:03:04,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d5c0d234043de23ba1582d/log.txt.gz 2026-04-08 03:03:05,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:03:05,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:03:05,268 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d5c0d234043de23ba1582d/lava-logs.yaml 2026-04-08 03:03:05,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:03:05,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:03:05,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d5c0d234043de23ba1582d/lava_callback.json.gz DEBUG: Setup failed for 69d5c0d234043de23ba1582d. Transitting job node result: incomplete -> fail 2026-04-08 03:03:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:03:05,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c0d234043de23ba1582d HTTP/1.1" 200 None 2026-04-08 03:03:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:03:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-08 03:03:05,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:03:05,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c0d234043de23ba1582d HTTP/1.1" 200 None 2026-04-08 03:03:05,728 - lava_callback - INFO - Completed processing callback for node 69d5c0d234043de23ba1582d INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:03:26,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:03:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55654 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:05:33,319 - lava_callback - INFO - Received callback for node 69d322f313dd9a95098955cd INFO: 172.20.0.1:40462 - "POST /node/69d322f313dd9a95098955cd HTTP/1.0" 202 Accepted 2026-04-08 03:05:33,325 - lava_callback - INFO - Starting async job submit for node 69d322f313dd9a95098955cd 2026-04-08 03:05:33,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:05:33,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d322f313dd9a95098955cd HTTP/1.1" 200 None 2026-04-08 03:05:33,341 - lava_callback - DEBUG - Processing node 69d322f313dd9a95098955cd: baseline-arm64-baylibre 2026-04-08 03:05:33,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d322f313dd9a95098955cd 2026-04-08 03:05:33,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:05:33,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d322f313dd9a95098955cd HTTP/1.1" 200 None 2026-04-08 03:05:33,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:05:33,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:05:33,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:05:33,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d322f313dd9a95098955cd HTTP/1.1" 200 None 2026-04-08 03:05:33,402 - lava_callback - ERROR - Error processing callback for node 69d322f313dd9a95098955cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:06:33,329 - lava_callback - INFO - Received callback for node 69d3233613dd9a95098955ea INFO: 172.20.0.1:48978 - "POST /node/69d3233613dd9a95098955ea HTTP/1.0" 202 Accepted 2026-04-08 03:06:33,335 - lava_callback - INFO - Starting async job submit for node 69d3233613dd9a95098955ea 2026-04-08 03:06:33,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:06:33,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3233613dd9a95098955ea HTTP/1.1" 200 None 2026-04-08 03:06:33,351 - lava_callback - DEBUG - Processing node 69d3233613dd9a95098955ea: baseline-arm64-baylibre 2026-04-08 03:06:33,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3233613dd9a95098955ea 2026-04-08 03:06:33,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:06:33,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3233613dd9a95098955ea HTTP/1.1" 200 None 2026-04-08 03:06:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:06:33,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:06:33,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:06:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3233613dd9a95098955ea HTTP/1.1" 200 None 2026-04-08 03:06:33,416 - lava_callback - ERROR - Error processing callback for node 69d3233613dd9a95098955ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:08:33,493 - lava_callback - INFO - Received callback for node 69d323a813dd9a950989564d INFO: 172.20.0.1:32770 - "POST /node/69d323a813dd9a950989564d HTTP/1.0" 202 Accepted 2026-04-08 03:08:33,499 - lava_callback - INFO - Starting async job submit for node 69d323a813dd9a950989564d 2026-04-08 03:08:33,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:08:33,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d323a813dd9a950989564d HTTP/1.1" 200 None 2026-04-08 03:08:33,517 - lava_callback - DEBUG - Processing node 69d323a813dd9a950989564d: baseline-arm64-baylibre 2026-04-08 03:08:33,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d323a813dd9a950989564d 2026-04-08 03:08:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:08:33,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d323a813dd9a950989564d HTTP/1.1" 200 None 2026-04-08 03:08:33,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:08:33,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:08:33,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:08:33,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d323a813dd9a950989564d HTTP/1.1" 200 None 2026-04-08 03:08:33,590 - lava_callback - ERROR - Error processing callback for node 69d323a813dd9a950989564d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:11:33,685 - lava_callback - INFO - Received callback for node 69d3245d13dd9a950989567c INFO: 172.20.0.1:55888 - "POST /node/69d3245d13dd9a950989567c HTTP/1.0" 202 Accepted 2026-04-08 03:11:33,691 - lava_callback - INFO - Starting async job submit for node 69d3245d13dd9a950989567c 2026-04-08 03:11:33,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:11:33,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3245d13dd9a950989567c HTTP/1.1" 200 None 2026-04-08 03:11:33,716 - lava_callback - DEBUG - Processing node 69d3245d13dd9a950989567c: baseline-arm64-baylibre 2026-04-08 03:11:33,717 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3245d13dd9a950989567c 2026-04-08 03:11:33,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:11:33,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3245d13dd9a950989567c HTTP/1.1" 200 None 2026-04-08 03:11:33,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:11:33,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:11:33,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:11:33,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3245d13dd9a950989567c HTTP/1.1" 200 None 2026-04-08 03:11:33,775 - lava_callback - ERROR - Error processing callback for node 69d3245d13dd9a950989567c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:14:33,836 - lava_callback - INFO - Received callback for node 69d3251113dd9a95098956a5 INFO: 172.20.0.1:52156 - "POST /node/69d3251113dd9a95098956a5 HTTP/1.0" 202 Accepted 2026-04-08 03:14:33,841 - lava_callback - INFO - Starting async job submit for node 69d3251113dd9a95098956a5 2026-04-08 03:14:33,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:14:33,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3251113dd9a95098956a5 HTTP/1.1" 200 None 2026-04-08 03:14:33,861 - lava_callback - DEBUG - Processing node 69d3251113dd9a95098956a5: baseline-arm64-baylibre 2026-04-08 03:14:33,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3251113dd9a95098956a5 2026-04-08 03:14:33,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:14:33,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3251113dd9a95098956a5 HTTP/1.1" 200 None 2026-04-08 03:14:33,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:14:33,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:14:33,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:14:33,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3251113dd9a95098956a5 HTTP/1.1" 200 None 2026-04-08 03:14:33,923 - lava_callback - ERROR - Error processing callback for node 69d3251113dd9a95098956a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:16:33,986 - lava_callback - INFO - Received callback for node 69d3258a13dd9a95098956e3 INFO: 172.20.0.1:59610 - "POST /node/69d3258a13dd9a95098956e3 HTTP/1.0" 202 Accepted 2026-04-08 03:16:33,992 - lava_callback - INFO - Starting async job submit for node 69d3258a13dd9a95098956e3 2026-04-08 03:16:33,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:16:34,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3258a13dd9a95098956e3 HTTP/1.1" 200 None 2026-04-08 03:16:34,014 - lava_callback - DEBUG - Processing node 69d3258a13dd9a95098956e3: baseline-arm64-baylibre 2026-04-08 03:16:34,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3258a13dd9a95098956e3 2026-04-08 03:16:34,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:16:34,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3258a13dd9a95098956e3 HTTP/1.1" 200 None 2026-04-08 03:16:34,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:16:34,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:16:34,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:16:34,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3258a13dd9a95098956e3 HTTP/1.1" 200 None 2026-04-08 03:16:34,068 - lava_callback - ERROR - Error processing callback for node 69d3258a13dd9a95098956e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33132 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:18:36,349 - lava_callback - INFO - Received callback for node 69d3260613dd9a950989570e INFO: 172.20.0.1:33140 - "POST /node/69d3260613dd9a950989570e HTTP/1.0" 202 Accepted 2026-04-08 03:18:36,355 - lava_callback - INFO - Starting async job submit for node 69d3260613dd9a950989570e 2026-04-08 03:18:36,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:18:36,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3260613dd9a950989570e HTTP/1.1" 200 None 2026-04-08 03:18:36,370 - lava_callback - DEBUG - Processing node 69d3260613dd9a950989570e: baseline-arm64-clabbe 2026-04-08 03:18:36,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3260613dd9a950989570e 2026-04-08 03:18:36,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:18:36,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3260613dd9a950989570e HTTP/1.1" 200 None 2026-04-08 03:18:36,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:18:36,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:18:36,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:18:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3260613dd9a950989570e HTTP/1.1" 200 None 2026-04-08 03:18:36,427 - lava_callback - ERROR - Error processing callback for node 69d3260613dd9a950989570e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:19:56,357 - lava_callback - INFO - Received callback for node 69d3264f13dd9a950989574a INFO: 172.20.0.1:48938 - "POST /node/69d3264f13dd9a950989574a HTTP/1.0" 202 Accepted 2026-04-08 03:19:56,362 - lava_callback - INFO - Starting async job submit for node 69d3264f13dd9a950989574a 2026-04-08 03:19:56,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:19:56,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3264f13dd9a950989574a HTTP/1.1" 200 None 2026-04-08 03:19:56,381 - lava_callback - DEBUG - Processing node 69d3264f13dd9a950989574a: baseline-arm64-clabbe 2026-04-08 03:19:56,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3264f13dd9a950989574a 2026-04-08 03:19:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:19:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3264f13dd9a950989574a HTTP/1.1" 200 None 2026-04-08 03:19:56,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:19:56,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:19:56,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:19:56,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3264f13dd9a950989574a HTTP/1.1" 200 None 2026-04-08 03:19:56,437 - lava_callback - ERROR - Error processing callback for node 69d3264f13dd9a950989574a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40994 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:21:36,435 - lava_callback - INFO - Received callback for node 69d326bd13dd9a95098957ac INFO: 172.20.0.1:40996 - "POST /node/69d326bd13dd9a95098957ac HTTP/1.0" 202 Accepted 2026-04-08 03:21:36,444 - lava_callback - INFO - Starting async job submit for node 69d326bd13dd9a95098957ac 2026-04-08 03:21:36,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:36,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d326bd13dd9a95098957ac HTTP/1.1" 200 None 2026-04-08 03:21:36,460 - lava_callback - DEBUG - Processing node 69d326bd13dd9a95098957ac: baseline-arm64-clabbe 2026-04-08 03:21:36,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d326bd13dd9a95098957ac 2026-04-08 03:21:36,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:36,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d326bd13dd9a95098957ac HTTP/1.1" 200 None 2026-04-08 03:21:36,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:36,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:21:36,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:36,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d326bd13dd9a95098957ac HTTP/1.1" 200 None 2026-04-08 03:21:36,525 - lava_callback - ERROR - Error processing callback for node 69d326bd13dd9a95098957ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41010 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:21:42,084 - lava_callback - INFO - Received callback for node 69d5c50c34043de23ba15ada INFO: 172.20.0.1:56336 - "POST /node/69d5c50c34043de23ba15ada HTTP/1.0" 202 Accepted 2026-04-08 03:21:42,092 - lava_callback - INFO - Starting async job submit for node 69d5c50c34043de23ba15ada 2026-04-08 03:21:42,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:42,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c50c34043de23ba15ada HTTP/1.1" 200 None 2026-04-08 03:21:42,153 - lava_callback - DEBUG - Processing node 69d5c50c34043de23ba15ada: baseline-nfs-arm64 2026-04-08 03:21:43,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:21:43,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:21:43,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c50c34043de23ba15ada/log.txt.gz 2026-04-08 03:21:44,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:21:44,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:21:44,452 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c50c34043de23ba15ada/lava-logs.yaml 2026-04-08 03:21:44,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-08 03:21:44,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-08 03:21:44,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d5c50c34043de23ba15ada/lava_callback.json.gz DEBUG: Setup failed for 69d5c50c34043de23ba15ada. Transitting job node result: incomplete -> fail 2026-04-08 03:21:44,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d5c50c34043de23ba15ada HTTP/1.1" 200 None 2026-04-08 03:21:44,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:44,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-08 03:21:44,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:44,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d5c50c34043de23ba15ada HTTP/1.1" 200 None 2026-04-08 03:21:44,921 - lava_callback - INFO - Completed processing callback for node 69d5c50c34043de23ba15ada INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51924 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:21:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:21:56,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43754 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:23:36,523 - lava_callback - INFO - Received callback for node 69d3273513dd9a95098957cb INFO: 172.20.0.1:43770 - "POST /node/69d3273513dd9a95098957cb HTTP/1.0" 202 Accepted 2026-04-08 03:23:36,530 - lava_callback - INFO - Starting async job submit for node 69d3273513dd9a95098957cb 2026-04-08 03:23:36,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:23:36,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3273513dd9a95098957cb HTTP/1.1" 200 None 2026-04-08 03:23:36,552 - lava_callback - DEBUG - Processing node 69d3273513dd9a95098957cb: baseline-arm64-clabbe 2026-04-08 03:23:36,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3273513dd9a95098957cb 2026-04-08 03:23:36,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:23:36,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3273513dd9a95098957cb HTTP/1.1" 200 None 2026-04-08 03:23:36,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:23:36,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:23:36,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:23:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3273513dd9a95098957cb HTTP/1.1" 200 None 2026-04-08 03:23:36,642 - lava_callback - ERROR - Error processing callback for node 69d3273513dd9a95098957cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33598 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:24:56,611 - lava_callback - INFO - Received callback for node 69d3277813dd9a950989580e INFO: 172.20.0.1:33614 - "POST /node/69d3277813dd9a950989580e HTTP/1.0" 202 Accepted 2026-04-08 03:24:56,616 - lava_callback - INFO - Starting async job submit for node 69d3277813dd9a950989580e 2026-04-08 03:24:56,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:24:56,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3277813dd9a950989580e HTTP/1.1" 200 None 2026-04-08 03:24:56,633 - lava_callback - DEBUG - Processing node 69d3277813dd9a950989580e: baseline-arm64-clabbe 2026-04-08 03:24:56,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3277813dd9a950989580e 2026-04-08 03:24:56,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:24:56,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3277813dd9a950989580e HTTP/1.1" 200 None 2026-04-08 03:24:56,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:24:56,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:24:56,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:24:56,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3277813dd9a950989580e HTTP/1.1" 200 None 2026-04-08 03:24:56,689 - lava_callback - ERROR - Error processing callback for node 69d3277813dd9a950989580e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48722 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:27:36,687 - lava_callback - INFO - Received callback for node 69d3282413dd9a950989583b INFO: 172.20.0.1:48736 - "POST /node/69d3282413dd9a950989583b HTTP/1.0" 202 Accepted 2026-04-08 03:27:36,692 - lava_callback - INFO - Starting async job submit for node 69d3282413dd9a950989583b 2026-04-08 03:27:36,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:27:36,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3282413dd9a950989583b HTTP/1.1" 200 None 2026-04-08 03:27:36,709 - lava_callback - DEBUG - Processing node 69d3282413dd9a950989583b: baseline-arm64-clabbe 2026-04-08 03:27:36,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3282413dd9a950989583b 2026-04-08 03:27:36,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:27:36,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3282413dd9a950989583b HTTP/1.1" 200 None 2026-04-08 03:27:36,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:27:36,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:27:36,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:27:36,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3282413dd9a950989583b HTTP/1.1" 200 None 2026-04-08 03:27:36,773 - lava_callback - ERROR - Error processing callback for node 69d3282413dd9a950989583b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48778 - "GET / HTTP/1.0" 200 OK 2026-04-08 03:29:36,720 - lava_callback - INFO - Received callback for node 69d3289d13dd9a950989587a INFO: 172.20.0.1:48790 - "POST /node/69d3289d13dd9a950989587a HTTP/1.0" 202 Accepted 2026-04-08 03:29:36,725 - lava_callback - INFO - Starting async job submit for node 69d3289d13dd9a950989587a 2026-04-08 03:29:36,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:29:36,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3289d13dd9a950989587a HTTP/1.1" 200 None 2026-04-08 03:29:36,741 - lava_callback - DEBUG - Processing node 69d3289d13dd9a950989587a: baseline-arm64-clabbe 2026-04-08 03:29:36,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3289d13dd9a950989587a 2026-04-08 03:29:36,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:29:36,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3289d13dd9a950989587a HTTP/1.1" 200 None 2026-04-08 03:29:36,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:29:36,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-08 03:29:36,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 03:29:36,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3289d13dd9a950989587a HTTP/1.1" 200 None 2026-04-08 03:29:36,792 - lava_callback - ERROR - Error processing callback for node 69d3289d13dd9a950989587a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42212 - "GET /node/69927edd98a8bdb31c394f02%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56972 - "GET /node/6983ed3c969566dcb0d29aa0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56976 - "GET /node/6988c58c9fc35f969e1eeacd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET /node/698f84973013abef95d01a9c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48770 - "GET /node/691068368b15debe9dd4d512%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43176 - "GET /node/698e7f4adb401c547d5708ef%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43180 - "GET /node/693e1f6c407f32424eb57729%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET /node/693fb0160d8ce4018da9c0fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47094 - "GET /node/698a0efe22b4cc0f227ad8be%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49048 - "GET /node/69863492177ca0f097bd2a33%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49060 - "GET /node/698ead1cdb401c547d571e36%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39390 - "GET /node/69c80793123b47fd23770222%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39400 - "GET /node/6985ea5871989fb14149cb8b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET /node/698a9b49d9a1cfa777a24e88%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET /node/698bda541e517752bab8b902%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55022 - "GET /node/693e1390407f32424eb56948%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET /node/6990a624c45febfe445208de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET /node/69402420575bc060ce153c6b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET /node/698af4943b3beb19e7616a57%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47138 - "GET /node/6980d4771ab488c16c858f7e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47140 - "GET /node/69876c8de31b58f834f1998a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59262 - "GET /node/69113f60f15111fc8ce479de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59276 - "GET /node/6990b665c45febfe44523615%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37220 - "GET /node/69487cfd9214b4938716964a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59226 - "GET /node/69934ed2523507f3806a63dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET /node/69278df397dccbdf516a6a02%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38200 - "GET /node/693ae817fee8383e92b6564a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38538 - "GET /node/693af58dfee8383e92b6b422%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38540 - "GET /node/699185d910b45da7d7d0fca2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET /node/69876b97e31b58f834f1982b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42850 - "GET /node/6985de8b71989fb14149b654%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET /node/69547c8e6972f3788844d591%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET /node/6985f45c71989fb14149d780%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET /node/691131b2f15111fc8ce46588%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42874 - "GET /node/699743468babaef657676ce5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38404 - "GET /node/6910b9268b15debe9dd54078%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38414 - "GET /node/6919fe45eaa94778a74d4740%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32880 - "GET /node/69400960575bc060ce150568%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32882 - "GET /node/698e6ea7db401c547d56f607%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:44:45,366 - lava_callback - INFO - Received callback for node 69d3565413dd9a9509895978 INFO: 172.20.0.1:42502 - "POST /node/69d3565413dd9a9509895978 HTTP/1.0" 202 Accepted 2026-04-08 06:44:45,372 - lava_callback - INFO - Starting async job submit for node 69d3565413dd9a9509895978 2026-04-08 06:44:45,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:44:45,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3565413dd9a9509895978 HTTP/1.1" 200 None 2026-04-08 06:44:45,390 - lava_callback - DEBUG - Processing node 69d3565413dd9a9509895978: baseline-arm-baylibre 2026-04-08 06:44:45,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3565413dd9a9509895978 2026-04-08 06:44:45,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:44:45,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3565413dd9a9509895978 HTTP/1.1" 200 None 2026-04-08 06:44:45,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:44:45,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:44:45,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:44:45,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3565413dd9a9509895978 HTTP/1.1" 200 None 2026-04-08 06:44:45,441 - lava_callback - ERROR - Error processing callback for node 69d3565413dd9a9509895978: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:45:25,337 - lava_callback - INFO - Received callback for node 69d3567413dd9a95098959aa INFO: 172.20.0.1:34448 - "POST /node/69d3567413dd9a95098959aa HTTP/1.0" 202 Accepted 2026-04-08 06:45:25,343 - lava_callback - INFO - Starting async job submit for node 69d3567413dd9a95098959aa 2026-04-08 06:45:25,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:45:25,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3567413dd9a95098959aa HTTP/1.1" 200 None 2026-04-08 06:45:25,358 - lava_callback - DEBUG - Processing node 69d3567413dd9a95098959aa: baseline-arm-baylibre 2026-04-08 06:45:25,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3567413dd9a95098959aa 2026-04-08 06:45:25,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:45:25,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3567413dd9a95098959aa HTTP/1.1" 200 None 2026-04-08 06:45:25,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:45:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:45:25,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:45:25,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3567413dd9a95098959aa HTTP/1.1" 200 None 2026-04-08 06:45:25,417 - lava_callback - ERROR - Error processing callback for node 69d3567413dd9a95098959aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37126 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:46:25,376 - lava_callback - INFO - Received callback for node 69d356b313dd9a95098959f8 INFO: 172.20.0.1:59088 - "POST /node/69d356b313dd9a95098959f8 HTTP/1.0" 202 Accepted 2026-04-08 06:46:25,381 - lava_callback - INFO - Starting async job submit for node 69d356b313dd9a95098959f8 2026-04-08 06:46:25,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:46:25,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356b313dd9a95098959f8 HTTP/1.1" 200 None 2026-04-08 06:46:25,398 - lava_callback - DEBUG - Processing node 69d356b313dd9a95098959f8: baseline-arm-baylibre 2026-04-08 06:46:25,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d356b313dd9a95098959f8 2026-04-08 06:46:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:46:25,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356b313dd9a95098959f8 HTTP/1.1" 200 None 2026-04-08 06:46:25,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:46:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:46:25,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:46:25,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d356b313dd9a95098959f8 HTTP/1.1" 200 None 2026-04-08 06:46:25,450 - lava_callback - ERROR - Error processing callback for node 69d356b313dd9a95098959f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47148 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:47:05,419 - lava_callback - INFO - Received callback for node 69d356d713dd9a9509895a05 INFO: 172.20.0.1:53108 - "POST /node/69d356d713dd9a9509895a05 HTTP/1.0" 202 Accepted 2026-04-08 06:47:05,425 - lava_callback - INFO - Starting async job submit for node 69d356d713dd9a9509895a05 2026-04-08 06:47:05,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:05,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356d713dd9a9509895a05 HTTP/1.1" 200 None 2026-04-08 06:47:05,446 - lava_callback - DEBUG - Processing node 69d356d713dd9a9509895a05: baseline-arm-baylibre 2026-04-08 06:47:05,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d356d713dd9a9509895a05 2026-04-08 06:47:05,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:05,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356d713dd9a9509895a05 HTTP/1.1" 200 None 2026-04-08 06:47:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:05,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:47:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:05,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d356d713dd9a9509895a05 HTTP/1.1" 200 None 2026-04-08 06:47:05,503 - lava_callback - ERROR - Error processing callback for node 69d356d713dd9a9509895a05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41840 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:47:25,445 - lava_callback - INFO - Received callback for node 69d356f813dd9a9509895a19 INFO: 172.20.0.1:34144 - "POST /node/69d356f813dd9a9509895a19 HTTP/1.0" 202 Accepted 2026-04-08 06:47:25,451 - lava_callback - INFO - Starting async job submit for node 69d356f813dd9a9509895a19 2026-04-08 06:47:25,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:25,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356f813dd9a9509895a19 HTTP/1.1" 200 None 2026-04-08 06:47:25,467 - lava_callback - DEBUG - Processing node 69d356f813dd9a9509895a19: baseline-arm-baylibre 2026-04-08 06:47:25,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d356f813dd9a9509895a19 2026-04-08 06:47:25,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:25,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d356f813dd9a9509895a19 HTTP/1.1" 200 None 2026-04-08 06:47:25,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:25,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:47:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:47:25,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d356f813dd9a9509895a19 HTTP/1.1" 200 None 2026-04-08 06:47:25,533 - lava_callback - ERROR - Error processing callback for node 69d356f813dd9a9509895a19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:49:05,509 - lava_callback - INFO - Received callback for node 69d3575e13dd9a9509895a79 INFO: 172.20.0.1:45622 - "POST /node/69d3575e13dd9a9509895a79 HTTP/1.0" 202 Accepted 2026-04-08 06:49:05,514 - lava_callback - INFO - Starting async job submit for node 69d3575e13dd9a9509895a79 2026-04-08 06:49:05,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:05,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3575e13dd9a9509895a79 HTTP/1.1" 200 None 2026-04-08 06:49:05,531 - lava_callback - DEBUG - Processing node 69d3575e13dd9a9509895a79: baseline-arm-clabbe 2026-04-08 06:49:05,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3575e13dd9a9509895a79 2026-04-08 06:49:05,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:05,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3575e13dd9a9509895a79 HTTP/1.1" 200 None 2026-04-08 06:49:05,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:05,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:49:05,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:05,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3575e13dd9a9509895a79 HTTP/1.1" 200 None 2026-04-08 06:49:05,600 - lava_callback - ERROR - Error processing callback for node 69d3575e13dd9a9509895a79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42472 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:49:45,464 - lava_callback - INFO - Received callback for node 69d3578213dd9a9509895a8f INFO: 172.20.0.1:52998 - "POST /node/69d3578213dd9a9509895a8f HTTP/1.0" 202 Accepted 2026-04-08 06:49:45,469 - lava_callback - INFO - Starting async job submit for node 69d3578213dd9a9509895a8f 2026-04-08 06:49:45,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:45,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3578213dd9a9509895a8f HTTP/1.1" 200 None 2026-04-08 06:49:45,485 - lava_callback - DEBUG - Processing node 69d3578213dd9a9509895a8f: baseline-arm-clabbe 2026-04-08 06:49:45,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3578213dd9a9509895a8f 2026-04-08 06:49:45,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:45,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3578213dd9a9509895a8f HTTP/1.1" 200 None 2026-04-08 06:49:45,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:45,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:49:45,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:49:45,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3578213dd9a9509895a8f HTTP/1.1" 200 None 2026-04-08 06:49:45,541 - lava_callback - ERROR - Error processing callback for node 69d3578213dd9a9509895a8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:50:25,522 - lava_callback - INFO - Received callback for node 69d357a013dd9a9509895abc INFO: 172.20.0.1:39628 - "POST /node/69d357a013dd9a9509895abc HTTP/1.0" 202 Accepted 2026-04-08 06:50:25,527 - lava_callback - INFO - Starting async job submit for node 69d357a013dd9a9509895abc 2026-04-08 06:50:25,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:25,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357a013dd9a9509895abc HTTP/1.1" 200 None 2026-04-08 06:50:25,543 - lava_callback - DEBUG - Processing node 69d357a013dd9a9509895abc: baseline-arm-clabbe 2026-04-08 06:50:25,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d357a013dd9a9509895abc 2026-04-08 06:50:25,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:25,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357a013dd9a9509895abc HTTP/1.1" 200 None 2026-04-08 06:50:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:25,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:50:25,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:25,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d357a013dd9a9509895abc HTTP/1.1" 200 None 2026-04-08 06:50:25,615 - lava_callback - ERROR - Error processing callback for node 69d357a013dd9a9509895abc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51330 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:50:45,485 - lava_callback - INFO - Received callback for node 69d357bd13dd9a9509895af6 INFO: 172.20.0.1:47284 - "POST /node/69d357bd13dd9a9509895af6 HTTP/1.0" 202 Accepted 2026-04-08 06:50:45,491 - lava_callback - INFO - Starting async job submit for node 69d357bd13dd9a9509895af6 2026-04-08 06:50:45,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:45,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357bd13dd9a9509895af6 HTTP/1.1" 200 None 2026-04-08 06:50:45,507 - lava_callback - DEBUG - Processing node 69d357bd13dd9a9509895af6: baseline-arm-clabbe 2026-04-08 06:50:45,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d357bd13dd9a9509895af6 2026-04-08 06:50:45,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:45,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357bd13dd9a9509895af6 HTTP/1.1" 200 None 2026-04-08 06:50:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:45,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:50:45,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:50:45,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d357bd13dd9a9509895af6 HTTP/1.1" 200 None 2026-04-08 06:50:45,573 - lava_callback - ERROR - Error processing callback for node 69d357bd13dd9a9509895af6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51546 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:51:25,614 - lava_callback - INFO - Received callback for node 69d357df13dd9a9509895b14 INFO: 172.20.0.1:52496 - "POST /node/69d357df13dd9a9509895b14 HTTP/1.0" 202 Accepted 2026-04-08 06:51:25,620 - lava_callback - INFO - Starting async job submit for node 69d357df13dd9a9509895b14 2026-04-08 06:51:25,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:51:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357df13dd9a9509895b14 HTTP/1.1" 200 None 2026-04-08 06:51:25,636 - lava_callback - DEBUG - Processing node 69d357df13dd9a9509895b14: baseline-arm-clabbe 2026-04-08 06:51:25,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d357df13dd9a9509895b14 2026-04-08 06:51:25,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:51:25,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d357df13dd9a9509895b14 HTTP/1.1" 200 None 2026-04-08 06:51:25,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:51:25,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:51:25,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:51:25,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d357df13dd9a9509895b14 HTTP/1.1" 200 None 2026-04-08 06:51:25,692 - lava_callback - ERROR - Error processing callback for node 69d357df13dd9a9509895b14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:52:05,560 - lava_callback - INFO - Received callback for node 69d3580413dd9a9509895b1f INFO: 172.20.0.1:49282 - "POST /node/69d3580413dd9a9509895b1f HTTP/1.0" 202 Accepted 2026-04-08 06:52:05,566 - lava_callback - INFO - Starting async job submit for node 69d3580413dd9a9509895b1f 2026-04-08 06:52:05,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:05,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3580413dd9a9509895b1f HTTP/1.1" 200 None 2026-04-08 06:52:05,590 - lava_callback - DEBUG - Processing node 69d3580413dd9a9509895b1f: baseline-arm-clabbe 2026-04-08 06:52:05,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3580413dd9a9509895b1f 2026-04-08 06:52:05,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:05,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3580413dd9a9509895b1f HTTP/1.1" 200 None 2026-04-08 06:52:05,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:05,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:52:05,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3580413dd9a9509895b1f HTTP/1.1" 200 None 2026-04-08 06:52:05,648 - lava_callback - ERROR - Error processing callback for node 69d3580413dd9a9509895b1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:52:25,651 - lava_callback - INFO - Received callback for node 69d3582313dd9a9509895b39 INFO: 172.20.0.1:51412 - "POST /node/69d3582313dd9a9509895b39 HTTP/1.0" 202 Accepted 2026-04-08 06:52:25,657 - lava_callback - INFO - Starting async job submit for node 69d3582313dd9a9509895b39 2026-04-08 06:52:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:25,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3582313dd9a9509895b39 HTTP/1.1" 200 None 2026-04-08 06:52:25,673 - lava_callback - DEBUG - Processing node 69d3582313dd9a9509895b39: baseline-arm-clabbe 2026-04-08 06:52:25,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3582313dd9a9509895b39 2026-04-08 06:52:25,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:25,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3582313dd9a9509895b39 HTTP/1.1" 200 None 2026-04-08 06:52:25,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:25,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:52:25,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:52:25,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3582313dd9a9509895b39 HTTP/1.1" 200 None 2026-04-08 06:52:25,736 - lava_callback - ERROR - Error processing callback for node 69d3582313dd9a9509895b39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:53:05,591 - lava_callback - INFO - Received callback for node 69d3584513dd9a9509895b5f INFO: 172.20.0.1:46532 - "POST /node/69d3584513dd9a9509895b5f HTTP/1.0" 202 Accepted 2026-04-08 06:53:05,597 - lava_callback - INFO - Starting async job submit for node 69d3584513dd9a9509895b5f 2026-04-08 06:53:05,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:05,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3584513dd9a9509895b5f HTTP/1.1" 200 None 2026-04-08 06:53:05,613 - lava_callback - DEBUG - Processing node 69d3584513dd9a9509895b5f: baseline-arm-clabbe 2026-04-08 06:53:05,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3584513dd9a9509895b5f 2026-04-08 06:53:05,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:05,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3584513dd9a9509895b5f HTTP/1.1" 200 None 2026-04-08 06:53:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:05,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:53:05,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:05,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3584513dd9a9509895b5f HTTP/1.1" 200 None 2026-04-08 06:53:05,669 - lava_callback - ERROR - Error processing callback for node 69d3584513dd9a9509895b5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:53:45,691 - lava_callback - INFO - Received callback for node 69d3586913dd9a9509895b83 INFO: 172.20.0.1:42702 - "POST /node/69d3586913dd9a9509895b83 HTTP/1.0" 202 Accepted 2026-04-08 06:53:45,697 - lava_callback - INFO - Starting async job submit for node 69d3586913dd9a9509895b83 2026-04-08 06:53:45,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:45,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3586913dd9a9509895b83 HTTP/1.1" 200 None 2026-04-08 06:53:45,721 - lava_callback - DEBUG - Processing node 69d3586913dd9a9509895b83: baseline-arm-clabbe 2026-04-08 06:53:45,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3586913dd9a9509895b83 2026-04-08 06:53:45,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:45,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3586913dd9a9509895b83 HTTP/1.1" 200 None 2026-04-08 06:53:45,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:45,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fb9e13dd9a95098934c9 HTTP/1.1" 200 None 2026-04-08 06:53:45,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:53:45,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3586913dd9a9509895b83 HTTP/1.1" 200 None 2026-04-08 06:53:45,773 - lava_callback - ERROR - Error processing callback for node 69d3586913dd9a9509895b83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36358 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:54:05,814 - lava_callback - INFO - Received callback for node 69d3588813dd9a9509895bb8 INFO: 172.20.0.1:39068 - "POST /node/69d3588813dd9a9509895bb8 HTTP/1.0" 202 Accepted 2026-04-08 06:54:05,820 - lava_callback - INFO - Starting async job submit for node 69d3588813dd9a9509895bb8 2026-04-08 06:54:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:54:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3588813dd9a9509895bb8 HTTP/1.1" 200 None 2026-04-08 06:54:05,836 - lava_callback - DEBUG - Processing node 69d3588813dd9a9509895bb8: baseline-arm-baylibre 2026-04-08 06:54:05,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3588813dd9a9509895bb8 2026-04-08 06:54:05,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:54:05,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3588813dd9a9509895bb8 HTTP/1.1" 200 None 2026-04-08 06:54:05,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:54:05,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:54:05,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:54:05,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3588813dd9a9509895bb8 HTTP/1.1" 200 None 2026-04-08 06:54:05,906 - lava_callback - ERROR - Error processing callback for node 69d3588813dd9a9509895bb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:55:45,939 - lava_callback - INFO - Received callback for node 69d358ed13dd9a9509895bf4 INFO: 172.20.0.1:56360 - "POST /node/69d358ed13dd9a9509895bf4 HTTP/1.0" 202 Accepted 2026-04-08 06:55:45,944 - lava_callback - INFO - Starting async job submit for node 69d358ed13dd9a9509895bf4 2026-04-08 06:55:45,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:55:45,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d358ed13dd9a9509895bf4 HTTP/1.1" 200 None 2026-04-08 06:55:45,961 - lava_callback - DEBUG - Processing node 69d358ed13dd9a9509895bf4: baseline-arm-baylibre 2026-04-08 06:55:45,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d358ed13dd9a9509895bf4 2026-04-08 06:55:45,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:55:45,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d358ed13dd9a9509895bf4 HTTP/1.1" 200 None 2026-04-08 06:55:45,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:55:45,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:55:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:55:46,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d358ed13dd9a9509895bf4 HTTP/1.1" 200 None 2026-04-08 06:55:46,019 - lava_callback - ERROR - Error processing callback for node 69d358ed13dd9a9509895bf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:56:25,903 - lava_callback - INFO - Received callback for node 69d3591013dd9a9509895c09 INFO: 172.20.0.1:51506 - "POST /node/69d3591013dd9a9509895c09 HTTP/1.0" 202 Accepted 2026-04-08 06:56:25,908 - lava_callback - INFO - Starting async job submit for node 69d3591013dd9a9509895c09 2026-04-08 06:56:25,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:56:25,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3591013dd9a9509895c09 HTTP/1.1" 200 None 2026-04-08 06:56:25,924 - lava_callback - DEBUG - Processing node 69d3591013dd9a9509895c09: baseline-arm-baylibre 2026-04-08 06:56:25,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3591013dd9a9509895c09 2026-04-08 06:56:25,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:56:25,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3591013dd9a9509895c09 HTTP/1.1" 200 None 2026-04-08 06:56:25,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:56:25,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:56:25,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:56:25,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3591013dd9a9509895c09 HTTP/1.1" 200 None 2026-04-08 06:56:25,998 - lava_callback - ERROR - Error processing callback for node 69d3591013dd9a9509895c09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38842 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:57:06,035 - lava_callback - INFO - Received callback for node 69d3592f13dd9a9509895c2f INFO: 172.20.0.1:53970 - "POST /node/69d3592f13dd9a9509895c2f HTTP/1.0" 202 Accepted 2026-04-08 06:57:06,041 - lava_callback - INFO - Starting async job submit for node 69d3592f13dd9a9509895c2f 2026-04-08 06:57:06,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:06,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3592f13dd9a9509895c2f HTTP/1.1" 200 None 2026-04-08 06:57:06,057 - lava_callback - DEBUG - Processing node 69d3592f13dd9a9509895c2f: baseline-arm-baylibre 2026-04-08 06:57:06,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3592f13dd9a9509895c2f 2026-04-08 06:57:06,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:06,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3592f13dd9a9509895c2f HTTP/1.1" 200 None 2026-04-08 06:57:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:06,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:57:06,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:06,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3592f13dd9a9509895c2f HTTP/1.1" 200 None 2026-04-08 06:57:06,123 - lava_callback - ERROR - Error processing callback for node 69d3592f13dd9a9509895c2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:57:25,949 - lava_callback - INFO - Received callback for node 69d3594813dd9a9509895c60 INFO: 172.20.0.1:49732 - "POST /node/69d3594813dd9a9509895c60 HTTP/1.0" 202 Accepted 2026-04-08 06:57:25,954 - lava_callback - INFO - Starting async job submit for node 69d3594813dd9a9509895c60 2026-04-08 06:57:25,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:25,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3594813dd9a9509895c60 HTTP/1.1" 200 None 2026-04-08 06:57:25,972 - lava_callback - DEBUG - Processing node 69d3594813dd9a9509895c60: baseline-arm-baylibre 2026-04-08 06:57:25,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3594813dd9a9509895c60 2026-04-08 06:57:25,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:25,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3594813dd9a9509895c60 HTTP/1.1" 200 None 2026-04-08 06:57:25,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:57:26,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:57:26,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3594813dd9a9509895c60 HTTP/1.1" 200 None 2026-04-08 06:57:26,025 - lava_callback - ERROR - Error processing callback for node 69d3594813dd9a9509895c60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:58:05,999 - lava_callback - INFO - Received callback for node 69d3597013dd9a9509895c77 INFO: 172.20.0.1:59196 - "POST /node/69d3597013dd9a9509895c77 HTTP/1.0" 202 Accepted 2026-04-08 06:58:06,005 - lava_callback - INFO - Starting async job submit for node 69d3597013dd9a9509895c77 2026-04-08 06:58:06,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:06,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3597013dd9a9509895c77 HTTP/1.1" 200 None 2026-04-08 06:58:06,031 - lava_callback - DEBUG - Processing node 69d3597013dd9a9509895c77: baseline-arm-baylibre 2026-04-08 06:58:06,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3597013dd9a9509895c77 2026-04-08 06:58:06,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:06,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3597013dd9a9509895c77 HTTP/1.1" 200 None 2026-04-08 06:58:06,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:06,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:58:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:06,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3597013dd9a9509895c77 HTTP/1.1" 200 None 2026-04-08 06:58:06,108 - lava_callback - ERROR - Error processing callback for node 69d3597013dd9a9509895c77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:58:46,074 - lava_callback - INFO - Received callback for node 69d3599213dd9a9509895c83 INFO: 172.20.0.1:48490 - "POST /node/69d3599213dd9a9509895c83 HTTP/1.0" 202 Accepted 2026-04-08 06:58:46,082 - lava_callback - INFO - Starting async job submit for node 69d3599213dd9a9509895c83 2026-04-08 06:58:46,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:46,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3599213dd9a9509895c83 HTTP/1.1" 200 None 2026-04-08 06:58:46,098 - lava_callback - DEBUG - Processing node 69d3599213dd9a9509895c83: baseline-arm-baylibre 2026-04-08 06:58:46,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3599213dd9a9509895c83 2026-04-08 06:58:46,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:46,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3599213dd9a9509895c83 HTTP/1.1" 200 None 2026-04-08 06:58:46,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:46,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:58:46,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:58:46,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3599213dd9a9509895c83 HTTP/1.1" 200 None 2026-04-08 06:58:46,184 - lava_callback - ERROR - Error processing callback for node 69d3599213dd9a9509895c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42636 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:59:06,054 - lava_callback - INFO - Received callback for node 69d359b013dd9a9509895ca2 INFO: 172.20.0.1:48666 - "POST /node/69d359b013dd9a9509895ca2 HTTP/1.0" 202 Accepted 2026-04-08 06:59:06,060 - lava_callback - INFO - Starting async job submit for node 69d359b013dd9a9509895ca2 2026-04-08 06:59:06,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:06,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359b013dd9a9509895ca2 HTTP/1.1" 200 None 2026-04-08 06:59:06,075 - lava_callback - DEBUG - Processing node 69d359b013dd9a9509895ca2: baseline-arm-baylibre 2026-04-08 06:59:06,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d359b013dd9a9509895ca2 2026-04-08 06:59:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:06,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359b013dd9a9509895ca2 HTTP/1.1" 200 None 2026-04-08 06:59:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:59:06,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:06,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d359b013dd9a9509895ca2 HTTP/1.1" 200 None 2026-04-08 06:59:06,131 - lava_callback - ERROR - Error processing callback for node 69d359b013dd9a9509895ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK 2026-04-08 06:59:46,155 - lava_callback - INFO - Received callback for node 69d359d413dd9a9509895cbe INFO: 172.20.0.1:55020 - "POST /node/69d359d413dd9a9509895cbe HTTP/1.0" 202 Accepted 2026-04-08 06:59:46,160 - lava_callback - INFO - Starting async job submit for node 69d359d413dd9a9509895cbe 2026-04-08 06:59:46,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:46,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359d413dd9a9509895cbe HTTP/1.1" 200 None 2026-04-08 06:59:46,178 - lava_callback - DEBUG - Processing node 69d359d413dd9a9509895cbe: baseline-arm-baylibre 2026-04-08 06:59:46,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d359d413dd9a9509895cbe 2026-04-08 06:59:46,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:46,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359d413dd9a9509895cbe HTTP/1.1" 200 None 2026-04-08 06:59:46,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:46,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 06:59:46,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 06:59:46,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d359d413dd9a9509895cbe HTTP/1.1" 200 None 2026-04-08 06:59:46,229 - lava_callback - ERROR - Error processing callback for node 69d359d413dd9a9509895cbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:00:26,154 - lava_callback - INFO - Received callback for node 69d359f813dd9a9509895ccf INFO: 172.20.0.1:43836 - "POST /node/69d359f813dd9a9509895ccf HTTP/1.0" 202 Accepted 2026-04-08 07:00:26,160 - lava_callback - INFO - Starting async job submit for node 69d359f813dd9a9509895ccf 2026-04-08 07:00:26,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:26,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359f813dd9a9509895ccf HTTP/1.1" 200 None 2026-04-08 07:00:26,179 - lava_callback - DEBUG - Processing node 69d359f813dd9a9509895ccf: baseline-arm-baylibre 2026-04-08 07:00:26,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d359f813dd9a9509895ccf 2026-04-08 07:00:26,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:26,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d359f813dd9a9509895ccf HTTP/1.1" 200 None 2026-04-08 07:00:26,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:26,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:00:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:26,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d359f813dd9a9509895ccf HTTP/1.1" 200 None 2026-04-08 07:00:26,239 - lava_callback - ERROR - Error processing callback for node 69d359f813dd9a9509895ccf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:00:46,121 - lava_callback - INFO - Received callback for node 69d35a1813dd9a9509895cfc INFO: 172.20.0.1:50572 - "POST /node/69d35a1813dd9a9509895cfc HTTP/1.0" 202 Accepted 2026-04-08 07:00:46,127 - lava_callback - INFO - Starting async job submit for node 69d35a1813dd9a9509895cfc 2026-04-08 07:00:46,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a1813dd9a9509895cfc HTTP/1.1" 200 None 2026-04-08 07:00:46,143 - lava_callback - DEBUG - Processing node 69d35a1813dd9a9509895cfc: baseline-arm-baylibre 2026-04-08 07:00:46,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35a1813dd9a9509895cfc 2026-04-08 07:00:46,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:46,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a1813dd9a9509895cfc HTTP/1.1" 200 None 2026-04-08 07:00:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:46,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:00:46,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:00:46,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35a1813dd9a9509895cfc HTTP/1.1" 200 None 2026-04-08 07:00:46,199 - lava_callback - ERROR - Error processing callback for node 69d35a1813dd9a9509895cfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:01:26,046 - lava_callback - INFO - Received callback for node 69d35a3613dd9a9509895d2d INFO: 172.20.0.1:60026 - "POST /node/69d35a3613dd9a9509895d2d HTTP/1.0" 202 Accepted 2026-04-08 07:01:26,052 - lava_callback - INFO - Starting async job submit for node 69d35a3613dd9a9509895d2d 2026-04-08 07:01:26,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:26,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a3613dd9a9509895d2d HTTP/1.1" 200 None 2026-04-08 07:01:26,068 - lava_callback - DEBUG - Processing node 69d35a3613dd9a9509895d2d: baseline-arm-clabbe 2026-04-08 07:01:26,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35a3613dd9a9509895d2d 2026-04-08 07:01:26,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:26,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a3613dd9a9509895d2d HTTP/1.1" 200 None 2026-04-08 07:01:26,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:26,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:01:26,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:26,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35a3613dd9a9509895d2d HTTP/1.1" 200 None 2026-04-08 07:01:26,126 - lava_callback - ERROR - Error processing callback for node 69d35a3613dd9a9509895d2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:01:46,259 - lava_callback - INFO - Received callback for node 69d35a5113dd9a9509895d68 INFO: 172.20.0.1:33960 - "POST /node/69d35a5113dd9a9509895d68 HTTP/1.0" 202 Accepted 2026-04-08 07:01:46,265 - lava_callback - INFO - Starting async job submit for node 69d35a5113dd9a9509895d68 2026-04-08 07:01:46,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:46,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a5113dd9a9509895d68 HTTP/1.1" 200 None 2026-04-08 07:01:46,281 - lava_callback - DEBUG - Processing node 69d35a5113dd9a9509895d68: baseline-arm-baylibre 2026-04-08 07:01:46,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35a5113dd9a9509895d68 2026-04-08 07:01:46,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:46,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a5113dd9a9509895d68 HTTP/1.1" 200 None 2026-04-08 07:01:46,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:46,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:01:46,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:01:46,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35a5113dd9a9509895d68 HTTP/1.1" 200 None 2026-04-08 07:01:46,340 - lava_callback - ERROR - Error processing callback for node 69d35a5113dd9a9509895d68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:02:26,031 - lava_callback - INFO - Received callback for node 69d35a7613dd9a9509895d78 INFO: 172.20.0.1:41116 - "POST /node/69d35a7613dd9a9509895d78 HTTP/1.0" 202 Accepted 2026-04-08 07:02:26,037 - lava_callback - INFO - Starting async job submit for node 69d35a7613dd9a9509895d78 2026-04-08 07:02:26,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:02:26,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a7613dd9a9509895d78 HTTP/1.1" 200 None 2026-04-08 07:02:26,054 - lava_callback - DEBUG - Processing node 69d35a7613dd9a9509895d78: baseline-arm-clabbe 2026-04-08 07:02:26,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35a7613dd9a9509895d78 2026-04-08 07:02:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:02:26,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a7613dd9a9509895d78 HTTP/1.1" 200 None 2026-04-08 07:02:26,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:02:26,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:02:26,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:02:26,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35a7613dd9a9509895d78 HTTP/1.1" 200 None 2026-04-08 07:02:26,112 - lava_callback - ERROR - Error processing callback for node 69d35a7613dd9a9509895d78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:03:06,047 - lava_callback - INFO - Received callback for node 69d35a9713dd9a9509895d99 INFO: 172.20.0.1:54358 - "POST /node/69d35a9713dd9a9509895d99 HTTP/1.0" 202 Accepted 2026-04-08 07:03:06,053 - lava_callback - INFO - Starting async job submit for node 69d35a9713dd9a9509895d99 2026-04-08 07:03:06,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:06,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a9713dd9a9509895d99 HTTP/1.1" 200 None 2026-04-08 07:03:06,069 - lava_callback - DEBUG - Processing node 69d35a9713dd9a9509895d99: baseline-arm-clabbe 2026-04-08 07:03:06,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35a9713dd9a9509895d99 2026-04-08 07:03:06,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:06,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35a9713dd9a9509895d99 HTTP/1.1" 200 None 2026-04-08 07:03:06,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:06,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:03:06,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:06,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35a9713dd9a9509895d99 HTTP/1.1" 200 None 2026-04-08 07:03:06,130 - lava_callback - ERROR - Error processing callback for node 69d35a9713dd9a9509895d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:03:26,046 - lava_callback - INFO - Received callback for node 69d35aba13dd9a9509895da7 INFO: 172.20.0.1:50564 - "POST /node/69d35aba13dd9a9509895da7 HTTP/1.0" 202 Accepted 2026-04-08 07:03:26,052 - lava_callback - INFO - Starting async job submit for node 69d35aba13dd9a9509895da7 2026-04-08 07:03:26,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:26,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35aba13dd9a9509895da7 HTTP/1.1" 200 None 2026-04-08 07:03:26,071 - lava_callback - DEBUG - Processing node 69d35aba13dd9a9509895da7: baseline-arm-clabbe 2026-04-08 07:03:26,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35aba13dd9a9509895da7 2026-04-08 07:03:26,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:26,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35aba13dd9a9509895da7 HTTP/1.1" 200 None 2026-04-08 07:03:26,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:26,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:03:26,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:03:26,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35aba13dd9a9509895da7 HTTP/1.1" 200 None 2026-04-08 07:03:26,135 - lava_callback - ERROR - Error processing callback for node 69d35aba13dd9a9509895da7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:04:06,096 - lava_callback - INFO - Received callback for node 69d35add13dd9a9509895dbc INFO: 172.20.0.1:45686 - "POST /node/69d35add13dd9a9509895dbc HTTP/1.0" 202 Accepted 2026-04-08 07:04:06,101 - lava_callback - INFO - Starting async job submit for node 69d35add13dd9a9509895dbc 2026-04-08 07:04:06,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:06,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35add13dd9a9509895dbc HTTP/1.1" 200 None 2026-04-08 07:04:06,119 - lava_callback - DEBUG - Processing node 69d35add13dd9a9509895dbc: baseline-arm-clabbe 2026-04-08 07:04:06,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35add13dd9a9509895dbc 2026-04-08 07:04:06,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:06,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35add13dd9a9509895dbc HTTP/1.1" 200 None 2026-04-08 07:04:06,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:06,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:04:06,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:06,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35add13dd9a9509895dbc HTTP/1.1" 200 None 2026-04-08 07:04:06,188 - lava_callback - ERROR - Error processing callback for node 69d35add13dd9a9509895dbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37470 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:04:46,113 - lava_callback - INFO - Received callback for node 69d35b0013dd9a9509895dd1 INFO: 172.20.0.1:39354 - "POST /node/69d35b0013dd9a9509895dd1 HTTP/1.0" 202 Accepted 2026-04-08 07:04:46,119 - lava_callback - INFO - Starting async job submit for node 69d35b0013dd9a9509895dd1 2026-04-08 07:04:46,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:46,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35b0013dd9a9509895dd1 HTTP/1.1" 200 None 2026-04-08 07:04:46,134 - lava_callback - DEBUG - Processing node 69d35b0013dd9a9509895dd1: baseline-arm-clabbe 2026-04-08 07:04:46,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35b0013dd9a9509895dd1 2026-04-08 07:04:46,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:46,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35b0013dd9a9509895dd1 HTTP/1.1" 200 None 2026-04-08 07:04:46,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:46,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:04:46,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:04:46,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35b0013dd9a9509895dd1 HTTP/1.1" 200 None 2026-04-08 07:04:46,198 - lava_callback - ERROR - Error processing callback for node 69d35b0013dd9a9509895dd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47950 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:09:46,326 - lava_callback - INFO - Received callback for node 69d35c2913dd9a9509895ee0 INFO: 172.20.0.1:36860 - "POST /node/69d35c2913dd9a9509895ee0 HTTP/1.0" 202 Accepted 2026-04-08 07:09:46,331 - lava_callback - INFO - Starting async job submit for node 69d35c2913dd9a9509895ee0 2026-04-08 07:09:46,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:09:46,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c2913dd9a9509895ee0 HTTP/1.1" 200 None 2026-04-08 07:09:46,361 - lava_callback - DEBUG - Processing node 69d35c2913dd9a9509895ee0: baseline-arm-clabbe 2026-04-08 07:09:46,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35c2913dd9a9509895ee0 2026-04-08 07:09:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:09:46,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c2913dd9a9509895ee0 HTTP/1.1" 200 None 2026-04-08 07:09:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:09:46,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:09:46,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:09:46,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35c2913dd9a9509895ee0 HTTP/1.1" 200 None 2026-04-08 07:09:46,418 - lava_callback - ERROR - Error processing callback for node 69d35c2913dd9a9509895ee0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57920 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:10:06,272 - lava_callback - INFO - Received callback for node 69d35c4b13dd9a9509895f08 INFO: 172.20.0.1:34902 - "POST /node/69d35c4b13dd9a9509895f08 HTTP/1.0" 202 Accepted 2026-04-08 07:10:06,278 - lava_callback - INFO - Starting async job submit for node 69d35c4b13dd9a9509895f08 2026-04-08 07:10:06,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:06,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c4b13dd9a9509895f08 HTTP/1.1" 200 None 2026-04-08 07:10:06,294 - lava_callback - DEBUG - Processing node 69d35c4b13dd9a9509895f08: baseline-arm-clabbe 2026-04-08 07:10:06,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35c4b13dd9a9509895f08 2026-04-08 07:10:06,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:06,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c4b13dd9a9509895f08 HTTP/1.1" 200 None 2026-04-08 07:10:06,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:06,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:10:06,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:06,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35c4b13dd9a9509895f08 HTTP/1.1" 200 None 2026-04-08 07:10:06,352 - lava_callback - ERROR - Error processing callback for node 69d35c4b13dd9a9509895f08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:10:46,363 - lava_callback - INFO - Received callback for node 69d35c6713dd9a9509895f50 INFO: 172.20.0.1:56874 - "POST /node/69d35c6713dd9a9509895f50 HTTP/1.0" 202 Accepted 2026-04-08 07:10:46,368 - lava_callback - INFO - Starting async job submit for node 69d35c6713dd9a9509895f50 2026-04-08 07:10:46,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:46,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c6713dd9a9509895f50 HTTP/1.1" 200 None 2026-04-08 07:10:46,393 - lava_callback - DEBUG - Processing node 69d35c6713dd9a9509895f50: baseline-arm-clabbe 2026-04-08 07:10:46,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35c6713dd9a9509895f50 2026-04-08 07:10:46,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:46,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c6713dd9a9509895f50 HTTP/1.1" 200 None 2026-04-08 07:10:46,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:46,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:10:46,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:10:46,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35c6713dd9a9509895f50 HTTP/1.1" 200 None 2026-04-08 07:10:46,464 - lava_callback - ERROR - Error processing callback for node 69d35c6713dd9a9509895f50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:11:26,782 - lava_callback - INFO - Received callback for node 69d35c8f13dd9a9509895f63 INFO: 172.20.0.1:36150 - "POST /node/69d35c8f13dd9a9509895f63 HTTP/1.0" 202 Accepted 2026-04-08 07:11:26,788 - lava_callback - INFO - Starting async job submit for node 69d35c8f13dd9a9509895f63 2026-04-08 07:11:26,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:11:26,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c8f13dd9a9509895f63 HTTP/1.1" 200 None 2026-04-08 07:11:26,804 - lava_callback - DEBUG - Processing node 69d35c8f13dd9a9509895f63: baseline-arm64-baylibre 2026-04-08 07:11:26,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35c8f13dd9a9509895f63 2026-04-08 07:11:26,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:11:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35c8f13dd9a9509895f63 HTTP/1.1" 200 None 2026-04-08 07:11:26,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:11:26,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:11:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:11:26,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35c8f13dd9a9509895f63 HTTP/1.1" 200 None 2026-04-08 07:11:26,859 - lava_callback - ERROR - Error processing callback for node 69d35c8f13dd9a9509895f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:12:26,757 - lava_callback - INFO - Received callback for node 69d35cd713dd9a9509895f81 INFO: 172.20.0.1:49160 - "POST /node/69d35cd713dd9a9509895f81 HTTP/1.0" 202 Accepted 2026-04-08 07:12:26,762 - lava_callback - INFO - Starting async job submit for node 69d35cd713dd9a9509895f81 2026-04-08 07:12:26,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:12:26,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35cd713dd9a9509895f81 HTTP/1.1" 200 None 2026-04-08 07:12:26,792 - lava_callback - DEBUG - Processing node 69d35cd713dd9a9509895f81: baseline-arm64-baylibre 2026-04-08 07:12:26,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35cd713dd9a9509895f81 2026-04-08 07:12:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:12:26,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35cd713dd9a9509895f81 HTTP/1.1" 200 None 2026-04-08 07:12:26,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:12:26,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:12:26,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:12:26,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35cd713dd9a9509895f81 HTTP/1.1" 200 None 2026-04-08 07:12:26,843 - lava_callback - ERROR - Error processing callback for node 69d35cd713dd9a9509895f81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:13:46,938 - lava_callback - INFO - Received callback for node 69d35d2313dd9a9509895f9c INFO: 172.20.0.1:47226 - "POST /node/69d35d2313dd9a9509895f9c HTTP/1.0" 202 Accepted 2026-04-08 07:13:46,947 - lava_callback - INFO - Starting async job submit for node 69d35d2313dd9a9509895f9c 2026-04-08 07:13:46,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:13:46,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35d2313dd9a9509895f9c HTTP/1.1" 200 None 2026-04-08 07:13:46,967 - lava_callback - DEBUG - Processing node 69d35d2313dd9a9509895f9c: baseline-arm64-baylibre 2026-04-08 07:13:46,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35d2313dd9a9509895f9c 2026-04-08 07:13:46,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:13:46,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35d2313dd9a9509895f9c HTTP/1.1" 200 None 2026-04-08 07:13:46,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:13:47,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:13:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:13:47,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35d2313dd9a9509895f9c HTTP/1.1" 200 None 2026-04-08 07:13:47,048 - lava_callback - ERROR - Error processing callback for node 69d35d2313dd9a9509895f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:15:06,978 - lava_callback - INFO - Received callback for node 69d35d6613dd9a9509895fdf INFO: 172.20.0.1:58768 - "POST /node/69d35d6613dd9a9509895fdf HTTP/1.0" 202 Accepted 2026-04-08 07:15:06,984 - lava_callback - INFO - Starting async job submit for node 69d35d6613dd9a9509895fdf 2026-04-08 07:15:06,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:15:07,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35d6613dd9a9509895fdf HTTP/1.1" 200 None 2026-04-08 07:15:07,003 - lava_callback - DEBUG - Processing node 69d35d6613dd9a9509895fdf: baseline-arm64-baylibre 2026-04-08 07:15:07,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35d6613dd9a9509895fdf 2026-04-08 07:15:07,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:15:07,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35d6613dd9a9509895fdf HTTP/1.1" 200 None 2026-04-08 07:15:07,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:15:07,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:15:07,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:15:07,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35d6613dd9a9509895fdf HTTP/1.1" 200 None 2026-04-08 07:15:07,070 - lava_callback - ERROR - Error processing callback for node 69d35d6613dd9a9509895fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38574 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:16:07,017 - lava_callback - INFO - Received callback for node 69d35db013dd9a9509896003 INFO: 172.20.0.1:38586 - "POST /node/69d35db013dd9a9509896003 HTTP/1.0" 202 Accepted 2026-04-08 07:16:07,026 - lava_callback - INFO - Starting async job submit for node 69d35db013dd9a9509896003 2026-04-08 07:16:07,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:16:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35db013dd9a9509896003 HTTP/1.1" 200 None 2026-04-08 07:16:07,049 - lava_callback - DEBUG - Processing node 69d35db013dd9a9509896003: baseline-arm64-baylibre 2026-04-08 07:16:07,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35db013dd9a9509896003 2026-04-08 07:16:07,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:16:07,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35db013dd9a9509896003 HTTP/1.1" 200 None 2026-04-08 07:16:07,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:16:07,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:16:07,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:16:07,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35db013dd9a9509896003 HTTP/1.1" 200 None 2026-04-08 07:16:07,114 - lava_callback - ERROR - Error processing callback for node 69d35db013dd9a9509896003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:17:27,138 - lava_callback - INFO - Received callback for node 69d35df513dd9a9509896041 INFO: 172.20.0.1:42178 - "POST /node/69d35df513dd9a9509896041 HTTP/1.0" 202 Accepted 2026-04-08 07:17:27,146 - lava_callback - INFO - Starting async job submit for node 69d35df513dd9a9509896041 2026-04-08 07:17:27,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:17:27,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35df513dd9a9509896041 HTTP/1.1" 200 None 2026-04-08 07:17:27,167 - lava_callback - DEBUG - Processing node 69d35df513dd9a9509896041: baseline-arm64-baylibre 2026-04-08 07:17:27,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35df513dd9a9509896041 2026-04-08 07:17:27,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:17:27,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35df513dd9a9509896041 HTTP/1.1" 200 None 2026-04-08 07:17:27,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:17:27,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:17:27,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:17:27,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35df513dd9a9509896041 HTTP/1.1" 200 None 2026-04-08 07:17:27,253 - lava_callback - ERROR - Error processing callback for node 69d35df513dd9a9509896041: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:18:26,740 - lava_callback - INFO - Received callback for node 69d35e3a13dd9a9509896087 INFO: 172.20.0.1:37578 - "POST /node/69d35e3a13dd9a9509896087 HTTP/1.0" 202 Accepted 2026-04-08 07:18:26,746 - lava_callback - INFO - Starting async job submit for node 69d35e3a13dd9a9509896087 2026-04-08 07:18:26,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:18:26,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35e3a13dd9a9509896087 HTTP/1.1" 200 None 2026-04-08 07:18:26,763 - lava_callback - DEBUG - Processing node 69d35e3a13dd9a9509896087: baseline-arm64-clabbe 2026-04-08 07:18:26,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35e3a13dd9a9509896087 2026-04-08 07:18:26,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:18:26,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35e3a13dd9a9509896087 HTTP/1.1" 200 None 2026-04-08 07:18:26,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:18:26,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:18:26,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:18:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35e3a13dd9a9509896087 HTTP/1.1" 200 None 2026-04-08 07:18:26,838 - lava_callback - ERROR - Error processing callback for node 69d35e3a13dd9a9509896087: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46258 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:19:46,817 - lava_callback - INFO - Received callback for node 69d35e8213dd9a95098960b3 INFO: 172.20.0.1:46270 - "POST /node/69d35e8213dd9a95098960b3 HTTP/1.0" 202 Accepted 2026-04-08 07:19:46,823 - lava_callback - INFO - Starting async job submit for node 69d35e8213dd9a95098960b3 2026-04-08 07:19:46,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:19:46,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35e8213dd9a95098960b3 HTTP/1.1" 200 None 2026-04-08 07:19:46,838 - lava_callback - DEBUG - Processing node 69d35e8213dd9a95098960b3: baseline-arm64-clabbe 2026-04-08 07:19:46,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35e8213dd9a95098960b3 2026-04-08 07:19:46,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:19:46,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35e8213dd9a95098960b3 HTTP/1.1" 200 None 2026-04-08 07:19:46,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:19:46,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:19:46,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:19:46,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35e8213dd9a95098960b3 HTTP/1.1" 200 None 2026-04-08 07:19:46,900 - lava_callback - ERROR - Error processing callback for node 69d35e8213dd9a95098960b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36640 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:21:06,846 - lava_callback - INFO - Received callback for node 69d35ecd13dd9a95098960cd INFO: 172.20.0.1:36654 - "POST /node/69d35ecd13dd9a95098960cd HTTP/1.0" 202 Accepted 2026-04-08 07:21:06,853 - lava_callback - INFO - Starting async job submit for node 69d35ecd13dd9a95098960cd 2026-04-08 07:21:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:21:06,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35ecd13dd9a95098960cd HTTP/1.1" 200 None 2026-04-08 07:21:06,873 - lava_callback - DEBUG - Processing node 69d35ecd13dd9a95098960cd: baseline-arm64-clabbe 2026-04-08 07:21:06,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35ecd13dd9a95098960cd 2026-04-08 07:21:06,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:21:06,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35ecd13dd9a95098960cd HTTP/1.1" 200 None 2026-04-08 07:21:06,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:21:06,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:21:06,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:21:06,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35ecd13dd9a95098960cd HTTP/1.1" 200 None 2026-04-08 07:21:06,948 - lava_callback - ERROR - Error processing callback for node 69d35ecd13dd9a95098960cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:22:06,970 - lava_callback - INFO - Received callback for node 69d35f1113dd9a95098960fe INFO: 172.20.0.1:58600 - "POST /node/69d35f1113dd9a95098960fe HTTP/1.0" 202 Accepted 2026-04-08 07:22:06,978 - lava_callback - INFO - Starting async job submit for node 69d35f1113dd9a95098960fe 2026-04-08 07:22:06,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:22:06,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f1113dd9a95098960fe HTTP/1.1" 200 None 2026-04-08 07:22:07,000 - lava_callback - DEBUG - Processing node 69d35f1113dd9a95098960fe: baseline-arm64-clabbe 2026-04-08 07:22:07,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35f1113dd9a95098960fe 2026-04-08 07:22:07,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:22:07,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f1113dd9a95098960fe HTTP/1.1" 200 None 2026-04-08 07:22:07,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:22:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:22:07,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:22:07,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35f1113dd9a95098960fe HTTP/1.1" 200 None 2026-04-08 07:22:07,093 - lava_callback - ERROR - Error processing callback for node 69d35f1113dd9a95098960fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55718 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:23:07,006 - lava_callback - INFO - Received callback for node 69d35f5213dd9a9509896144 INFO: 172.20.0.1:55722 - "POST /node/69d35f5213dd9a9509896144 HTTP/1.0" 202 Accepted 2026-04-08 07:23:07,012 - lava_callback - INFO - Starting async job submit for node 69d35f5213dd9a9509896144 2026-04-08 07:23:07,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:23:07,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f5213dd9a9509896144 HTTP/1.1" 200 None 2026-04-08 07:23:07,029 - lava_callback - DEBUG - Processing node 69d35f5213dd9a9509896144: baseline-arm64-clabbe 2026-04-08 07:23:07,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35f5213dd9a9509896144 2026-04-08 07:23:07,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:23:07,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f5213dd9a9509896144 HTTP/1.1" 200 None 2026-04-08 07:23:07,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:23:07,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:23:07,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:23:07,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35f5213dd9a9509896144 HTTP/1.1" 200 None 2026-04-08 07:23:07,096 - lava_callback - ERROR - Error processing callback for node 69d35f5213dd9a9509896144: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:24:26,987 - lava_callback - INFO - Received callback for node 69d35f9c13dd9a9509896166 INFO: 172.20.0.1:51820 - "POST /node/69d35f9c13dd9a9509896166 HTTP/1.0" 202 Accepted 2026-04-08 07:24:26,993 - lava_callback - INFO - Starting async job submit for node 69d35f9c13dd9a9509896166 2026-04-08 07:24:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:24:27,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f9c13dd9a9509896166 HTTP/1.1" 200 None 2026-04-08 07:24:27,009 - lava_callback - DEBUG - Processing node 69d35f9c13dd9a9509896166: baseline-arm64-clabbe 2026-04-08 07:24:27,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35f9c13dd9a9509896166 2026-04-08 07:24:27,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:24:27,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35f9c13dd9a9509896166 HTTP/1.1" 200 None 2026-04-08 07:24:27,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:24:27,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:24:27,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:24:27,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35f9c13dd9a9509896166 HTTP/1.1" 200 None 2026-04-08 07:24:27,084 - lava_callback - ERROR - Error processing callback for node 69d35f9c13dd9a9509896166: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52756 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:25:27,072 - lava_callback - INFO - Received callback for node 69d35fe313dd9a95098961a5 INFO: 172.20.0.1:52762 - "POST /node/69d35fe313dd9a95098961a5 HTTP/1.0" 202 Accepted 2026-04-08 07:25:27,078 - lava_callback - INFO - Starting async job submit for node 69d35fe313dd9a95098961a5 2026-04-08 07:25:27,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:25:27,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35fe313dd9a95098961a5 HTTP/1.1" 200 None 2026-04-08 07:25:27,106 - lava_callback - DEBUG - Processing node 69d35fe313dd9a95098961a5: baseline-arm64-clabbe 2026-04-08 07:25:27,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d35fe313dd9a95098961a5 2026-04-08 07:25:27,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:25:27,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d35fe313dd9a95098961a5 HTTP/1.1" 200 None 2026-04-08 07:25:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:25:27,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2fbaa13dd9a95098934d8 HTTP/1.1" 200 None 2026-04-08 07:25:27,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:25:27,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d35fe313dd9a95098961a5 HTTP/1.1" 200 None 2026-04-08 07:25:27,238 - lava_callback - ERROR - Error processing callback for node 69d35fe313dd9a95098961a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:26:27,119 - lava_callback - INFO - Received callback for node 69d3601e13dd9a95098961bf INFO: 172.20.0.1:42168 - "POST /node/69d3601e13dd9a95098961bf HTTP/1.0" 202 Accepted 2026-04-08 07:26:27,125 - lava_callback - INFO - Starting async job submit for node 69d3601e13dd9a95098961bf 2026-04-08 07:26:27,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:26:27,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3601e13dd9a95098961bf HTTP/1.1" 200 None 2026-04-08 07:26:27,147 - lava_callback - DEBUG - Processing node 69d3601e13dd9a95098961bf: baseline-arm-clabbe 2026-04-08 07:26:27,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3601e13dd9a95098961bf 2026-04-08 07:26:27,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:26:27,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3601e13dd9a95098961bf HTTP/1.1" 200 None 2026-04-08 07:26:27,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:26:27,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:26:27,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:26:27,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3601e13dd9a95098961bf HTTP/1.1" 200 None 2026-04-08 07:26:27,202 - lava_callback - ERROR - Error processing callback for node 69d3601e13dd9a95098961bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:27:07,765 - lava_callback - INFO - Received callback for node 69d3603c13dd9a95098961ce INFO: 172.20.0.1:34408 - "POST /node/69d3603c13dd9a95098961ce HTTP/1.0" 202 Accepted 2026-04-08 07:27:07,774 - lava_callback - INFO - Starting async job submit for node 69d3603c13dd9a95098961ce 2026-04-08 07:27:07,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:07,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3603c13dd9a95098961ce HTTP/1.1" 200 None 2026-04-08 07:27:07,796 - lava_callback - DEBUG - Processing node 69d3603c13dd9a95098961ce: baseline-arm-baylibre 2026-04-08 07:27:07,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3603c13dd9a95098961ce 2026-04-08 07:27:07,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:07,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3603c13dd9a95098961ce HTTP/1.1" 200 None 2026-04-08 07:27:07,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:07,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:27:07,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:07,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3603c13dd9a95098961ce HTTP/1.1" 200 None 2026-04-08 07:27:07,883 - lava_callback - ERROR - Error processing callback for node 69d3603c13dd9a95098961ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38900 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:27:47,621 - lava_callback - INFO - Received callback for node 69d3606013dd9a95098961e7 INFO: 172.20.0.1:38916 - "POST /node/69d3606013dd9a95098961e7 HTTP/1.0" 202 Accepted 2026-04-08 07:27:47,626 - lava_callback - INFO - Starting async job submit for node 69d3606013dd9a95098961e7 2026-04-08 07:27:47,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:47,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3606013dd9a95098961e7 HTTP/1.1" 200 None 2026-04-08 07:27:47,642 - lava_callback - DEBUG - Processing node 69d3606013dd9a95098961e7: baseline-arm-baylibre 2026-04-08 07:27:47,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3606013dd9a95098961e7 2026-04-08 07:27:47,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:47,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3606013dd9a95098961e7 HTTP/1.1" 200 None 2026-04-08 07:27:47,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:47,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:27:47,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:27:47,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3606013dd9a95098961e7 HTTP/1.1" 200 None 2026-04-08 07:27:47,697 - lava_callback - ERROR - Error processing callback for node 69d3606013dd9a95098961e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:28:27,195 - lava_callback - INFO - Received callback for node 69d3608913dd9a95098961fd INFO: 172.20.0.1:41490 - "POST /node/69d3608913dd9a95098961fd HTTP/1.0" 202 Accepted 2026-04-08 07:28:27,200 - lava_callback - INFO - Starting async job submit for node 69d3608913dd9a95098961fd 2026-04-08 07:28:27,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:27,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3608913dd9a95098961fd HTTP/1.1" 200 None 2026-04-08 07:28:27,218 - lava_callback - DEBUG - Processing node 69d3608913dd9a95098961fd: baseline-arm-clabbe 2026-04-08 07:28:27,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3608913dd9a95098961fd 2026-04-08 07:28:27,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:27,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3608913dd9a95098961fd HTTP/1.1" 200 None 2026-04-08 07:28:27,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:28:27,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:27,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3608913dd9a95098961fd HTTP/1.1" 200 None 2026-04-08 07:28:27,281 - lava_callback - ERROR - Error processing callback for node 69d3608913dd9a95098961fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:28:47,812 - lava_callback - INFO - Received callback for node 69d360a413dd9a9509896203 INFO: 172.20.0.1:37476 - "POST /node/69d360a413dd9a9509896203 HTTP/1.0" 202 Accepted 2026-04-08 07:28:47,818 - lava_callback - INFO - Starting async job submit for node 69d360a413dd9a9509896203 2026-04-08 07:28:47,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:47,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360a413dd9a9509896203 HTTP/1.1" 200 None 2026-04-08 07:28:47,834 - lava_callback - DEBUG - Processing node 69d360a413dd9a9509896203: baseline-arm-baylibre 2026-04-08 07:28:47,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d360a413dd9a9509896203 2026-04-08 07:28:47,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:47,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360a413dd9a9509896203 HTTP/1.1" 200 None 2026-04-08 07:28:47,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:47,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:28:47,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:28:47,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d360a413dd9a9509896203 HTTP/1.1" 200 None 2026-04-08 07:28:47,899 - lava_callback - ERROR - Error processing callback for node 69d360a413dd9a9509896203: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37530 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:29:27,716 - lava_callback - INFO - Received callback for node 69d360c813dd9a9509896233 INFO: 172.20.0.1:37544 - "POST /node/69d360c813dd9a9509896233 HTTP/1.0" 202 Accepted 2026-04-08 07:29:27,725 - lava_callback - INFO - Starting async job submit for node 69d360c813dd9a9509896233 2026-04-08 07:29:27,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:29:27,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360c813dd9a9509896233 HTTP/1.1" 200 None 2026-04-08 07:29:27,747 - lava_callback - DEBUG - Processing node 69d360c813dd9a9509896233: baseline-arm-baylibre 2026-04-08 07:29:27,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d360c813dd9a9509896233 2026-04-08 07:29:27,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:29:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360c813dd9a9509896233 HTTP/1.1" 200 None 2026-04-08 07:29:27,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:29:27,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:29:27,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:29:27,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d360c813dd9a9509896233 HTTP/1.1" 200 None 2026-04-08 07:29:27,806 - lava_callback - ERROR - Error processing callback for node 69d360c813dd9a9509896233: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:30:07,326 - lava_callback - INFO - Received callback for node 69d360f013dd9a950989623d INFO: 172.20.0.1:57304 - "POST /node/69d360f013dd9a950989623d HTTP/1.0" 202 Accepted 2026-04-08 07:30:07,331 - lava_callback - INFO - Starting async job submit for node 69d360f013dd9a950989623d 2026-04-08 07:30:07,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:07,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360f013dd9a950989623d HTTP/1.1" 200 None 2026-04-08 07:30:07,348 - lava_callback - DEBUG - Processing node 69d360f013dd9a950989623d: baseline-arm-clabbe 2026-04-08 07:30:07,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d360f013dd9a950989623d 2026-04-08 07:30:07,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:07,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d360f013dd9a950989623d HTTP/1.1" 200 None 2026-04-08 07:30:07,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:07,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:30:07,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:07,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d360f013dd9a950989623d HTTP/1.1" 200 None 2026-04-08 07:30:07,407 - lava_callback - ERROR - Error processing callback for node 69d360f013dd9a950989623d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:30:47,215 - lava_callback - INFO - Received callback for node 69d3611313dd9a950989624b INFO: 172.20.0.1:58504 - "POST /node/69d3611313dd9a950989624b HTTP/1.0" 202 Accepted 2026-04-08 07:30:47,220 - lava_callback - INFO - Starting async job submit for node 69d3611313dd9a950989624b 2026-04-08 07:30:47,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3611313dd9a950989624b HTTP/1.1" 200 None 2026-04-08 07:30:47,236 - lava_callback - DEBUG - Processing node 69d3611313dd9a950989624b: baseline-arm-clabbe 2026-04-08 07:30:47,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3611313dd9a950989624b 2026-04-08 07:30:47,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:47,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3611313dd9a950989624b HTTP/1.1" 200 None 2026-04-08 07:30:47,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:47,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:30:47,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:30:47,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3611313dd9a950989624b HTTP/1.1" 200 None 2026-04-08 07:30:47,303 - lava_callback - ERROR - Error processing callback for node 69d3611313dd9a950989624b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:31:07,939 - lava_callback - INFO - Received callback for node 69d3613113dd9a950989626c INFO: 172.20.0.1:47180 - "POST /node/69d3613113dd9a950989626c HTTP/1.0" 202 Accepted 2026-04-08 07:31:07,944 - lava_callback - INFO - Starting async job submit for node 69d3613113dd9a950989626c 2026-04-08 07:31:07,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:07,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3613113dd9a950989626c HTTP/1.1" 200 None 2026-04-08 07:31:07,961 - lava_callback - DEBUG - Processing node 69d3613113dd9a950989626c: baseline-arm-baylibre 2026-04-08 07:31:07,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3613113dd9a950989626c 2026-04-08 07:31:07,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:07,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3613113dd9a950989626c HTTP/1.1" 200 None 2026-04-08 07:31:07,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:07,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:31:07,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:08,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3613113dd9a950989626c HTTP/1.1" 200 None 2026-04-08 07:31:08,029 - lava_callback - ERROR - Error processing callback for node 69d3613113dd9a950989626c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:31:47,807 - lava_callback - INFO - Received callback for node 69d3615113dd9a950989628c INFO: 172.20.0.1:45920 - "POST /node/69d3615113dd9a950989628c HTTP/1.0" 202 Accepted 2026-04-08 07:31:47,813 - lava_callback - INFO - Starting async job submit for node 69d3615113dd9a950989628c 2026-04-08 07:31:47,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:47,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3615113dd9a950989628c HTTP/1.1" 200 None 2026-04-08 07:31:47,829 - lava_callback - DEBUG - Processing node 69d3615113dd9a950989628c: baseline-arm-baylibre 2026-04-08 07:31:47,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3615113dd9a950989628c 2026-04-08 07:31:47,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:47,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3615113dd9a950989628c HTTP/1.1" 200 None 2026-04-08 07:31:47,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:47,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:31:47,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:31:47,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3615113dd9a950989628c HTTP/1.1" 200 None 2026-04-08 07:31:47,890 - lava_callback - ERROR - Error processing callback for node 69d3615113dd9a950989628c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:32:07,306 - lava_callback - INFO - Received callback for node 69d3617113dd9a95098962b6 INFO: 172.20.0.1:36068 - "POST /node/69d3617113dd9a95098962b6 HTTP/1.0" 202 Accepted 2026-04-08 07:32:07,312 - lava_callback - INFO - Starting async job submit for node 69d3617113dd9a95098962b6 2026-04-08 07:32:07,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:07,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3617113dd9a95098962b6 HTTP/1.1" 200 None 2026-04-08 07:32:07,328 - lava_callback - DEBUG - Processing node 69d3617113dd9a95098962b6: baseline-arm-clabbe 2026-04-08 07:32:07,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3617113dd9a95098962b6 2026-04-08 07:32:07,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:07,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3617113dd9a95098962b6 HTTP/1.1" 200 None 2026-04-08 07:32:07,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:07,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-08 07:32:07,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:07,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3617113dd9a95098962b6 HTTP/1.1" 200 None 2026-04-08 07:32:07,392 - lava_callback - ERROR - Error processing callback for node 69d3617113dd9a95098962b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:32:47,916 - lava_callback - INFO - Received callback for node 69d3618d13dd9a95098962e0 INFO: 172.20.0.1:58904 - "POST /node/69d3618d13dd9a95098962e0 HTTP/1.0" 202 Accepted 2026-04-08 07:32:47,926 - lava_callback - INFO - Starting async job submit for node 69d3618d13dd9a95098962e0 2026-04-08 07:32:47,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:47,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3618d13dd9a95098962e0 HTTP/1.1" 200 None 2026-04-08 07:32:47,942 - lava_callback - DEBUG - Processing node 69d3618d13dd9a95098962e0: baseline-arm-baylibre 2026-04-08 07:32:47,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3618d13dd9a95098962e0 2026-04-08 07:32:47,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:47,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3618d13dd9a95098962e0 HTTP/1.1" 200 None 2026-04-08 07:32:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:47,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:32:47,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:32:48,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3618d13dd9a95098962e0 HTTP/1.1" 200 None 2026-04-08 07:32:48,010 - lava_callback - ERROR - Error processing callback for node 69d3618d13dd9a95098962e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38474 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:33:07,354 - lava_callback - INFO - Received callback for node 69d361af13dd9a95098962fe INFO: 172.20.0.1:38480 - "POST /node/69d361af13dd9a95098962fe HTTP/1.0" 202 Accepted 2026-04-08 07:33:07,360 - lava_callback - INFO - Starting async job submit for node 69d361af13dd9a95098962fe 2026-04-08 07:33:07,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:07,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361af13dd9a95098962fe HTTP/1.1" 200 None 2026-04-08 07:33:07,385 - lava_callback - DEBUG - Processing node 69d361af13dd9a95098962fe: baseline-arm-clabbe 2026-04-08 07:33:07,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d361af13dd9a95098962fe 2026-04-08 07:33:07,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:07,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361af13dd9a95098962fe HTTP/1.1" 200 None 2026-04-08 07:33:07,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:07,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:33:07,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:07,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d361af13dd9a95098962fe HTTP/1.1" 200 None 2026-04-08 07:33:07,439 - lava_callback - ERROR - Error processing callback for node 69d361af13dd9a95098962fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40320 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:33:47,359 - lava_callback - INFO - Received callback for node 69d361d313dd9a9509896330 INFO: 172.20.0.1:40328 - "POST /node/69d361d313dd9a9509896330 HTTP/1.0" 202 Accepted 2026-04-08 07:33:47,364 - lava_callback - INFO - Starting async job submit for node 69d361d313dd9a9509896330 2026-04-08 07:33:47,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:47,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361d313dd9a9509896330 HTTP/1.1" 200 None 2026-04-08 07:33:47,382 - lava_callback - DEBUG - Processing node 69d361d313dd9a9509896330: baseline-arm-clabbe 2026-04-08 07:33:47,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d361d313dd9a9509896330 2026-04-08 07:33:47,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:47,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361d313dd9a9509896330 HTTP/1.1" 200 None 2026-04-08 07:33:47,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:47,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:33:47,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:33:47,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d361d313dd9a9509896330 HTTP/1.1" 200 None 2026-04-08 07:33:47,441 - lava_callback - ERROR - Error processing callback for node 69d361d313dd9a9509896330: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:34:27,960 - lava_callback - INFO - Received callback for node 69d361f113dd9a9509896348 INFO: 172.20.0.1:39230 - "POST /node/69d361f113dd9a9509896348 HTTP/1.0" 202 Accepted 2026-04-08 07:34:27,966 - lava_callback - INFO - Starting async job submit for node 69d361f113dd9a9509896348 2026-04-08 07:34:27,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:27,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361f113dd9a9509896348 HTTP/1.1" 200 None 2026-04-08 07:34:27,983 - lava_callback - DEBUG - Processing node 69d361f113dd9a9509896348: baseline-arm-baylibre 2026-04-08 07:34:27,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d361f113dd9a9509896348 2026-04-08 07:34:27,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:28,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d361f113dd9a9509896348 HTTP/1.1" 200 None 2026-04-08 07:34:28,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:28,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:34:28,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:28,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d361f113dd9a9509896348 HTTP/1.1" 200 None 2026-04-08 07:34:28,080 - lava_callback - ERROR - Error processing callback for node 69d361f113dd9a9509896348: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40016 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:34:47,937 - lava_callback - INFO - Received callback for node 69d3621413dd9a9509896355 INFO: 172.20.0.1:40028 - "POST /node/69d3621413dd9a9509896355 HTTP/1.0" 202 Accepted 2026-04-08 07:34:47,942 - lava_callback - INFO - Starting async job submit for node 69d3621413dd9a9509896355 2026-04-08 07:34:47,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:47,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3621413dd9a9509896355 HTTP/1.1" 200 None 2026-04-08 07:34:47,958 - lava_callback - DEBUG - Processing node 69d3621413dd9a9509896355: baseline-arm-baylibre 2026-04-08 07:34:47,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3621413dd9a9509896355 2026-04-08 07:34:47,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:47,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3621413dd9a9509896355 HTTP/1.1" 200 None 2026-04-08 07:34:47,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:47,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:34:47,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:34:48,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3621413dd9a9509896355 HTTP/1.1" 200 None 2026-04-08 07:34:48,020 - lava_callback - ERROR - Error processing callback for node 69d3621413dd9a9509896355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:35:27,475 - lava_callback - INFO - Received callback for node 69d3623c13dd9a9509896367 INFO: 172.20.0.1:43854 - "POST /node/69d3623c13dd9a9509896367 HTTP/1.0" 202 Accepted 2026-04-08 07:35:27,483 - lava_callback - INFO - Starting async job submit for node 69d3623c13dd9a9509896367 2026-04-08 07:35:27,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:35:27,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3623c13dd9a9509896367 HTTP/1.1" 200 None 2026-04-08 07:35:27,500 - lava_callback - DEBUG - Processing node 69d3623c13dd9a9509896367: baseline-arm-clabbe 2026-04-08 07:35:27,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3623c13dd9a9509896367 2026-04-08 07:35:27,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:35:27,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3623c13dd9a9509896367 HTTP/1.1" 200 None 2026-04-08 07:35:27,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:35:27,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:35:27,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:35:27,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3623c13dd9a9509896367 HTTP/1.1" 200 None 2026-04-08 07:35:27,568 - lava_callback - ERROR - Error processing callback for node 69d3623c13dd9a9509896367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:36:08,169 - lava_callback - INFO - Received callback for node 69d3625a13dd9a9509896383 INFO: 172.20.0.1:55306 - "POST /node/69d3625a13dd9a9509896383 HTTP/1.0" 202 Accepted 2026-04-08 07:36:08,175 - lava_callback - INFO - Starting async job submit for node 69d3625a13dd9a9509896383 2026-04-08 07:36:08,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:08,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3625a13dd9a9509896383 HTTP/1.1" 200 None 2026-04-08 07:36:08,196 - lava_callback - DEBUG - Processing node 69d3625a13dd9a9509896383: baseline-arm-baylibre 2026-04-08 07:36:08,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3625a13dd9a9509896383 2026-04-08 07:36:08,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:08,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3625a13dd9a9509896383 HTTP/1.1" 200 None 2026-04-08 07:36:08,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:08,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:36:08,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:08,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3625a13dd9a9509896383 HTTP/1.1" 200 None 2026-04-08 07:36:08,255 - lava_callback - ERROR - Error processing callback for node 69d3625a13dd9a9509896383: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:36:47,482 - lava_callback - INFO - Received callback for node 69d3627f13dd9a9509896399 INFO: 172.20.0.1:50572 - "POST /node/69d3627f13dd9a9509896399 HTTP/1.0" 202 Accepted 2026-04-08 07:36:47,488 - lava_callback - INFO - Starting async job submit for node 69d3627f13dd9a9509896399 2026-04-08 07:36:47,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:47,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3627f13dd9a9509896399 HTTP/1.1" 200 None 2026-04-08 07:36:47,508 - lava_callback - DEBUG - Processing node 69d3627f13dd9a9509896399: baseline-arm-clabbe 2026-04-08 07:36:47,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3627f13dd9a9509896399 2026-04-08 07:36:47,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:47,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3627f13dd9a9509896399 HTTP/1.1" 200 None 2026-04-08 07:36:47,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:36:47,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:36:47,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3627f13dd9a9509896399 HTTP/1.1" 200 None 2026-04-08 07:36:47,567 - lava_callback - ERROR - Error processing callback for node 69d3627f13dd9a9509896399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52644 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:37:27,506 - lava_callback - INFO - Received callback for node 69d362a213dd9a95098963a2 INFO: 172.20.0.1:52648 - "POST /node/69d362a213dd9a95098963a2 HTTP/1.0" 202 Accepted 2026-04-08 07:37:27,512 - lava_callback - INFO - Starting async job submit for node 69d362a213dd9a95098963a2 2026-04-08 07:37:27,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:27,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362a213dd9a95098963a2 HTTP/1.1" 200 None 2026-04-08 07:37:27,527 - lava_callback - DEBUG - Processing node 69d362a213dd9a95098963a2: baseline-arm-clabbe 2026-04-08 07:37:27,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d362a213dd9a95098963a2 2026-04-08 07:37:27,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:27,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362a213dd9a95098963a2 HTTP/1.1" 200 None 2026-04-08 07:37:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:27,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:37:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:27,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d362a213dd9a95098963a2 HTTP/1.1" 200 None 2026-04-08 07:37:27,602 - lava_callback - ERROR - Error processing callback for node 69d362a213dd9a95098963a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44040 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:37:48,133 - lava_callback - INFO - Received callback for node 69d362bf13dd9a95098963b5 INFO: 172.20.0.1:44046 - "POST /node/69d362bf13dd9a95098963b5 HTTP/1.0" 202 Accepted 2026-04-08 07:37:48,139 - lava_callback - INFO - Starting async job submit for node 69d362bf13dd9a95098963b5 2026-04-08 07:37:48,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:48,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362bf13dd9a95098963b5 HTTP/1.1" 200 None 2026-04-08 07:37:48,154 - lava_callback - DEBUG - Processing node 69d362bf13dd9a95098963b5: baseline-arm-baylibre 2026-04-08 07:37:48,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d362bf13dd9a95098963b5 2026-04-08 07:37:48,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:48,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362bf13dd9a95098963b5 HTTP/1.1" 200 None 2026-04-08 07:37:48,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:48,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:37:48,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:37:48,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d362bf13dd9a95098963b5 HTTP/1.1" 200 None 2026-04-08 07:37:48,217 - lava_callback - ERROR - Error processing callback for node 69d362bf13dd9a95098963b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:38:28,188 - lava_callback - INFO - Received callback for node 69d362e213dd9a95098963ec INFO: 172.20.0.1:48462 - "POST /node/69d362e213dd9a95098963ec HTTP/1.0" 202 Accepted 2026-04-08 07:38:28,194 - lava_callback - INFO - Starting async job submit for node 69d362e213dd9a95098963ec 2026-04-08 07:38:28,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:28,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362e213dd9a95098963ec HTTP/1.1" 200 None 2026-04-08 07:38:28,211 - lava_callback - DEBUG - Processing node 69d362e213dd9a95098963ec: baseline-arm-baylibre 2026-04-08 07:38:28,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d362e213dd9a95098963ec 2026-04-08 07:38:28,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:28,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d362e213dd9a95098963ec HTTP/1.1" 200 None 2026-04-08 07:38:28,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:28,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:38:28,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:28,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d362e213dd9a95098963ec HTTP/1.1" 200 None 2026-04-08 07:38:28,342 - lava_callback - ERROR - Error processing callback for node 69d362e213dd9a95098963ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:38:47,564 - lava_callback - INFO - Received callback for node 69d3630013dd9a950989641a INFO: 172.20.0.1:47196 - "POST /node/69d3630013dd9a950989641a HTTP/1.0" 202 Accepted 2026-04-08 07:38:47,569 - lava_callback - INFO - Starting async job submit for node 69d3630013dd9a950989641a 2026-04-08 07:38:47,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:47,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3630013dd9a950989641a HTTP/1.1" 200 None 2026-04-08 07:38:47,586 - lava_callback - DEBUG - Processing node 69d3630013dd9a950989641a: baseline-arm-clabbe 2026-04-08 07:38:47,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3630013dd9a950989641a 2026-04-08 07:38:47,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:47,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3630013dd9a950989641a HTTP/1.1" 200 None 2026-04-08 07:38:47,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:38:47,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:38:47,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3630013dd9a950989641a HTTP/1.1" 200 None 2026-04-08 07:38:47,653 - lava_callback - ERROR - Error processing callback for node 69d3630013dd9a950989641a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:39:27,526 - lava_callback - INFO - Received callback for node 69d3632013dd9a9509896443 INFO: 172.20.0.1:53758 - "POST /node/69d3632013dd9a9509896443 HTTP/1.0" 202 Accepted 2026-04-08 07:39:27,535 - lava_callback - INFO - Starting async job submit for node 69d3632013dd9a9509896443 2026-04-08 07:39:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:27,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3632013dd9a9509896443 HTTP/1.1" 200 None 2026-04-08 07:39:27,552 - lava_callback - DEBUG - Processing node 69d3632013dd9a9509896443: baseline-arm-clabbe 2026-04-08 07:39:27,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3632013dd9a9509896443 2026-04-08 07:39:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:27,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3632013dd9a9509896443 HTTP/1.1" 200 None 2026-04-08 07:39:27,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:27,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:39:27,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:27,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3632013dd9a9509896443 HTTP/1.1" 200 None 2026-04-08 07:39:27,616 - lava_callback - ERROR - Error processing callback for node 69d3632013dd9a9509896443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49542 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:39:48,362 - lava_callback - INFO - Received callback for node 69d3634013dd9a950989644a INFO: 172.20.0.1:49552 - "POST /node/69d3634013dd9a950989644a HTTP/1.0" 202 Accepted 2026-04-08 07:39:48,367 - lava_callback - INFO - Starting async job submit for node 69d3634013dd9a950989644a 2026-04-08 07:39:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3634013dd9a950989644a HTTP/1.1" 200 None 2026-04-08 07:39:48,383 - lava_callback - DEBUG - Processing node 69d3634013dd9a950989644a: baseline-arm-baylibre 2026-04-08 07:39:48,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3634013dd9a950989644a 2026-04-08 07:39:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:48,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3634013dd9a950989644a HTTP/1.1" 200 None 2026-04-08 07:39:48,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:48,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:39:48,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:39:48,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3634013dd9a950989644a HTTP/1.1" 200 None 2026-04-08 07:39:48,463 - lava_callback - ERROR - Error processing callback for node 69d3634013dd9a950989644a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:40:28,263 - lava_callback - INFO - Received callback for node 69d3636113dd9a9509896461 INFO: 172.20.0.1:47986 - "POST /node/69d3636113dd9a9509896461 HTTP/1.0" 202 Accepted 2026-04-08 07:40:28,271 - lava_callback - INFO - Starting async job submit for node 69d3636113dd9a9509896461 2026-04-08 07:40:28,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:40:28,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3636113dd9a9509896461 HTTP/1.1" 200 None 2026-04-08 07:40:28,290 - lava_callback - DEBUG - Processing node 69d3636113dd9a9509896461: baseline-arm-baylibre 2026-04-08 07:40:28,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3636113dd9a9509896461 2026-04-08 07:40:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:40:28,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3636113dd9a9509896461 HTTP/1.1" 200 None 2026-04-08 07:40:28,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:40:28,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:40:28,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:40:28,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3636113dd9a9509896461 HTTP/1.1" 200 None 2026-04-08 07:40:28,367 - lava_callback - ERROR - Error processing callback for node 69d3636113dd9a9509896461: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:41:07,720 - lava_callback - INFO - Received callback for node 69d3638113dd9a9509896491 INFO: 172.20.0.1:50472 - "POST /node/69d3638113dd9a9509896491 HTTP/1.0" 202 Accepted 2026-04-08 07:41:07,725 - lava_callback - INFO - Starting async job submit for node 69d3638113dd9a9509896491 2026-04-08 07:41:07,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:07,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3638113dd9a9509896491 HTTP/1.1" 200 None 2026-04-08 07:41:07,741 - lava_callback - DEBUG - Processing node 69d3638113dd9a9509896491: baseline-arm-clabbe 2026-04-08 07:41:07,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3638113dd9a9509896491 2026-04-08 07:41:07,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3638113dd9a9509896491 HTTP/1.1" 200 None 2026-04-08 07:41:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:07,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:41:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:07,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3638113dd9a9509896491 HTTP/1.1" 200 None 2026-04-08 07:41:07,813 - lava_callback - ERROR - Error processing callback for node 69d3638113dd9a9509896491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:41:28,376 - lava_callback - INFO - Received callback for node 69d363a113dd9a95098964d3 INFO: 172.20.0.1:60314 - "POST /node/69d363a113dd9a95098964d3 HTTP/1.0" 202 Accepted 2026-04-08 07:41:28,382 - lava_callback - INFO - Starting async job submit for node 69d363a113dd9a95098964d3 2026-04-08 07:41:28,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:28,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d363a113dd9a95098964d3 HTTP/1.1" 200 None 2026-04-08 07:41:28,398 - lava_callback - DEBUG - Processing node 69d363a113dd9a95098964d3: baseline-arm64-baylibre 2026-04-08 07:41:28,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d363a113dd9a95098964d3 2026-04-08 07:41:28,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d363a113dd9a95098964d3 HTTP/1.1" 200 None 2026-04-08 07:41:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:28,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:41:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:41:28,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d363a113dd9a95098964d3 HTTP/1.1" 200 None 2026-04-08 07:41:28,473 - lava_callback - ERROR - Error processing callback for node 69d363a113dd9a95098964d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46170 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:42:48,359 - lava_callback - INFO - Received callback for node 69d363e813dd9a95098964f6 INFO: 172.20.0.1:46178 - "POST /node/69d363e813dd9a95098964f6 HTTP/1.0" 202 Accepted 2026-04-08 07:42:48,366 - lava_callback - INFO - Starting async job submit for node 69d363e813dd9a95098964f6 2026-04-08 07:42:48,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:42:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d363e813dd9a95098964f6 HTTP/1.1" 200 None 2026-04-08 07:42:48,383 - lava_callback - DEBUG - Processing node 69d363e813dd9a95098964f6: baseline-arm64-baylibre 2026-04-08 07:42:48,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d363e813dd9a95098964f6 2026-04-08 07:42:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:42:48,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d363e813dd9a95098964f6 HTTP/1.1" 200 None 2026-04-08 07:42:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:42:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:42:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:42:48,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d363e813dd9a95098964f6 HTTP/1.1" 200 None 2026-04-08 07:42:48,438 - lava_callback - ERROR - Error processing callback for node 69d363e813dd9a95098964f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:43:48,473 - lava_callback - INFO - Received callback for node 69d3642413dd9a9509896506 INFO: 172.20.0.1:47598 - "POST /node/69d3642413dd9a9509896506 HTTP/1.0" 202 Accepted 2026-04-08 07:43:48,480 - lava_callback - INFO - Starting async job submit for node 69d3642413dd9a9509896506 2026-04-08 07:43:48,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:43:48,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3642413dd9a9509896506 HTTP/1.1" 200 None 2026-04-08 07:43:48,502 - lava_callback - DEBUG - Processing node 69d3642413dd9a9509896506: baseline-arm-baylibre 2026-04-08 07:43:48,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3642413dd9a9509896506 2026-04-08 07:43:48,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:43:48,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3642413dd9a9509896506 HTTP/1.1" 200 None 2026-04-08 07:43:48,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:43:48,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:43:48,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:43:48,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3642413dd9a9509896506 HTTP/1.1" 200 None 2026-04-08 07:43:48,567 - lava_callback - ERROR - Error processing callback for node 69d3642413dd9a9509896506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:44:28,505 - lava_callback - INFO - Received callback for node 69d3644c13dd9a950989654a INFO: 172.20.0.1:41406 - "POST /node/69d3644c13dd9a950989654a HTTP/1.0" 202 Accepted 2026-04-08 07:44:28,511 - lava_callback - INFO - Starting async job submit for node 69d3644c13dd9a950989654a 2026-04-08 07:44:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:44:28,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3644c13dd9a950989654a HTTP/1.1" 200 None 2026-04-08 07:44:28,532 - lava_callback - DEBUG - Processing node 69d3644c13dd9a950989654a: baseline-arm64-baylibre 2026-04-08 07:44:28,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3644c13dd9a950989654a 2026-04-08 07:44:28,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:44:28,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3644c13dd9a950989654a HTTP/1.1" 200 None 2026-04-08 07:44:28,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:44:28,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:44:28,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:44:28,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3644c13dd9a950989654a HTTP/1.1" 200 None 2026-04-08 07:44:28,613 - lava_callback - ERROR - Error processing callback for node 69d3644c13dd9a950989654a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:45:28,526 - lava_callback - INFO - Received callback for node 69d3648613dd9a9509896580 INFO: 172.20.0.1:57950 - "POST /node/69d3648613dd9a9509896580 HTTP/1.0" 202 Accepted 2026-04-08 07:45:28,532 - lava_callback - INFO - Starting async job submit for node 69d3648613dd9a9509896580 2026-04-08 07:45:28,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:28,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3648613dd9a9509896580 HTTP/1.1" 200 None 2026-04-08 07:45:28,548 - lava_callback - DEBUG - Processing node 69d3648613dd9a9509896580: baseline-arm-baylibre 2026-04-08 07:45:28,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3648613dd9a9509896580 2026-04-08 07:45:28,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:28,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3648613dd9a9509896580 HTTP/1.1" 200 None 2026-04-08 07:45:28,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:28,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:45:28,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:28,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3648613dd9a9509896580 HTTP/1.1" 200 None 2026-04-08 07:45:28,604 - lava_callback - ERROR - Error processing callback for node 69d3648613dd9a9509896580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60550 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:45:48,639 - lava_callback - INFO - Received callback for node 69d364a713dd9a950989659a INFO: 172.20.0.1:60564 - "POST /node/69d364a713dd9a950989659a HTTP/1.0" 202 Accepted 2026-04-08 07:45:48,648 - lava_callback - INFO - Starting async job submit for node 69d364a713dd9a950989659a 2026-04-08 07:45:48,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:48,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d364a713dd9a950989659a HTTP/1.1" 200 None 2026-04-08 07:45:48,665 - lava_callback - DEBUG - Processing node 69d364a713dd9a950989659a: baseline-arm-baylibre 2026-04-08 07:45:48,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d364a713dd9a950989659a 2026-04-08 07:45:48,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:48,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d364a713dd9a950989659a HTTP/1.1" 200 None 2026-04-08 07:45:48,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:48,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:45:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:45:48,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d364a713dd9a950989659a HTTP/1.1" 200 None 2026-04-08 07:45:48,729 - lava_callback - ERROR - Error processing callback for node 69d364a713dd9a950989659a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58816 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:46:48,629 - lava_callback - INFO - Received callback for node 69d364d413dd9a95098965ad INFO: 172.20.0.1:58818 - "POST /node/69d364d413dd9a95098965ad HTTP/1.0" 202 Accepted 2026-04-08 07:46:48,636 - lava_callback - INFO - Starting async job submit for node 69d364d413dd9a95098965ad 2026-04-08 07:46:48,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:46:48,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d364d413dd9a95098965ad HTTP/1.1" 200 None 2026-04-08 07:46:48,652 - lava_callback - DEBUG - Processing node 69d364d413dd9a95098965ad: baseline-arm64-baylibre 2026-04-08 07:46:48,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d364d413dd9a95098965ad 2026-04-08 07:46:48,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:46:48,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d364d413dd9a95098965ad HTTP/1.1" 200 None 2026-04-08 07:46:48,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:46:48,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:46:48,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:46:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d364d413dd9a95098965ad HTTP/1.1" 200 None 2026-04-08 07:46:48,744 - lava_callback - ERROR - Error processing callback for node 69d364d413dd9a95098965ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52756 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:47:28,689 - lava_callback - INFO - Received callback for node 69d3650e13dd9a95098965d3 INFO: 172.20.0.1:52770 - "POST /node/69d3650e13dd9a95098965d3 HTTP/1.0" 202 Accepted 2026-04-08 07:47:28,695 - lava_callback - INFO - Starting async job submit for node 69d3650e13dd9a95098965d3 2026-04-08 07:47:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:47:28,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3650e13dd9a95098965d3 HTTP/1.1" 200 None 2026-04-08 07:47:28,713 - lava_callback - DEBUG - Processing node 69d3650e13dd9a95098965d3: baseline-arm-baylibre 2026-04-08 07:47:28,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3650e13dd9a95098965d3 2026-04-08 07:47:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:47:28,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3650e13dd9a95098965d3 HTTP/1.1" 200 None 2026-04-08 07:47:28,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:47:28,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:47:28,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:47:28,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3650e13dd9a95098965d3 HTTP/1.1" 200 None 2026-04-08 07:47:28,773 - lava_callback - ERROR - Error processing callback for node 69d3650e13dd9a95098965d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:48:28,709 - lava_callback - INFO - Received callback for node 69d3653713dd9a9509896603 INFO: 172.20.0.1:48050 - "POST /node/69d3653713dd9a9509896603 HTTP/1.0" 202 Accepted 2026-04-08 07:48:28,715 - lava_callback - INFO - Starting async job submit for node 69d3653713dd9a9509896603 2026-04-08 07:48:28,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:48:28,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3653713dd9a9509896603 HTTP/1.1" 200 None 2026-04-08 07:48:28,730 - lava_callback - DEBUG - Processing node 69d3653713dd9a9509896603: baseline-arm64-baylibre 2026-04-08 07:48:28,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3653713dd9a9509896603 2026-04-08 07:48:28,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:48:28,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3653713dd9a9509896603 HTTP/1.1" 200 None 2026-04-08 07:48:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:48:28,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:48:28,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:48:28,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3653713dd9a9509896603 HTTP/1.1" 200 None 2026-04-08 07:48:28,797 - lava_callback - ERROR - Error processing callback for node 69d3653713dd9a9509896603: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40000 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:49:28,063 - lava_callback - INFO - Received callback for node 69d3657213dd9a9509896632 INFO: 172.20.0.1:40010 - "POST /node/69d3657213dd9a9509896632 HTTP/1.0" 202 Accepted 2026-04-08 07:49:28,070 - lava_callback - INFO - Starting async job submit for node 69d3657213dd9a9509896632 2026-04-08 07:49:28,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:28,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3657213dd9a9509896632 HTTP/1.1" 200 None 2026-04-08 07:49:28,115 - lava_callback - DEBUG - Processing node 69d3657213dd9a9509896632: baseline-arm-clabbe 2026-04-08 07:49:28,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3657213dd9a9509896632 2026-04-08 07:49:28,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:28,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3657213dd9a9509896632 HTTP/1.1" 200 None 2026-04-08 07:49:28,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:49:28,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:28,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3657213dd9a9509896632 HTTP/1.1" 200 None 2026-04-08 07:49:28,180 - lava_callback - ERROR - Error processing callback for node 69d3657213dd9a9509896632: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58782 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:49:48,041 - lava_callback - INFO - Received callback for node 69d3659313dd9a950989666c INFO: 172.20.0.1:58788 - "POST /node/69d3659313dd9a950989666c HTTP/1.0" 202 Accepted 2026-04-08 07:49:48,046 - lava_callback - INFO - Starting async job submit for node 69d3659313dd9a950989666c 2026-04-08 07:49:48,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:48,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3659313dd9a950989666c HTTP/1.1" 200 None 2026-04-08 07:49:48,072 - lava_callback - DEBUG - Processing node 69d3659313dd9a950989666c: baseline-arm-clabbe 2026-04-08 07:49:48,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3659313dd9a950989666c 2026-04-08 07:49:48,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:48,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3659313dd9a950989666c HTTP/1.1" 200 None 2026-04-08 07:49:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:48,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:49:48,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:49:48,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3659313dd9a950989666c HTTP/1.1" 200 None 2026-04-08 07:49:48,128 - lava_callback - ERROR - Error processing callback for node 69d3659313dd9a950989666c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:50:28,187 - lava_callback - INFO - Received callback for node 69d365b613dd9a950989667e INFO: 172.20.0.1:38660 - "POST /node/69d365b613dd9a950989667e HTTP/1.0" 202 Accepted 2026-04-08 07:50:28,196 - lava_callback - INFO - Starting async job submit for node 69d365b613dd9a950989667e 2026-04-08 07:50:28,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:50:28,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d365b613dd9a950989667e HTTP/1.1" 200 None 2026-04-08 07:50:28,219 - lava_callback - DEBUG - Processing node 69d365b613dd9a950989667e: baseline-arm-clabbe 2026-04-08 07:50:28,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d365b613dd9a950989667e 2026-04-08 07:50:28,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:50:28,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d365b613dd9a950989667e HTTP/1.1" 200 None 2026-04-08 07:50:28,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:50:28,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 07:50:28,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:50:28,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d365b613dd9a950989667e HTTP/1.1" 200 None 2026-04-08 07:50:28,276 - lava_callback - ERROR - Error processing callback for node 69d365b613dd9a950989667e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:51:08,114 - lava_callback - INFO - Received callback for node 69d365e713dd9a9509896693 INFO: 172.20.0.1:42464 - "POST /node/69d365e713dd9a9509896693 HTTP/1.0" 202 Accepted 2026-04-08 07:51:08,120 - lava_callback - INFO - Starting async job submit for node 69d365e713dd9a9509896693 2026-04-08 07:51:08,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:51:08,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d365e713dd9a9509896693 HTTP/1.1" 200 None 2026-04-08 07:51:08,136 - lava_callback - DEBUG - Processing node 69d365e713dd9a9509896693: baseline-arm64-clabbe 2026-04-08 07:51:08,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d365e713dd9a9509896693 2026-04-08 07:51:08,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:51:08,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d365e713dd9a9509896693 HTTP/1.1" 200 None 2026-04-08 07:51:08,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:51:08,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:51:08,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:51:08,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d365e713dd9a9509896693 HTTP/1.1" 200 None 2026-04-08 07:51:08,194 - lava_callback - ERROR - Error processing callback for node 69d365e713dd9a9509896693: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:52:08,997 - lava_callback - INFO - Received callback for node 69d3662313dd9a95098966d7 INFO: 172.20.0.1:48116 - "POST /node/69d3662313dd9a95098966d7 HTTP/1.0" 202 Accepted 2026-04-08 07:52:09,002 - lava_callback - INFO - Starting async job submit for node 69d3662313dd9a95098966d7 2026-04-08 07:52:09,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:52:09,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3662313dd9a95098966d7 HTTP/1.1" 200 None 2026-04-08 07:52:09,018 - lava_callback - DEBUG - Processing node 69d3662313dd9a95098966d7: baseline-arm64-baylibre 2026-04-08 07:52:09,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3662313dd9a95098966d7 2026-04-08 07:52:09,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:52:09,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3662313dd9a95098966d7 HTTP/1.1" 200 None 2026-04-08 07:52:09,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:52:09,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:52:09,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:52:09,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3662313dd9a95098966d7 HTTP/1.1" 200 None 2026-04-08 07:52:09,087 - lava_callback - ERROR - Error processing callback for node 69d3662313dd9a95098966d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:53:28,214 - lava_callback - INFO - Received callback for node 69d3666e13dd9a9509896726 INFO: 172.20.0.1:50918 - "POST /node/69d3666e13dd9a9509896726 HTTP/1.0" 202 Accepted 2026-04-08 07:53:28,226 - lava_callback - INFO - Starting async job submit for node 69d3666e13dd9a9509896726 2026-04-08 07:53:28,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:53:28,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3666e13dd9a9509896726 HTTP/1.1" 200 None 2026-04-08 07:53:28,248 - lava_callback - DEBUG - Processing node 69d3666e13dd9a9509896726: baseline-arm64-clabbe 2026-04-08 07:53:28,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3666e13dd9a9509896726 2026-04-08 07:53:28,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:53:28,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3666e13dd9a9509896726 HTTP/1.1" 200 None 2026-04-08 07:53:28,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:53:28,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:53:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:53:28,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3666e13dd9a9509896726 HTTP/1.1" 200 None 2026-04-08 07:53:28,320 - lava_callback - ERROR - Error processing callback for node 69d3666e13dd9a9509896726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:54:48,284 - lava_callback - INFO - Received callback for node 69d366b213dd9a9509896763 INFO: 172.20.0.1:34876 - "POST /node/69d366b213dd9a9509896763 HTTP/1.0" 202 Accepted 2026-04-08 07:54:48,290 - lava_callback - INFO - Starting async job submit for node 69d366b213dd9a9509896763 2026-04-08 07:54:48,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:54:48,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d366b213dd9a9509896763 HTTP/1.1" 200 None 2026-04-08 07:54:48,313 - lava_callback - DEBUG - Processing node 69d366b213dd9a9509896763: baseline-arm64-clabbe 2026-04-08 07:54:48,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d366b213dd9a9509896763 2026-04-08 07:54:48,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:54:48,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d366b213dd9a9509896763 HTTP/1.1" 200 None 2026-04-08 07:54:48,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:54:48,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:54:48,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:54:48,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d366b213dd9a9509896763 HTTP/1.1" 200 None 2026-04-08 07:54:48,382 - lava_callback - ERROR - Error processing callback for node 69d366b213dd9a9509896763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34588 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:55:49,232 - lava_callback - INFO - Received callback for node 69d366f013dd9a950989679f INFO: 172.20.0.1:34604 - "POST /node/69d366f013dd9a950989679f HTTP/1.0" 202 Accepted 2026-04-08 07:55:49,237 - lava_callback - INFO - Starting async job submit for node 69d366f013dd9a950989679f 2026-04-08 07:55:49,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:55:49,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d366f013dd9a950989679f HTTP/1.1" 200 None 2026-04-08 07:55:49,264 - lava_callback - DEBUG - Processing node 69d366f013dd9a950989679f: baseline-arm64-baylibre 2026-04-08 07:55:49,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d366f013dd9a950989679f 2026-04-08 07:55:49,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:55:49,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d366f013dd9a950989679f HTTP/1.1" 200 None 2026-04-08 07:55:49,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:55:49,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:55:49,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:55:49,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d366f013dd9a950989679f HTTP/1.1" 200 None 2026-04-08 07:55:49,372 - lava_callback - ERROR - Error processing callback for node 69d366f013dd9a950989679f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:57:08,384 - lava_callback - INFO - Received callback for node 69d3674113dd9a95098967c2 INFO: 172.20.0.1:55816 - "POST /node/69d3674113dd9a95098967c2 HTTP/1.0" 202 Accepted 2026-04-08 07:57:08,389 - lava_callback - INFO - Starting async job submit for node 69d3674113dd9a95098967c2 2026-04-08 07:57:08,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:57:08,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3674113dd9a95098967c2 HTTP/1.1" 200 None 2026-04-08 07:57:08,415 - lava_callback - DEBUG - Processing node 69d3674113dd9a95098967c2: baseline-arm64-clabbe 2026-04-08 07:57:08,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3674113dd9a95098967c2 2026-04-08 07:57:08,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:57:08,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3674113dd9a95098967c2 HTTP/1.1" 200 None 2026-04-08 07:57:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:57:08,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:57:08,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:57:08,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3674113dd9a95098967c2 HTTP/1.1" 200 None 2026-04-08 07:57:08,470 - lava_callback - ERROR - Error processing callback for node 69d3674113dd9a95098967c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:58:09,259 - lava_callback - INFO - Received callback for node 69d3678213dd9a95098967ea INFO: 172.20.0.1:40182 - "POST /node/69d3678213dd9a95098967ea HTTP/1.0" 202 Accepted 2026-04-08 07:58:09,265 - lava_callback - INFO - Starting async job submit for node 69d3678213dd9a95098967ea 2026-04-08 07:58:09,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:58:09,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3678213dd9a95098967ea HTTP/1.1" 200 None 2026-04-08 07:58:09,291 - lava_callback - DEBUG - Processing node 69d3678213dd9a95098967ea: baseline-arm64-baylibre 2026-04-08 07:58:09,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3678213dd9a95098967ea 2026-04-08 07:58:09,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:58:09,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3678213dd9a95098967ea HTTP/1.1" 200 None 2026-04-08 07:58:09,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:58:09,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:58:09,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:58:09,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3678213dd9a95098967ea HTTP/1.1" 200 None 2026-04-08 07:58:09,346 - lava_callback - ERROR - Error processing callback for node 69d3678213dd9a95098967ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK 2026-04-08 07:59:28,432 - lava_callback - INFO - Received callback for node 69d367cf13dd9a9509896821 INFO: 172.20.0.1:54140 - "POST /node/69d367cf13dd9a9509896821 HTTP/1.0" 202 Accepted 2026-04-08 07:59:28,438 - lava_callback - INFO - Starting async job submit for node 69d367cf13dd9a9509896821 2026-04-08 07:59:28,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:59:28,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d367cf13dd9a9509896821 HTTP/1.1" 200 None 2026-04-08 07:59:28,464 - lava_callback - DEBUG - Processing node 69d367cf13dd9a9509896821: baseline-arm64-clabbe 2026-04-08 07:59:28,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d367cf13dd9a9509896821 2026-04-08 07:59:28,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:59:28,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d367cf13dd9a9509896821 HTTP/1.1" 200 None 2026-04-08 07:59:28,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:59:28,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 07:59:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 07:59:28,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d367cf13dd9a9509896821 HTTP/1.1" 200 None 2026-04-08 07:59:28,527 - lava_callback - ERROR - Error processing callback for node 69d367cf13dd9a9509896821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:00:29,366 - lava_callback - INFO - Received callback for node 69d3681113dd9a950989684c INFO: 172.20.0.1:40238 - "POST /node/69d3681113dd9a950989684c HTTP/1.0" 202 Accepted 2026-04-08 08:00:29,373 - lava_callback - INFO - Starting async job submit for node 69d3681113dd9a950989684c 2026-04-08 08:00:29,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:00:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3681113dd9a950989684c HTTP/1.1" 200 None 2026-04-08 08:00:29,388 - lava_callback - DEBUG - Processing node 69d3681113dd9a950989684c: baseline-arm64-baylibre 2026-04-08 08:00:29,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3681113dd9a950989684c 2026-04-08 08:00:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:00:29,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3681113dd9a950989684c HTTP/1.1" 200 None 2026-04-08 08:00:29,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:00:29,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:00:29,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:00:29,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3681113dd9a950989684c HTTP/1.1" 200 None 2026-04-08 08:00:29,448 - lava_callback - ERROR - Error processing callback for node 69d3681113dd9a950989684c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:01:48,584 - lava_callback - INFO - Received callback for node 69d3685613dd9a950989689d INFO: 172.20.0.1:39018 - "POST /node/69d3685613dd9a950989689d HTTP/1.0" 202 Accepted 2026-04-08 08:01:48,590 - lava_callback - INFO - Starting async job submit for node 69d3685613dd9a950989689d 2026-04-08 08:01:48,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:01:48,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3685613dd9a950989689d HTTP/1.1" 200 None 2026-04-08 08:01:48,606 - lava_callback - DEBUG - Processing node 69d3685613dd9a950989689d: baseline-arm64-clabbe 2026-04-08 08:01:48,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3685613dd9a950989689d 2026-04-08 08:01:48,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:01:48,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3685613dd9a950989689d HTTP/1.1" 200 None 2026-04-08 08:01:48,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:01:48,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:01:48,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:01:48,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3685613dd9a950989689d HTTP/1.1" 200 None 2026-04-08 08:01:48,664 - lava_callback - ERROR - Error processing callback for node 69d3685613dd9a950989689d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55266 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:02:49,580 - lava_callback - INFO - Received callback for node 69d3689613dd9a95098968d3 INFO: 172.20.0.1:55270 - "POST /node/69d3689613dd9a95098968d3 HTTP/1.0" 202 Accepted 2026-04-08 08:02:49,586 - lava_callback - INFO - Starting async job submit for node 69d3689613dd9a95098968d3 2026-04-08 08:02:49,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:02:49,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3689613dd9a95098968d3 HTTP/1.1" 200 None 2026-04-08 08:02:49,603 - lava_callback - DEBUG - Processing node 69d3689613dd9a95098968d3: baseline-arm64-baylibre 2026-04-08 08:02:49,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3689613dd9a95098968d3 2026-04-08 08:02:49,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:02:49,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3689613dd9a95098968d3 HTTP/1.1" 200 None 2026-04-08 08:02:49,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:02:49,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:02:49,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:02:49,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3689613dd9a95098968d3 HTTP/1.1" 200 None 2026-04-08 08:02:49,658 - lava_callback - ERROR - Error processing callback for node 69d3689613dd9a95098968d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:03:48,681 - lava_callback - INFO - Received callback for node 69d368d413dd9a95098968f8 INFO: 172.20.0.1:44538 - "POST /node/69d368d413dd9a95098968f8 HTTP/1.0" 202 Accepted 2026-04-08 08:03:48,687 - lava_callback - INFO - Starting async job submit for node 69d368d413dd9a95098968f8 2026-04-08 08:03:48,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:03:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d368d413dd9a95098968f8 HTTP/1.1" 200 None 2026-04-08 08:03:48,706 - lava_callback - DEBUG - Processing node 69d368d413dd9a95098968f8: baseline-arm-clabbe 2026-04-08 08:03:48,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d368d413dd9a95098968f8 2026-04-08 08:03:48,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:03:48,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d368d413dd9a95098968f8 HTTP/1.1" 200 None 2026-04-08 08:03:48,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:03:48,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 08:03:48,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:03:48,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d368d413dd9a95098968f8 HTTP/1.1" 200 None 2026-04-08 08:03:48,769 - lava_callback - ERROR - Error processing callback for node 69d368d413dd9a95098968f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:04:28,674 - lava_callback - INFO - Received callback for node 69d3690613dd9a950989691e INFO: 172.20.0.1:43468 - "POST /node/69d3690613dd9a950989691e HTTP/1.0" 202 Accepted 2026-04-08 08:04:28,679 - lava_callback - INFO - Starting async job submit for node 69d3690613dd9a950989691e 2026-04-08 08:04:28,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:04:28,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3690613dd9a950989691e HTTP/1.1" 200 None 2026-04-08 08:04:28,695 - lava_callback - DEBUG - Processing node 69d3690613dd9a950989691e: baseline-arm64-clabbe 2026-04-08 08:04:28,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3690613dd9a950989691e 2026-04-08 08:04:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:04:28,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3690613dd9a950989691e HTTP/1.1" 200 None 2026-04-08 08:04:28,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:04:28,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:04:28,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:04:28,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3690613dd9a950989691e HTTP/1.1" 200 None 2026-04-08 08:04:28,750 - lava_callback - ERROR - Error processing callback for node 69d3690613dd9a950989691e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:05:28,744 - lava_callback - INFO - Received callback for node 69d3693d13dd9a9509896954 INFO: 172.20.0.1:42706 - "POST /node/69d3693d13dd9a9509896954 HTTP/1.0" 202 Accepted 2026-04-08 08:05:28,752 - lava_callback - INFO - Starting async job submit for node 69d3693d13dd9a9509896954 2026-04-08 08:05:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:05:28,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3693d13dd9a9509896954 HTTP/1.1" 200 None 2026-04-08 08:05:28,773 - lava_callback - DEBUG - Processing node 69d3693d13dd9a9509896954: baseline-arm-clabbe 2026-04-08 08:05:28,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3693d13dd9a9509896954 2026-04-08 08:05:28,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:05:28,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3693d13dd9a9509896954 HTTP/1.1" 200 None 2026-04-08 08:05:28,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:05:28,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 08:05:28,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:05:28,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3693d13dd9a9509896954 HTTP/1.1" 200 None 2026-04-08 08:05:28,835 - lava_callback - ERROR - Error processing callback for node 69d3693d13dd9a9509896954: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:06:28,797 - lava_callback - INFO - Received callback for node 69d3696f13dd9a950989695e INFO: 172.20.0.1:42458 - "POST /node/69d3696f13dd9a950989695e HTTP/1.0" 202 Accepted 2026-04-08 08:06:28,806 - lava_callback - INFO - Starting async job submit for node 69d3696f13dd9a950989695e 2026-04-08 08:06:28,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:06:28,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3696f13dd9a950989695e HTTP/1.1" 200 None 2026-04-08 08:06:28,823 - lava_callback - DEBUG - Processing node 69d3696f13dd9a950989695e: baseline-arm64-clabbe 2026-04-08 08:06:28,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d3696f13dd9a950989695e 2026-04-08 08:06:28,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:06:28,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3696f13dd9a950989695e HTTP/1.1" 200 None 2026-04-08 08:06:28,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:06:28,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:06:28,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:06:28,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3696f13dd9a950989695e HTTP/1.1" 200 None 2026-04-08 08:06:28,886 - lava_callback - ERROR - Error processing callback for node 69d3696f13dd9a950989695e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:07:08,767 - lava_callback - INFO - Received callback for node 69d369a813dd9a9509896971 INFO: 172.20.0.1:57462 - "POST /node/69d369a813dd9a9509896971 HTTP/1.0" 202 Accepted 2026-04-08 08:07:08,773 - lava_callback - INFO - Starting async job submit for node 69d369a813dd9a9509896971 2026-04-08 08:07:08,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:08,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369a813dd9a9509896971 HTTP/1.1" 200 None 2026-04-08 08:07:08,816 - lava_callback - DEBUG - Processing node 69d369a813dd9a9509896971: baseline-arm-clabbe 2026-04-08 08:07:08,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d369a813dd9a9509896971 2026-04-08 08:07:08,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:08,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369a813dd9a9509896971 HTTP/1.1" 200 None 2026-04-08 08:07:08,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:08,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 08:07:08,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:08,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d369a813dd9a9509896971 HTTP/1.1" 200 None 2026-04-08 08:07:08,875 - lava_callback - ERROR - Error processing callback for node 69d369a813dd9a9509896971: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:07:48,834 - lava_callback - INFO - Received callback for node 69d369c813dd9a950989698d INFO: 172.20.0.1:36114 - "POST /node/69d369c813dd9a950989698d HTTP/1.0" 202 Accepted 2026-04-08 08:07:48,840 - lava_callback - INFO - Starting async job submit for node 69d369c813dd9a950989698d 2026-04-08 08:07:48,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:48,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369c813dd9a950989698d HTTP/1.1" 200 None 2026-04-08 08:07:48,856 - lava_callback - DEBUG - Processing node 69d369c813dd9a950989698d: baseline-arm-clabbe 2026-04-08 08:07:48,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d369c813dd9a950989698d 2026-04-08 08:07:48,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:48,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369c813dd9a950989698d HTTP/1.1" 200 None 2026-04-08 08:07:48,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 08:07:48,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:07:48,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d369c813dd9a950989698d HTTP/1.1" 200 None 2026-04-08 08:07:48,925 - lava_callback - ERROR - Error processing callback for node 69d369c813dd9a950989698d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50260 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:08:28,853 - lava_callback - INFO - Received callback for node 69d369f713dd9a95098969dd INFO: 172.20.0.1:50270 - "POST /node/69d369f713dd9a95098969dd HTTP/1.0" 202 Accepted 2026-04-08 08:08:28,862 - lava_callback - INFO - Starting async job submit for node 69d369f713dd9a95098969dd 2026-04-08 08:08:28,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:08:28,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369f713dd9a95098969dd HTTP/1.1" 200 None 2026-04-08 08:08:28,880 - lava_callback - DEBUG - Processing node 69d369f713dd9a95098969dd: baseline-arm64-clabbe 2026-04-08 08:08:28,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d369f713dd9a95098969dd 2026-04-08 08:08:28,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:08:28,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d369f713dd9a95098969dd HTTP/1.1" 200 None 2026-04-08 08:08:28,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:08:28,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:08:28,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:08:28,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d369f713dd9a95098969dd HTTP/1.1" 200 None 2026-04-08 08:08:28,938 - lava_callback - ERROR - Error processing callback for node 69d369f713dd9a95098969dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:09:48,928 - lava_callback - INFO - Received callback for node 69d36a3d13dd9a9509896a0a INFO: 172.20.0.1:52818 - "POST /node/69d36a3d13dd9a9509896a0a HTTP/1.0" 202 Accepted 2026-04-08 08:09:48,934 - lava_callback - INFO - Starting async job submit for node 69d36a3d13dd9a9509896a0a 2026-04-08 08:09:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:09:48,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36a3d13dd9a9509896a0a HTTP/1.1" 200 None 2026-04-08 08:09:48,949 - lava_callback - DEBUG - Processing node 69d36a3d13dd9a9509896a0a: baseline-arm64-clabbe 2026-04-08 08:09:48,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d36a3d13dd9a9509896a0a 2026-04-08 08:09:48,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:09:48,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36a3d13dd9a9509896a0a HTTP/1.1" 200 None 2026-04-08 08:09:48,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:09:49,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:09:49,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:09:49,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d36a3d13dd9a9509896a0a HTTP/1.1" 200 None 2026-04-08 08:09:49,029 - lava_callback - ERROR - Error processing callback for node 69d36a3d13dd9a9509896a0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:10:48,984 - lava_callback - INFO - Received callback for node 69d36a8313dd9a9509896a56 INFO: 172.20.0.1:60088 - "POST /node/69d36a8313dd9a9509896a56 HTTP/1.0" 202 Accepted 2026-04-08 08:10:48,992 - lava_callback - INFO - Starting async job submit for node 69d36a8313dd9a9509896a56 2026-04-08 08:10:48,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:10:49,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36a8313dd9a9509896a56 HTTP/1.1" 200 None 2026-04-08 08:10:49,016 - lava_callback - DEBUG - Processing node 69d36a8313dd9a9509896a56: baseline-arm64-clabbe 2026-04-08 08:10:49,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d36a8313dd9a9509896a56 2026-04-08 08:10:49,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:10:49,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36a8313dd9a9509896a56 HTTP/1.1" 200 None 2026-04-08 08:10:49,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:10:49,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:10:49,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:10:49,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d36a8313dd9a9509896a56 HTTP/1.1" 200 None 2026-04-08 08:10:49,077 - lava_callback - ERROR - Error processing callback for node 69d36a8313dd9a9509896a56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:12:09,025 - lava_callback - INFO - Received callback for node 69d36ac913dd9a9509896a89 INFO: 172.20.0.1:41456 - "POST /node/69d36ac913dd9a9509896a89 HTTP/1.0" 202 Accepted 2026-04-08 08:12:09,034 - lava_callback - INFO - Starting async job submit for node 69d36ac913dd9a9509896a89 2026-04-08 08:12:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:09,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36ac913dd9a9509896a89 HTTP/1.1" 200 None 2026-04-08 08:12:09,057 - lava_callback - DEBUG - Processing node 69d36ac913dd9a9509896a89: baseline-arm64-clabbe 2026-04-08 08:12:09,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d36ac913dd9a9509896a89 2026-04-08 08:12:09,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36ac913dd9a9509896a89 HTTP/1.1" 200 None 2026-04-08 08:12:09,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:09,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-08 08:12:09,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:09,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d36ac913dd9a9509896a89 HTTP/1.1" 200 None 2026-04-08 08:12:09,136 - lava_callback - ERROR - Error processing callback for node 69d36ac913dd9a9509896a89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55262 - "GET / HTTP/1.0" 200 OK 2026-04-08 08:12:49,003 - lava_callback - INFO - Received callback for node 69d36afc13dd9a9509896ade INFO: 172.20.0.1:55272 - "POST /node/69d36afc13dd9a9509896ade HTTP/1.0" 202 Accepted 2026-04-08 08:12:49,008 - lava_callback - INFO - Starting async job submit for node 69d36afc13dd9a9509896ade 2026-04-08 08:12:49,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:49,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36afc13dd9a9509896ade HTTP/1.1" 200 None 2026-04-08 08:12:49,024 - lava_callback - DEBUG - Processing node 69d36afc13dd9a9509896ade: baseline-arm-clabbe 2026-04-08 08:12:49,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d36afc13dd9a9509896ade 2026-04-08 08:12:49,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:49,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36afc13dd9a9509896ade HTTP/1.1" 200 None 2026-04-08 08:12:49,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-08 08:12:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-08 08:12:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d36afc13dd9a9509896ade HTTP/1.1" 200 None 2026-04-08 08:12:49,093 - lava_callback - ERROR - Error processing callback for node 69d36afc13dd9a9509896ade: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]