INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48602 - "GET /node/693e5b51407f32424eb643a2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET /node/69407c2d575bc060ce15bcfc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET /node/69555fb2fbdac0e1a7b167fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET /node/694ddce98177197a294f080e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:35:54,068 - lava_callback - INFO - Received callback for node 69e8f8678327522856dac28e 2026-04-22 16:35:54,082 - lava_callback - INFO - Starting async job submit for node 69e8f8678327522856dac28e INFO: 172.20.0.1:45406 - "POST /node/69e8f8678327522856dac28e HTTP/1.0" 202 Accepted 2026-04-22 16:35:54,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:35:54,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f8678327522856dac28e HTTP/1.1" 200 None 2026-04-22 16:35:54,168 - lava_callback - DEBUG - Processing node 69e8f8678327522856dac28e: baseline-arm 2026-04-22 16:35:54,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:35:54,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:35:54,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f8678327522856dac28e/log.txt.gz 2026-04-22 16:35:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:35:55,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:35:55,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f8678327522856dac28e/lava-logs.yaml 2026-04-22 16:35:55,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:35:55,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:35:55,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f8678327522856dac28e/lava_callback.json.gz 2026-04-22 16:35:55,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:35:55,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f8678327522856dac28e HTTP/1.1" 200 None 2026-04-22 16:35:55,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:35:55,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4cc8327522856dac252 HTTP/1.1" 200 None 2026-04-22 16:35:55,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:35:55,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f8678327522856dac28e HTTP/1.1" 200 None 2026-04-22 16:35:55,525 - lava_callback - INFO - Completed processing callback for node 69e8f8678327522856dac28e INFO: 172.20.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55076 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:36:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:36:25,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57788 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:40:14,440 - lava_callback - INFO - Received callback for node 69e8f9e58327522856dae997 INFO: 172.20.0.1:57314 - "POST /node/69e8f9e58327522856dae997 HTTP/1.0" 202 Accepted 2026-04-22 16:40:14,447 - lava_callback - INFO - Starting async job submit for node 69e8f9e58327522856dae997 2026-04-22 16:40:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:14,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e58327522856dae997 HTTP/1.1" 200 None 2026-04-22 16:40:14,480 - lava_callback - DEBUG - Processing node 69e8f9e58327522856dae997: baseline-arm 2026-04-22 16:40:14,486 - lava_callback - WARNING - Failed to upload log 2026-04-22 16:40:14,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:14,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:14,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e58327522856dae997/lava-logs.yaml 2026-04-22 16:40:14,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:14,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:14,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e58327522856dae997/lava_callback.json.gz 2026-04-22 16:40:14,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:14,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e58327522856dae997 HTTP/1.1" 200 None 2026-04-22 16:40:14,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:14,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:40:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e58327522856dae997 HTTP/1.1" 200 None 2026-04-22 16:40:14,807 - lava_callback - INFO - Completed processing callback for node 69e8f9e58327522856dae997 INFO: 172.20.0.1:57324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57332 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:40:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:25,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58764 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:40:33,314 - lava_callback - INFO - Received callback for node 69e8f9ef8327522856dae9b1 INFO: 172.20.0.1:35166 - "POST /node/69e8f9ef8327522856dae9b1 HTTP/1.0" 202 Accepted 2026-04-22 16:40:33,320 - lava_callback - INFO - Starting async job submit for node 69e8f9ef8327522856dae9b1 2026-04-22 16:40:33,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:33,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9ef8327522856dae9b1 HTTP/1.1" 200 None 2026-04-22 16:40:33,343 - lava_callback - DEBUG - Processing node 69e8f9ef8327522856dae9b1: baseline-arm 2026-04-22 16:40:33,348 - lava_callback - WARNING - Failed to upload log 2026-04-22 16:40:33,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:33,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:33,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9ef8327522856dae9b1/lava-logs.yaml 2026-04-22 16:40:33,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:33,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:33,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9ef8327522856dae9b1/lava_callback.json.gz 2026-04-22 16:40:33,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:33,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9ef8327522856dae9b1 HTTP/1.1" 200 None 2026-04-22 16:40:33,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:33,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:40:33,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:33,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9ef8327522856dae9b1 HTTP/1.1" 200 None 2026-04-22 16:40:33,587 - lava_callback - INFO - Completed processing callback for node 69e8f9ef8327522856dae9b1 INFO: 172.20.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32858 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:40:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:55,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54712 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:40:57,023 - lava_callback - INFO - Received callback for node 69e8f9e98327522856dae9a3 INFO: 172.20.0.1:54724 - "POST /node/69e8f9e98327522856dae9a3 HTTP/1.0" 202 Accepted 2026-04-22 16:40:57,070 - lava_callback - INFO - Starting async job submit for node 69e8f9e98327522856dae9a3 2026-04-22 16:40:57,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:57,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e98327522856dae9a3 HTTP/1.1" 200 None 2026-04-22 16:40:57,105 - lava_callback - DEBUG - Processing node 69e8f9e98327522856dae9a3: baseline-arm 2026-04-22 16:40:57,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:57,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:57,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e98327522856dae9a3/log.txt.gz 2026-04-22 16:40:57,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:57,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:57,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e98327522856dae9a3/lava-logs.yaml 2026-04-22 16:40:57,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:40:57,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:40:57,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e98327522856dae9a3/lava_callback.json.gz 2026-04-22 16:40:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:57,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e98327522856dae9a3 HTTP/1.1" 200 None 2026-04-22 16:40:57,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:57,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:40:57,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:40:57,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e98327522856dae9a3 HTTP/1.1" 200 None 2026-04-22 16:40:57,775 - lava_callback - INFO - Completed processing callback for node 69e8f9e98327522856dae9a3 2026-04-22 16:41:00,166 - lava_callback - INFO - Received callback for node 69e8f9e68327522856dae99a INFO: 172.20.0.1:37680 - "POST /node/69e8f9e68327522856dae99a HTTP/1.0" 202 Accepted 2026-04-22 16:41:00,215 - lava_callback - INFO - Starting async job submit for node 69e8f9e68327522856dae99a 2026-04-22 16:41:00,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:00,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e68327522856dae99a HTTP/1.1" 200 None 2026-04-22 16:41:00,260 - lava_callback - DEBUG - Processing node 69e8f9e68327522856dae99a: baseline-arm 2026-04-22 16:41:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:00,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:00,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e68327522856dae99a/log.txt.gz 2026-04-22 16:41:00,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:00,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:00,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e68327522856dae99a/lava-logs.yaml 2026-04-22 16:41:00,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:00,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:00,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e68327522856dae99a/lava_callback.json.gz 2026-04-22 16:41:00,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:00,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e68327522856dae99a HTTP/1.1" 200 None 2026-04-22 16:41:00,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:00,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:00,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:00,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e68327522856dae99a HTTP/1.1" 200 None 2026-04-22 16:41:00,985 - lava_callback - INFO - Completed processing callback for node 69e8f9e68327522856dae99a INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:41:23,164 - lava_callback - INFO - Received callback for node 69e8f9e48327522856dae994 INFO: 172.20.0.1:48552 - "POST /node/69e8f9e48327522856dae994 HTTP/1.0" 202 Accepted 2026-04-22 16:41:23,171 - lava_callback - INFO - Starting async job submit for node 69e8f9e48327522856dae994 2026-04-22 16:41:23,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:23,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e48327522856dae994 HTTP/1.1" 200 None 2026-04-22 16:41:23,210 - lava_callback - DEBUG - Processing node 69e8f9e48327522856dae994: baseline-arm 2026-04-22 16:41:23,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:23,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:23,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e48327522856dae994/log.txt.gz 2026-04-22 16:41:23,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:23,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:23,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e48327522856dae994/lava-logs.yaml 2026-04-22 16:41:23,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:23,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:24,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e48327522856dae994/lava_callback.json.gz 2026-04-22 16:41:24,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:24,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e48327522856dae994 HTTP/1.1" 200 None 2026-04-22 16:41:24,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:24,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:24,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:24,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e48327522856dae994 HTTP/1.1" 200 None 2026-04-22 16:41:24,081 - lava_callback - INFO - Completed processing callback for node 69e8f9e48327522856dae994 2026-04-22 16:41:25,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:25,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:41:31,508 - lava_callback - INFO - Received callback for node 69e8fa0b8327522856daea22 INFO: 172.20.0.1:39754 - "POST /node/69e8fa0b8327522856daea22 HTTP/1.0" 202 Accepted 2026-04-22 16:41:31,562 - lava_callback - INFO - Starting async job submit for node 69e8fa0b8327522856daea22 2026-04-22 16:41:31,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:31,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa0b8327522856daea22 HTTP/1.1" 200 None 2026-04-22 16:41:31,605 - lava_callback - DEBUG - Processing node 69e8fa0b8327522856daea22: baseline-arm-pengutronix 2026-04-22 16:41:31,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:31,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:31,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0b8327522856daea22/log.txt.gz 2026-04-22 16:41:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:32,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:32,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0b8327522856daea22/lava-logs.yaml 2026-04-22 16:41:32,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:32,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:32,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0b8327522856daea22/lava_callback.json.gz 2026-04-22 16:41:32,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:32,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa0b8327522856daea22 HTTP/1.1" 200 None 2026-04-22 16:41:32,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:32,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:32,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:32,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa0b8327522856daea22 HTTP/1.1" 200 None 2026-04-22 16:41:32,257 - lava_callback - INFO - Completed processing callback for node 69e8fa0b8327522856daea22 2026-04-22 16:41:36,006 - lava_callback - INFO - Received callback for node 69e8f9e88327522856dae9a0 INFO: 172.20.0.1:39760 - "POST /node/69e8f9e88327522856dae9a0 HTTP/1.0" 202 Accepted 2026-04-22 16:41:36,016 - lava_callback - INFO - Starting async job submit for node 69e8f9e88327522856dae9a0 2026-04-22 16:41:36,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:36,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e88327522856dae9a0 HTTP/1.1" 200 None 2026-04-22 16:41:36,058 - lava_callback - DEBUG - Processing node 69e8f9e88327522856dae9a0: baseline-arm 2026-04-22 16:41:36,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:36,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:36,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e88327522856dae9a0/log.txt.gz INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:41:36,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:36,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:36,685 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e88327522856dae9a0/lava-logs.yaml 2026-04-22 16:41:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:36,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:36,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e88327522856dae9a0/lava_callback.json.gz 2026-04-22 16:41:36,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:36,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e88327522856dae9a0 HTTP/1.1" 200 None 2026-04-22 16:41:36,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:36,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:36,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:36,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e88327522856dae9a0 HTTP/1.1" 200 None 2026-04-22 16:41:36,920 - lava_callback - INFO - Completed processing callback for node 69e8f9e88327522856dae9a0 2026-04-22 16:41:37,429 - lava_callback - INFO - Received callback for node 69e8fa098327522856daea1c INFO: 172.20.0.1:39778 - "POST /node/69e8fa098327522856daea1c HTTP/1.0" 202 Accepted 2026-04-22 16:41:37,435 - lava_callback - INFO - Starting async job submit for node 69e8fa098327522856daea1c 2026-04-22 16:41:37,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:37,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa098327522856daea1c HTTP/1.1" 200 None 2026-04-22 16:41:37,476 - lava_callback - DEBUG - Processing node 69e8fa098327522856daea1c: baseline-arm-pengutronix 2026-04-22 16:41:37,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:37,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:37,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa098327522856daea1c/log.txt.gz 2026-04-22 16:41:37,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:38,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:38,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa098327522856daea1c/lava-logs.yaml 2026-04-22 16:41:38,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:38,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:38,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa098327522856daea1c/lava_callback.json.gz 2026-04-22 16:41:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:38,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa098327522856daea1c HTTP/1.1" 200 None 2026-04-22 16:41:38,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:38,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:38,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:38,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa098327522856daea1c HTTP/1.1" 200 None 2026-04-22 16:41:38,250 - lava_callback - INFO - Completed processing callback for node 69e8fa098327522856daea1c 2026-04-22 16:41:39,257 - lava_callback - INFO - Received callback for node 69e8fa078327522856daea19 INFO: 172.20.0.1:39784 - "POST /node/69e8fa078327522856daea19 HTTP/1.0" 202 Accepted 2026-04-22 16:41:39,264 - lava_callback - INFO - Starting async job submit for node 69e8fa078327522856daea19 2026-04-22 16:41:39,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa078327522856daea19 HTTP/1.1" 200 None 2026-04-22 16:41:39,304 - lava_callback - DEBUG - Processing node 69e8fa078327522856daea19: baseline-arm-pengutronix 2026-04-22 16:41:39,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:39,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:39,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa078327522856daea19/log.txt.gz 2026-04-22 16:41:39,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:39,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:39,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa078327522856daea19/lava-logs.yaml 2026-04-22 16:41:39,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:41:39,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:41:39,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa078327522856daea19/lava_callback.json.gz 2026-04-22 16:41:39,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:39,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa078327522856daea19 HTTP/1.1" 200 None 2026-04-22 16:41:39,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:39,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:41:39,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:40,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa078327522856daea19 HTTP/1.1" 200 None 2026-04-22 16:41:40,005 - lava_callback - INFO - Completed processing callback for node 69e8fa078327522856daea19 INFO: 172.20.0.1:54178 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:41:55,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:41:55,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60080 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:42:03,594 - lava_callback - INFO - Received callback for node 69e8fa048327522856daea0b INFO: 172.20.0.1:34200 - "POST /node/69e8fa048327522856daea0b HTTP/1.0" 202 Accepted 2026-04-22 16:42:03,601 - lava_callback - INFO - Starting async job submit for node 69e8fa048327522856daea0b 2026-04-22 16:42:03,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:03,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa048327522856daea0b HTTP/1.1" 200 None 2026-04-22 16:42:03,662 - lava_callback - DEBUG - Processing node 69e8fa048327522856daea0b: baseline-arm-kontron 2026-04-22 16:42:03,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:03,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:03,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa048327522856daea0b/log.txt.gz 2026-04-22 16:42:04,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:04,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:04,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa048327522856daea0b/lava-logs.yaml 2026-04-22 16:42:04,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:04,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:04,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa048327522856daea0b/lava_callback.json.gz 2026-04-22 16:42:04,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:04,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa048327522856daea0b HTTP/1.1" 200 None 2026-04-22 16:42:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:04,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:04,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:04,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa048327522856daea0b HTTP/1.1" 200 None 2026-04-22 16:42:04,497 - lava_callback - INFO - Completed processing callback for node 69e8fa048327522856daea0b 2026-04-22 16:42:05,099 - lava_callback - INFO - Received callback for node 69e8fa058327522856daea0e INFO: 172.20.0.1:34208 - "POST /node/69e8fa058327522856daea0e HTTP/1.0" 202 Accepted 2026-04-22 16:42:05,106 - lava_callback - INFO - Starting async job submit for node 69e8fa058327522856daea0e 2026-04-22 16:42:05,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:05,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa058327522856daea0e HTTP/1.1" 200 None 2026-04-22 16:42:05,147 - lava_callback - DEBUG - Processing node 69e8fa058327522856daea0e: baseline-arm-kontron 2026-04-22 16:42:05,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:05,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:05,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa058327522856daea0e/log.txt.gz 2026-04-22 16:42:05,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:05,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:05,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa058327522856daea0e/lava-logs.yaml 2026-04-22 16:42:05,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:05,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:05,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e8fa058327522856daea0e/lava_callback.json.gz 2026-04-22 16:42:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:05,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa058327522856daea0e HTTP/1.1" 200 None 2026-04-22 16:42:05,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:05,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:05,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:05,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa058327522856daea0e HTTP/1.1" 200 None 2026-04-22 16:42:05,939 - lava_callback - INFO - Completed processing callback for node 69e8fa058327522856daea0e INFO: 172.20.0.1:34216 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:42:09,988 - lava_callback - INFO - Received callback for node 69e8f9f98327522856dae9e0 INFO: 172.20.0.1:41342 - "POST /node/69e8f9f98327522856dae9e0 HTTP/1.0" 202 Accepted 2026-04-22 16:42:09,995 - lava_callback - INFO - Starting async job submit for node 69e8f9f98327522856dae9e0 2026-04-22 16:42:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:10,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f98327522856dae9e0 HTTP/1.1" 200 None 2026-04-22 16:42:10,039 - lava_callback - DEBUG - Processing node 69e8f9f98327522856dae9e0: baseline-arm-broonie 2026-04-22 16:42:10,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:10,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:10,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f98327522856dae9e0/log.txt.gz 2026-04-22 16:42:10,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:10,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:10,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f98327522856dae9e0/lava-logs.yaml 2026-04-22 16:42:10,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:11,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:11,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f98327522856dae9e0/lava_callback.json.gz 2026-04-22 16:42:11,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:11,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f98327522856dae9e0 HTTP/1.1" 200 None 2026-04-22 16:42:11,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:11,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:11,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:11,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9f98327522856dae9e0 HTTP/1.1" 200 None 2026-04-22 16:42:11,126 - lava_callback - INFO - Completed processing callback for node 69e8f9f98327522856dae9e0 2026-04-22 16:42:12,440 - lava_callback - INFO - Received callback for node 69e8f9f78327522856dae9d9 INFO: 172.20.0.1:41352 - "POST /node/69e8f9f78327522856dae9d9 HTTP/1.0" 202 Accepted 2026-04-22 16:42:12,446 - lava_callback - INFO - Starting async job submit for node 69e8f9f78327522856dae9d9 2026-04-22 16:42:12,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:12,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f78327522856dae9d9 HTTP/1.1" 200 None 2026-04-22 16:42:12,496 - lava_callback - DEBUG - Processing node 69e8f9f78327522856dae9d9: baseline-arm-broonie 2026-04-22 16:42:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:12,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:12,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f78327522856dae9d9/log.txt.gz 2026-04-22 16:42:13,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:13,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:13,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f78327522856dae9d9/lava-logs.yaml 2026-04-22 16:42:13,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:13,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:13,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f78327522856dae9d9/lava_callback.json.gz 2026-04-22 16:42:13,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:13,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f78327522856dae9d9 HTTP/1.1" 200 None 2026-04-22 16:42:13,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:13,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:13,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:13,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9f78327522856dae9d9 HTTP/1.1" 200 None 2026-04-22 16:42:13,503 - lava_callback - INFO - Completed processing callback for node 69e8f9f78327522856dae9d9 2026-04-22 16:42:14,226 - lava_callback - INFO - Received callback for node 69e8f9f88327522856dae9dc INFO: 172.20.0.1:41362 - "POST /node/69e8f9f88327522856dae9dc HTTP/1.0" 202 Accepted 2026-04-22 16:42:14,242 - lava_callback - INFO - Starting async job submit for node 69e8f9f88327522856dae9dc 2026-04-22 16:42:14,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:14,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f88327522856dae9dc HTTP/1.1" 200 None 2026-04-22 16:42:14,310 - lava_callback - DEBUG - Processing node 69e8f9f88327522856dae9dc: baseline-arm-broonie 2026-04-22 16:42:14,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:14,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:14,790 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f88327522856dae9dc/log.txt.gz 2026-04-22 16:42:14,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:15,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:15,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f88327522856dae9dc/lava-logs.yaml 2026-04-22 16:42:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 16:42:15,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:15,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f88327522856dae9dc/lava_callback.json.gz 2026-04-22 16:42:15,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:15,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f88327522856dae9dc HTTP/1.1" 200 None 2026-04-22 16:42:15,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:15,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:15,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:15,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9f88327522856dae9dc HTTP/1.1" 200 None 2026-04-22 16:42:15,305 - lava_callback - INFO - Completed processing callback for node 69e8f9f88327522856dae9dc INFO: 172.20.0.1:41372 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:42:25,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:25,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:59314 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:42:35,037 - lava_callback - INFO - Received callback for node 69e8f9f58327522856dae9d6 INFO: 172.20.0.1:38324 - "POST /node/69e8f9f58327522856dae9d6 HTTP/1.0" 202 Accepted 2026-04-22 16:42:35,044 - lava_callback - INFO - Starting async job submit for node 69e8f9f58327522856dae9d6 2026-04-22 16:42:35,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:35,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f58327522856dae9d6 HTTP/1.1" 200 None 2026-04-22 16:42:35,090 - lava_callback - DEBUG - Processing node 69e8f9f58327522856dae9d6: baseline-arm-broonie 2026-04-22 16:42:35,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:35,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:35,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f58327522856dae9d6/log.txt.gz 2026-04-22 16:42:35,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:35,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:35,861 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f58327522856dae9d6/lava-logs.yaml 2026-04-22 16:42:35,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:42:35,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:42:35,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e8f9f58327522856dae9d6/lava_callback.json.gz 2026-04-22 16:42:35,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:36,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9f58327522856dae9d6 HTTP/1.1" 200 None 2026-04-22 16:42:36,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:36,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:42:36,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:36,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9f58327522856dae9d6 HTTP/1.1" 200 None 2026-04-22 16:42:36,044 - lava_callback - INFO - Completed processing callback for node 69e8f9f58327522856dae9d6 INFO: 172.20.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60324 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:42:55,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:42:55,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:43:03,958 - lava_callback - INFO - Received callback for node 69e8fa838327522856daeb1e INFO: 172.20.0.1:34334 - "POST /node/69e8fa838327522856daeb1e HTTP/1.0" 202 Accepted 2026-04-22 16:43:03,964 - lava_callback - INFO - Starting async job submit for node 69e8fa838327522856daeb1e 2026-04-22 16:43:03,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:03,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa838327522856daeb1e HTTP/1.1" 200 None 2026-04-22 16:43:03,981 - lava_callback - DEBUG - Processing node 69e8fa838327522856daeb1e: baseline-arm 2026-04-22 16:43:03,986 - lava_callback - WARNING - Failed to upload log 2026-04-22 16:43:03,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:43:04,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:43:04,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8fa838327522856daeb1e/lava-logs.yaml 2026-04-22 16:43:04,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:43:04,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:43:04,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8fa838327522856daeb1e/lava_callback.json.gz 2026-04-22 16:43:04,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa838327522856daeb1e HTTP/1.1" 200 None 2026-04-22 16:43:04,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:04,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:43:04,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:04,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa838327522856daeb1e HTTP/1.1" 200 None 2026-04-22 16:43:04,253 - lava_callback - INFO - Completed processing callback for node 69e8fa838327522856daeb1e 2026-04-22 16:43:05,501 - lava_callback - INFO - Received callback for node 69e8fa238327522856daea6d INFO: 172.20.0.1:34346 - "POST /node/69e8fa238327522856daea6d HTTP/1.0" 202 Accepted 2026-04-22 16:43:05,507 - lava_callback - INFO - Starting async job submit for node 69e8fa238327522856daea6d 2026-04-22 16:43:05,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:05,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa238327522856daea6d HTTP/1.1" 200 None 2026-04-22 16:43:05,545 - lava_callback - DEBUG - Processing node 69e8fa238327522856daea6d: ltp-dio 2026-04-22 16:43:05,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:43:06,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:43:06,061 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e8fa238327522856daea6d/log.txt.gz 2026-04-22 16:43:06,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:43:06,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:43:06,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e8fa238327522856daea6d/lava-logs.yaml 2026-04-22 16:43:06,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:43:06,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:43:06,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e8fa238327522856daea6d/lava_callback.json.gz 2026-04-22 16:43:06,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:06,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa238327522856daea6d HTTP/1.1" 200 None 2026-04-22 16:43:06,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:06,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:43:06,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa238327522856daea6d HTTP/1.1" 200 None 2026-04-22 16:43:06,682 - lava_callback - INFO - Completed processing callback for node 69e8fa238327522856daea6d INFO: 172.20.0.1:52108 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 16:43:15,167 - lava_callback - INFO - Received callback for node 69e6579747863bb428fe4b36 INFO: 172.20.0.1:52122 - "POST /node/69e6579747863bb428fe4b36 HTTP/1.0" 202 Accepted 2026-04-22 16:43:15,172 - lava_callback - INFO - Starting async job submit for node 69e6579747863bb428fe4b36 2026-04-22 16:43:15,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:15,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6579747863bb428fe4b36 HTTP/1.1" 200 None 2026-04-22 16:43:15,187 - lava_callback - DEBUG - Processing node 69e6579747863bb428fe4b36: baseline-arm-baylibre 2026-04-22 16:43:15,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6579747863bb428fe4b36 2026-04-22 16:43:15,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:15,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6579747863bb428fe4b36 HTTP/1.1" 200 None 2026-04-22 16:43:15,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:15,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:43:15,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:15,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6579747863bb428fe4b36 HTTP/1.1" 200 None 2026-04-22 16:43:15,237 - lava_callback - ERROR - Error processing callback for node 69e6579747863bb428fe4b36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52134 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:43:25,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:43:25,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:44:55,324 - lava_callback - INFO - Received callback for node 69e657f947863bb428fe4b55 INFO: 172.20.0.1:50702 - "POST /node/69e657f947863bb428fe4b55 HTTP/1.0" 202 Accepted 2026-04-22 16:44:55,329 - lava_callback - INFO - Starting async job submit for node 69e657f947863bb428fe4b55 2026-04-22 16:44:55,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:44:55,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e657f947863bb428fe4b55 HTTP/1.1" 200 None 2026-04-22 16:44:55,346 - lava_callback - DEBUG - Processing node 69e657f947863bb428fe4b55: baseline-arm-baylibre 2026-04-22 16:44:55,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e657f947863bb428fe4b55 2026-04-22 16:44:55,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:44:55,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e657f947863bb428fe4b55 HTTP/1.1" 200 None 2026-04-22 16:44:55,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:44:55,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:44:55,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:44:55,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e657f947863bb428fe4b55 HTTP/1.1" 200 None 2026-04-22 16:44:55,393 - lava_callback - ERROR - Error processing callback for node 69e657f947863bb428fe4b55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:45:10,019 - lava_callback - INFO - Received callback for node 69e8fa1d8327522856daea64 INFO: 172.20.0.1:43252 - "POST /node/69e8fa1d8327522856daea64 HTTP/1.0" 202 Accepted 2026-04-22 16:45:10,025 - lava_callback - INFO - Starting async job submit for node 69e8fa1d8327522856daea64 2026-04-22 16:45:10,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:10,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1d8327522856daea64 HTTP/1.1" 200 None 2026-04-22 16:45:10,065 - lava_callback - DEBUG - Processing node 69e8fa1d8327522856daea64: ltp-containers 2026-04-22 16:45:10,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:10,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:10,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e8fa1d8327522856daea64/log.txt.gz 2026-04-22 16:45:10,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:10,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:10,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e8fa1d8327522856daea64/lava-logs.yaml 2026-04-22 16:45:10,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:11,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:11,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e8fa1d8327522856daea64/lava_callback.json.gz 2026-04-22 16:45:11,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:11,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1d8327522856daea64 HTTP/1.1" 200 None 2026-04-22 16:45:11,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:45:11,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:11,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa1d8327522856daea64 HTTP/1.1" 200 None 2026-04-22 16:45:11,207 - lava_callback - INFO - Completed processing callback for node 69e8fa1d8327522856daea64 INFO: 172.20.0.1:43256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43262 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:45:25,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:25,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:45:31,089 - lava_callback - INFO - Received callback for node 69e8fa1f8327522856daea67 INFO: 172.20.0.1:55848 - "POST /node/69e8fa1f8327522856daea67 HTTP/1.0" 202 Accepted 2026-04-22 16:45:31,095 - lava_callback - INFO - Starting async job submit for node 69e8fa1f8327522856daea67 2026-04-22 16:45:31,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:31,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1f8327522856daea67 HTTP/1.1" 200 None 2026-04-22 16:45:31,135 - lava_callback - DEBUG - Processing node 69e8fa1f8327522856daea67: ltp-controllers 2026-04-22 16:45:31,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:31,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:31,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8fa1f8327522856daea67/log.txt.gz 2026-04-22 16:45:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:32,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:32,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8fa1f8327522856daea67/lava-logs.yaml 2026-04-22 16:45:32,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:32,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:32,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8fa1f8327522856daea67/lava_callback.json.gz 2026-04-22 16:45:32,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:32,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1f8327522856daea67 HTTP/1.1" 200 None 2026-04-22 16:45:32,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:32,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:45:32,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:32,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa1f8327522856daea67 HTTP/1.1" 200 None 2026-04-22 16:45:32,365 - lava_callback - INFO - Completed processing callback for node 69e8fa1f8327522856daea67 2026-04-22 16:45:32,734 - lava_callback - INFO - Received callback for node 69e8fa308327522856daea9b INFO: 172.20.0.1:55856 - "POST /node/69e8fa308327522856daea9b HTTP/1.0" 202 Accepted 2026-04-22 16:45:32,742 - lava_callback - INFO - Starting async job submit for node 69e8fa308327522856daea9b 2026-04-22 16:45:32,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:32,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa308327522856daea9b HTTP/1.1" 200 None 2026-04-22 16:45:32,782 - lava_callback - DEBUG - Processing node 69e8fa308327522856daea9b: ltp-syscalls 2026-04-22 16:45:33,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:33,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:33,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8fa308327522856daea9b/log.txt.gz 2026-04-22 16:45:34,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:34,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:34,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8fa308327522856daea9b/lava-logs.yaml 2026-04-22 16:45:34,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:45:34,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:45:34,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8fa308327522856daea9b/lava_callback.json.gz 2026-04-22 16:45:34,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:34,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa308327522856daea9b HTTP/1.1" 200 None 2026-04-22 16:45:34,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:34,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:45:34,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:34,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa308327522856daea9b HTTP/1.1" 200 None 2026-04-22 16:45:34,412 - lava_callback - INFO - Completed processing callback for node 69e8fa308327522856daea9b INFO: 172.20.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:45:55,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:45:55,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:46:33,941 - lava_callback - INFO - Received callback for node 69e8fa218327522856daea6a INFO: 172.20.0.1:39978 - "POST /node/69e8fa218327522856daea6a HTTP/1.0" 202 Accepted 2026-04-22 16:46:33,948 - lava_callback - INFO - Starting async job submit for node 69e8fa218327522856daea6a 2026-04-22 16:46:33,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:33,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa218327522856daea6a HTTP/1.1" 200 None 2026-04-22 16:46:33,989 - lava_callback - DEBUG - Processing node 69e8fa218327522856daea6a: ltp-cve 2026-04-22 16:46:34,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:46:34,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:46:34,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e8fa218327522856daea6a/log.txt.gz 2026-04-22 16:46:34,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:46:35,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:46:35,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e8fa218327522856daea6a/lava-logs.yaml 2026-04-22 16:46:35,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:46:35,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:46:35,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e8fa218327522856daea6a/lava_callback.json.gz 2026-04-22 16:46:35,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa218327522856daea6a HTTP/1.1" 200 None 2026-04-22 16:46:35,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:46:35,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,348 - lava_callback - INFO - Received callback for node 69e6585947863bb428fe4b6b 2026-04-22 16:46:35,355 - lava_callback - INFO - Starting async job submit for node 69e6585947863bb428fe4b6b INFO: 172.20.0.1:39984 - "POST /node/69e6585947863bb428fe4b6b HTTP/1.0" 202 Accepted 2026-04-22 16:46:35,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa218327522856daea6a HTTP/1.1" 200 None 2026-04-22 16:46:35,365 - lava_callback - INFO - Completed processing callback for node 69e8fa218327522856daea6a 2026-04-22 16:46:35,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6585947863bb428fe4b6b HTTP/1.1" 200 None 2026-04-22 16:46:35,410 - lava_callback - DEBUG - Processing node 69e6585947863bb428fe4b6b: baseline-arm-baylibre 2026-04-22 16:46:35,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6585947863bb428fe4b6b 2026-04-22 16:46:35,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6585947863bb428fe4b6b HTTP/1.1" 200 None 2026-04-22 16:46:35,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:46:35,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6585947863bb428fe4b6b HTTP/1.1" 200 None 2026-04-22 16:46:35,482 - lava_callback - ERROR - Error processing callback for node 69e6585947863bb428fe4b6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54828 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:46:55,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:46:55,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55820 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:47:13,858 - lava_callback - INFO - Received callback for node 69e8fb8a8327522856daebc2 INFO: 172.20.0.1:44204 - "POST /node/69e8fb8a8327522856daebc2 HTTP/1.0" 202 Accepted 2026-04-22 16:47:13,864 - lava_callback - INFO - Starting async job submit for node 69e8fb8a8327522856daebc2 2026-04-22 16:47:13,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:47:13,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fb8a8327522856daebc2 HTTP/1.1" 200 None 2026-04-22 16:47:13,881 - lava_callback - DEBUG - Processing node 69e8fb8a8327522856daebc2: baseline-arm 2026-04-22 16:47:13,886 - lava_callback - WARNING - Failed to upload log 2026-04-22 16:47:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:47:13,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:47:13,992 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8fb8a8327522856daebc2/lava-logs.yaml 2026-04-22 16:47:13,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:47:14,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:47:14,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8fb8a8327522856daebc2/lava_callback.json.gz 2026-04-22 16:47:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:47:14,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fb8a8327522856daebc2 HTTP/1.1" 200 None 2026-04-22 16:47:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:47:14,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:47:14,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:47:14,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fb8a8327522856daebc2 HTTP/1.1" 200 None 2026-04-22 16:47:14,148 - lava_callback - INFO - Completed processing callback for node 69e8fb8a8327522856daebc2 INFO: 172.20.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44222 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:47:25,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:47:25,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57346 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 16:48:15,418 - lava_callback - INFO - Received callback for node 69e658bb47863bb428fe4b78 INFO: 172.20.0.1:57350 - "POST /node/69e658bb47863bb428fe4b78 HTTP/1.0" 202 Accepted 2026-04-22 16:48:15,424 - lava_callback - INFO - Starting async job submit for node 69e658bb47863bb428fe4b78 2026-04-22 16:48:15,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:48:15,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e658bb47863bb428fe4b78 HTTP/1.1" 200 None 2026-04-22 16:48:15,439 - lava_callback - DEBUG - Processing node 69e658bb47863bb428fe4b78: baseline-arm-baylibre 2026-04-22 16:48:15,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e658bb47863bb428fe4b78 2026-04-22 16:48:15,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:48:15,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e658bb47863bb428fe4b78 HTTP/1.1" 200 None 2026-04-22 16:48:15,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:48:15,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:48:15,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:48:15,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e658bb47863bb428fe4b78 HTTP/1.1" 200 None 2026-04-22 16:48:15,509 - lava_callback - ERROR - Error processing callback for node 69e658bb47863bb428fe4b78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:49:10,207 - lava_callback - INFO - Received callback for node 69e8fa248327522856daea70 INFO: 172.20.0.1:50096 - "POST /node/69e8fa248327522856daea70 HTTP/1.0" 202 Accepted 2026-04-22 16:49:10,214 - lava_callback - INFO - Starting async job submit for node 69e8fa248327522856daea70 2026-04-22 16:49:10,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:10,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa248327522856daea70 HTTP/1.1" 200 None 2026-04-22 16:49:10,256 - lava_callback - DEBUG - Processing node 69e8fa248327522856daea70: ltp-fs_bind 2026-04-22 16:49:10,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:11,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:11,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e8fa248327522856daea70/log.txt.gz 2026-04-22 16:49:11,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:11,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:11,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e8fa248327522856daea70/lava-logs.yaml 2026-04-22 16:49:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:11,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:11,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e8fa248327522856daea70/lava_callback.json.gz 2026-04-22 16:49:11,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:11,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa248327522856daea70 HTTP/1.1" 200 None 2026-04-22 16:49:11,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:12,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:49:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:12,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa248327522856daea70 HTTP/1.1" 200 None 2026-04-22 16:49:12,068 - lava_callback - INFO - Completed processing callback for node 69e8fa248327522856daea70 INFO: 172.20.0.1:50106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:49:25,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:25,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:49:31,833 - lava_callback - INFO - Received callback for node 69e8fa268327522856daea73 INFO: 172.20.0.1:34148 - "POST /node/69e8fa268327522856daea73 HTTP/1.0" 202 Accepted 2026-04-22 16:49:31,839 - lava_callback - INFO - Starting async job submit for node 69e8fa268327522856daea73 2026-04-22 16:49:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:31,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa268327522856daea73 HTTP/1.1" 200 None 2026-04-22 16:49:31,879 - lava_callback - DEBUG - Processing node 69e8fa268327522856daea73: ltp-fsx 2026-04-22 16:49:32,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:32,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:32,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e8fa268327522856daea73/log.txt.gz 2026-04-22 16:49:32,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:32,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:32,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e8fa268327522856daea73/lava-logs.yaml 2026-04-22 16:49:32,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:49:32,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:49:32,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e8fa268327522856daea73/lava_callback.json.gz 2026-04-22 16:49:32,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:32,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa268327522856daea73 HTTP/1.1" 200 None 2026-04-22 16:49:32,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:49:33,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:33,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa268327522856daea73 HTTP/1.1" 200 None 2026-04-22 16:49:33,031 - lava_callback - INFO - Completed processing callback for node 69e8fa268327522856daea73 2026-04-22 16:49:35,461 - lava_callback - INFO - Received callback for node 69e6591b47863bb428fe4b86 INFO: 172.20.0.1:34154 - "POST /node/69e6591b47863bb428fe4b86 HTTP/1.0" 202 Accepted 2026-04-22 16:49:35,470 - lava_callback - INFO - Starting async job submit for node 69e6591b47863bb428fe4b86 2026-04-22 16:49:35,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:35,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6591b47863bb428fe4b86 HTTP/1.1" 200 None 2026-04-22 16:49:35,485 - lava_callback - DEBUG - Processing node 69e6591b47863bb428fe4b86: baseline-arm-baylibre 2026-04-22 16:49:35,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6591b47863bb428fe4b86 2026-04-22 16:49:35,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:35,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6591b47863bb428fe4b86 HTTP/1.1" 200 None 2026-04-22 16:49:35,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:35,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:49:35,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:35,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6591b47863bb428fe4b86 HTTP/1.1" 200 None 2026-04-22 16:49:35,543 - lava_callback - ERROR - Error processing callback for node 69e6591b47863bb428fe4b86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:49:55,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:49:55,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:50:33,527 - lava_callback - INFO - Received callback for node 69e8fa288327522856daea76 INFO: 172.20.0.1:58390 - "POST /node/69e8fa288327522856daea76 HTTP/1.0" 202 Accepted 2026-04-22 16:50:33,533 - lava_callback - INFO - Starting async job submit for node 69e8fa288327522856daea76 2026-04-22 16:50:33,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:50:33,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa288327522856daea76 HTTP/1.1" 200 None 2026-04-22 16:50:33,579 - lava_callback - DEBUG - Processing node 69e8fa288327522856daea76: ltp-input 2026-04-22 16:50:33,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:50:34,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:50:34,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e8fa288327522856daea76/log.txt.gz 2026-04-22 16:50:34,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:50:34,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:50:34,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e8fa288327522856daea76/lava-logs.yaml 2026-04-22 16:50:34,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:50:34,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:50:34,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e8fa288327522856daea76/lava_callback.json.gz 2026-04-22 16:50:34,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:50:34,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa288327522856daea76 HTTP/1.1" 200 None 2026-04-22 16:50:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:50:34,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:50:34,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:50:34,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa288327522856daea76 HTTP/1.1" 200 None 2026-04-22 16:50:34,835 - lava_callback - INFO - Completed processing callback for node 69e8fa288327522856daea76 INFO: 172.20.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52236 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:50:55,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:50:55,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 16:51:16,110 - lava_callback - INFO - Received callback for node 69e6597e47863bb428fe4b94 INFO: 172.20.0.1:51068 - "POST /node/69e6597e47863bb428fe4b94 HTTP/1.0" 202 Accepted 2026-04-22 16:51:16,116 - lava_callback - INFO - Starting async job submit for node 69e6597e47863bb428fe4b94 2026-04-22 16:51:16,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:51:16,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6597e47863bb428fe4b94 HTTP/1.1" 200 None 2026-04-22 16:51:16,131 - lava_callback - DEBUG - Processing node 69e6597e47863bb428fe4b94: baseline-arm-clabbe 2026-04-22 16:51:16,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6597e47863bb428fe4b94 2026-04-22 16:51:16,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:51:16,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6597e47863bb428fe4b94 HTTP/1.1" 200 None 2026-04-22 16:51:16,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:51:16,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:51:16,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:51:16,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6597e47863bb428fe4b94 HTTP/1.1" 200 None 2026-04-22 16:51:16,185 - lava_callback - ERROR - Error processing callback for node 69e6597e47863bb428fe4b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40302 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:52:56,003 - lava_callback - INFO - Received callback for node 69e659df47863bb428fe4ba8 INFO: 172.20.0.1:54234 - "POST /node/69e659df47863bb428fe4ba8 HTTP/1.0" 202 Accepted 2026-04-22 16:52:56,008 - lava_callback - INFO - Starting async job submit for node 69e659df47863bb428fe4ba8 2026-04-22 16:52:56,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:52:56,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e659df47863bb428fe4ba8 HTTP/1.1" 200 None 2026-04-22 16:52:56,023 - lava_callback - DEBUG - Processing node 69e659df47863bb428fe4ba8: baseline-arm-clabbe 2026-04-22 16:52:56,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e659df47863bb428fe4ba8 2026-04-22 16:52:56,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:52:56,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e659df47863bb428fe4ba8 HTTP/1.1" 200 None 2026-04-22 16:52:56,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:52:56,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:52:56,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:52:56,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e659df47863bb428fe4ba8 HTTP/1.1" 200 None 2026-04-22 16:52:56,077 - lava_callback - ERROR - Error processing callback for node 69e659df47863bb428fe4ba8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:53:10,501 - lava_callback - INFO - Received callback for node 69e8fa1c8327522856daea5d INFO: 172.20.0.1:50914 - "POST /node/69e8fa1c8327522856daea5d HTTP/1.0" 202 Accepted 2026-04-22 16:53:10,509 - lava_callback - INFO - Starting async job submit for node 69e8fa1c8327522856daea5d 2026-04-22 16:53:10,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:10,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1c8327522856daea5d HTTP/1.1" 200 None 2026-04-22 16:53:10,617 - lava_callback - DEBUG - Processing node 69e8fa1c8327522856daea5d: ltp-cap_bounds 2026-04-22 16:53:11,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:11,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:11,672 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e8fa1c8327522856daea5d/log.txt.gz 2026-04-22 16:53:12,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:12,202 - lava_callback - INFO - Received callback for node 69e8fa298327522856daea79 INFO: 172.20.0.1:50930 - "POST /node/69e8fa298327522856daea79 HTTP/1.0" 202 Accepted 2026-04-22 16:53:12,209 - lava_callback - INFO - Starting async job submit for node 69e8fa298327522856daea79 2026-04-22 16:53:12,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:12,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa298327522856daea79 HTTP/1.1" 200 None 2026-04-22 16:53:12,256 - lava_callback - DEBUG - Processing node 69e8fa298327522856daea79: ltp-ipc 2026-04-22 16:53:12,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:12,399 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e8fa1c8327522856daea5d/lava-logs.yaml 2026-04-22 16:53:12,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:12,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:12,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:12,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e8fa1c8327522856daea5d/lava_callback.json.gz 2026-04-22 16:53:12,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:12,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:12,790 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e8fa298327522856daea79/log.txt.gz 2026-04-22 16:53:12,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa1c8327522856daea5d HTTP/1.1" 200 None 2026-04-22 16:53:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:12,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:53:12,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa1c8327522856daea5d HTTP/1.1" 200 None 2026-04-22 16:53:13,015 - lava_callback - INFO - Completed processing callback for node 69e8fa1c8327522856daea5d 2026-04-22 16:53:13,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:13,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e8fa298327522856daea79/lava-logs.yaml 2026-04-22 16:53:13,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:13,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:13,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e8fa298327522856daea79/lava_callback.json.gz 2026-04-22 16:53:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa298327522856daea79 HTTP/1.1" 200 None 2026-04-22 16:53:13,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:53:13,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:13,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa298327522856daea79 HTTP/1.1" 200 None 2026-04-22 16:53:13,680 - lava_callback - INFO - Completed processing callback for node 69e8fa298327522856daea79 INFO: 172.20.0.1:50942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50950 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:53:25,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:25,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:53:32,478 - lava_callback - INFO - Received callback for node 69e8fa2b8327522856daea7c INFO: 172.20.0.1:54050 - "POST /node/69e8fa2b8327522856daea7c HTTP/1.0" 202 Accepted 2026-04-22 16:53:32,485 - lava_callback - INFO - Starting async job submit for node 69e8fa2b8327522856daea7c 2026-04-22 16:53:32,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:32,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2b8327522856daea7c HTTP/1.1" 200 None 2026-04-22 16:53:32,534 - lava_callback - DEBUG - Processing node 69e8fa2b8327522856daea7c: ltp-pty 2026-04-22 16:53:32,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:33,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:33,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e8fa2b8327522856daea7c/log.txt.gz 2026-04-22 16:53:33,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:33,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:33,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e8fa2b8327522856daea7c/lava-logs.yaml 2026-04-22 16:53:33,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:33,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:33,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e8fa2b8327522856daea7c/lava_callback.json.gz 2026-04-22 16:53:33,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:33,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2b8327522856daea7c HTTP/1.1" 200 None 2026-04-22 16:53:33,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:33,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:53:33,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:33,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa2b8327522856daea7c HTTP/1.1" 200 None 2026-04-22 16:53:33,587 - lava_callback - INFO - Completed processing callback for node 69e8fa2b8327522856daea7c 2026-04-22 16:53:34,007 - lava_callback - INFO - Received callback for node 69e8f8698327522856dac291 INFO: 172.20.0.1:54064 - "POST /node/69e8f8698327522856dac291 HTTP/1.0" 202 Accepted 2026-04-22 16:53:34,014 - lava_callback - INFO - Starting async job submit for node 69e8f8698327522856dac291 2026-04-22 16:53:34,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:34,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f8698327522856dac291 HTTP/1.1" 200 None 2026-04-22 16:53:34,113 - lava_callback - DEBUG - Processing node 69e8f8698327522856dac291: ltp-smoke 2026-04-22 16:53:34,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:34,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:34,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8f8698327522856dac291/log.txt.gz 2026-04-22 16:53:35,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:35,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:35,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8f8698327522856dac291/lava-logs.yaml 2026-04-22 16:53:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:53:35,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:53:35,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8f8698327522856dac291/lava_callback.json.gz 2026-04-22 16:53:35,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:35,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f8698327522856dac291 HTTP/1.1" 200 None 2026-04-22 16:53:35,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:35,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4cc8327522856dac252 HTTP/1.1" 200 None 2026-04-22 16:53:35,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:35,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f8698327522856dac291 HTTP/1.1" 200 None 2026-04-22 16:53:35,638 - lava_callback - INFO - Completed processing callback for node 69e8f8698327522856dac291 INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46024 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:53:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:53:55,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45938 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:54:36,084 - lava_callback - INFO - Received callback for node 69e65a4047863bb428fe4bb8 INFO: 172.20.0.1:38996 - "POST /node/69e65a4047863bb428fe4bb8 HTTP/1.0" 202 Accepted 2026-04-22 16:54:36,090 - lava_callback - INFO - Starting async job submit for node 69e65a4047863bb428fe4bb8 2026-04-22 16:54:36,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:36,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65a4047863bb428fe4bb8 HTTP/1.1" 200 None 2026-04-22 16:54:36,109 - lava_callback - DEBUG - Processing node 69e65a4047863bb428fe4bb8: baseline-arm-clabbe 2026-04-22 16:54:36,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65a4047863bb428fe4bb8 2026-04-22 16:54:36,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:36,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65a4047863bb428fe4bb8 HTTP/1.1" 200 None 2026-04-22 16:54:36,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:36,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:54:36,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:36,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65a4047863bb428fe4bb8 HTTP/1.1" 200 None 2026-04-22 16:54:36,162 - lava_callback - ERROR - Error processing callback for node 69e65a4047863bb428fe4bb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34746 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:54:54,451 - lava_callback - INFO - Received callback for node 69e8fa2c8327522856daea7f INFO: 172.20.0.1:57620 - "POST /node/69e8fa2c8327522856daea7f HTTP/1.0" 202 Accepted 2026-04-22 16:54:54,457 - lava_callback - INFO - Starting async job submit for node 69e8fa2c8327522856daea7f 2026-04-22 16:54:54,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:54,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2c8327522856daea7f HTTP/1.1" 200 None 2026-04-22 16:54:54,516 - lava_callback - DEBUG - Processing node 69e8fa2c8327522856daea7f: ltp-sched 2026-04-22 16:54:54,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:54:54,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:54:54,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e8fa2c8327522856daea7f/log.txt.gz 2026-04-22 16:54:55,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:54:55,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:54:55,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e8fa2c8327522856daea7f/lava-logs.yaml 2026-04-22 16:54:55,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:54:55,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:54:55,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e8fa2c8327522856daea7f/lava_callback.json.gz 2026-04-22 16:54:55,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:55,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2c8327522856daea7f HTTP/1.1" 200 None 2026-04-22 16:54:55,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:55,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:54:55,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:55,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa2c8327522856daea7f HTTP/1.1" 200 None 2026-04-22 16:54:55,540 - lava_callback - INFO - Completed processing callback for node 69e8fa2c8327522856daea7f 2026-04-22 16:54:55,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:54:55,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60860 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 16:56:15,259 - lava_callback - INFO - Received callback for node 69e8f9e78327522856dae99d INFO: 172.20.0.1:60866 - "POST /node/69e8f9e78327522856dae99d HTTP/1.0" 202 Accepted 2026-04-22 16:56:15,265 - lava_callback - INFO - Starting async job submit for node 69e8f9e78327522856dae99d 2026-04-22 16:56:15,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:15,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e78327522856dae99d HTTP/1.1" 200 None 2026-04-22 16:56:15,333 - lava_callback - DEBUG - Processing node 69e8f9e78327522856dae99d: baseline-arm 2026-04-22 16:56:15,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:56:16,103 - lava_callback - INFO - Received callback for node 69e65aa147863bb428fe4bc8 INFO: 172.20.0.1:60876 - "POST /node/69e65aa147863bb428fe4bc8 HTTP/1.0" 202 Accepted 2026-04-22 16:56:16,109 - lava_callback - INFO - Starting async job submit for node 69e65aa147863bb428fe4bc8 2026-04-22 16:56:16,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:16,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65aa147863bb428fe4bc8 HTTP/1.1" 200 None 2026-04-22 16:56:16,131 - lava_callback - DEBUG - Processing node 69e65aa147863bb428fe4bc8: baseline-arm-clabbe 2026-04-22 16:56:16,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65aa147863bb428fe4bc8 2026-04-22 16:56:16,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:16,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65aa147863bb428fe4bc8 HTTP/1.1" 200 None 2026-04-22 16:56:16,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:16,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:56:16,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:16,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65aa147863bb428fe4bc8 HTTP/1.1" 200 None 2026-04-22 16:56:16,181 - lava_callback - ERROR - Error processing callback for node 69e65aa147863bb428fe4bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 16:56:16,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:56:16,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e78327522856dae99d/log.txt.gz INFO: 172.20.0.1:60882 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:56:16,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:56:16,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:56:16,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e78327522856dae99d/lava-logs.yaml 2026-04-22 16:56:16,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:56:16,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:56:16,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8f9e78327522856dae99d/lava_callback.json.gz DEBUG: Setup failed for 69e8f9e78327522856dae99d. Transitting job node result: incomplete -> fail 2026-04-22 16:56:17,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:17,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f9e78327522856dae99d HTTP/1.1" 200 None 2026-04-22 16:56:17,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:17,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:56:17,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:17,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8f9e78327522856dae99d HTTP/1.1" 200 None 2026-04-22 16:56:17,234 - lava_callback - INFO - Completed processing callback for node 69e8f9e78327522856dae99d 2026-04-22 16:56:25,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:56:25,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57368 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:57:11,792 - lava_callback - INFO - Received callback for node 69e8fa2e8327522856daea98 INFO: 172.20.0.1:59914 - "POST /node/69e8fa2e8327522856daea98 HTTP/1.0" 202 Accepted 2026-04-22 16:57:11,801 - lava_callback - INFO - Starting async job submit for node 69e8fa2e8327522856daea98 2026-04-22 16:57:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:11,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2e8327522856daea98 HTTP/1.1" 200 None 2026-04-22 16:57:11,851 - lava_callback - DEBUG - Processing node 69e8fa2e8327522856daea98: ltp-smoke 2026-04-22 16:57:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:12,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:12,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8fa2e8327522856daea98/log.txt.gz 2026-04-22 16:57:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:12,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:12,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8fa2e8327522856daea98/lava-logs.yaml 2026-04-22 16:57:12,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:12,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:12,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8fa2e8327522856daea98/lava_callback.json.gz 2026-04-22 16:57:13,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:13,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa2e8327522856daea98 HTTP/1.1" 200 None 2026-04-22 16:57:13,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:13,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:57:13,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:13,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa2e8327522856daea98 HTTP/1.1" 200 None 2026-04-22 16:57:13,093 - lava_callback - INFO - Completed processing callback for node 69e8fa2e8327522856daea98 INFO: 172.20.0.1:59926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:57:25,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:25,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:57:30,901 - lava_callback - INFO - Received callback for node 69e8fa338327522856daeaa1 INFO: 172.20.0.1:43796 - "POST /node/69e8fa338327522856daeaa1 HTTP/1.0" 202 Accepted 2026-04-22 16:57:30,908 - lava_callback - INFO - Starting async job submit for node 69e8fa338327522856daeaa1 2026-04-22 16:57:30,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:30,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa338327522856daeaa1 HTTP/1.1" 200 None 2026-04-22 16:57:30,964 - lava_callback - DEBUG - Processing node 69e8fa338327522856daeaa1: ltp-timers 2026-04-22 16:57:31,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:31,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:31,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e8fa338327522856daeaa1/log.txt.gz 2026-04-22 16:57:31,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:31,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:31,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e8fa338327522856daeaa1/lava-logs.yaml 2026-04-22 16:57:31,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:32,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:32,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e8fa338327522856daeaa1/lava_callback.json.gz 2026-04-22 16:57:32,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:32,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa338327522856daeaa1 HTTP/1.1" 200 None 2026-04-22 16:57:32,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:57:32,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:32,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa338327522856daeaa1 HTTP/1.1" 200 None 2026-04-22 16:57:32,164 - lava_callback - INFO - Completed processing callback for node 69e8fa338327522856daeaa1 INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45452 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:57:51,784 - lava_callback - INFO - Received callback for node 69e8fa318327522856daea9e INFO: 172.20.0.1:39884 - "POST /node/69e8fa318327522856daea9e HTTP/1.0" 202 Accepted 2026-04-22 16:57:51,792 - lava_callback - INFO - Starting async job submit for node 69e8fa318327522856daea9e 2026-04-22 16:57:51,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:51,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa318327522856daea9e HTTP/1.1" 200 None 2026-04-22 16:57:51,840 - lava_callback - DEBUG - Processing node 69e8fa318327522856daea9e: ltp-syscalls-ipc 2026-04-22 16:57:52,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:52,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:52,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8fa318327522856daea9e/log.txt.gz 2026-04-22 16:57:52,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:52,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:52,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8fa318327522856daea9e/lava-logs.yaml 2026-04-22 16:57:52,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 16:57:53,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 16:57:53,023 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8fa318327522856daea9e/lava_callback.json.gz 2026-04-22 16:57:53,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:53,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa318327522856daea9e HTTP/1.1" 200 None 2026-04-22 16:57:53,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:53,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 16:57:53,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:53,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa318327522856daea9e HTTP/1.1" 200 None 2026-04-22 16:57:53,135 - lava_callback - INFO - Completed processing callback for node 69e8fa318327522856daea9e 2026-04-22 16:57:55,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:56,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 16:57:56,145 - lava_callback - INFO - Received callback for node 69e65b0447863bb428fe4bda INFO: 172.20.0.1:39894 - "POST /node/69e65b0447863bb428fe4bda HTTP/1.0" 202 Accepted 2026-04-22 16:57:56,155 - lava_callback - INFO - Starting async job submit for node 69e65b0447863bb428fe4bda 2026-04-22 16:57:56,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:56,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65b0447863bb428fe4bda HTTP/1.1" 200 None 2026-04-22 16:57:56,171 - lava_callback - DEBUG - Processing node 69e65b0447863bb428fe4bda: baseline-arm-clabbe 2026-04-22 16:57:56,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65b0447863bb428fe4bda 2026-04-22 16:57:56,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:56,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65b0447863bb428fe4bda HTTP/1.1" 200 None 2026-04-22 16:57:56,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:56,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:57:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:57:56,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65b0447863bb428fe4bda HTTP/1.1" 200 None 2026-04-22 16:57:56,232 - lava_callback - ERROR - Error processing callback for node 69e65b0447863bb428fe4bda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37324 - "GET / HTTP/1.0" 200 OK 2026-04-22 16:59:36,243 - lava_callback - INFO - Received callback for node 69e65b6847863bb428fe4bf0 INFO: 172.20.0.1:60522 - "POST /node/69e65b6847863bb428fe4bf0 HTTP/1.0" 202 Accepted 2026-04-22 16:59:36,249 - lava_callback - INFO - Starting async job submit for node 69e65b6847863bb428fe4bf0 2026-04-22 16:59:36,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:59:36,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65b6847863bb428fe4bf0 HTTP/1.1" 200 None 2026-04-22 16:59:36,264 - lava_callback - DEBUG - Processing node 69e65b6847863bb428fe4bf0: baseline-arm-clabbe 2026-04-22 16:59:36,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65b6847863bb428fe4bf0 2026-04-22 16:59:36,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:59:36,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65b6847863bb428fe4bf0 HTTP/1.1" 200 None 2026-04-22 16:59:36,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:59:36,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 16:59:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 16:59:36,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65b6847863bb428fe4bf0 HTTP/1.1" 200 None 2026-04-22 16:59:36,325 - lava_callback - ERROR - Error processing callback for node 69e65b6847863bb428fe4bf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:00:01,678 - lava_callback - INFO - Received callback for node 69e8fa0a8327522856daea1f INFO: 172.20.0.1:38194 - "POST /node/69e8fa0a8327522856daea1f HTTP/1.0" 202 Accepted 2026-04-22 17:00:01,725 - lava_callback - INFO - Starting async job submit for node 69e8fa0a8327522856daea1f 2026-04-22 17:00:01,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:00:01,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa0a8327522856daea1f HTTP/1.1" 200 None 2026-04-22 17:00:01,771 - lava_callback - DEBUG - Processing node 69e8fa0a8327522856daea1f: baseline-arm-pengutronix 2026-04-22 17:00:01,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:00:01,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:00:01,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0a8327522856daea1f/log.txt.gz 2026-04-22 17:00:02,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:00:02,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:00:02,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0a8327522856daea1f/lava-logs.yaml 2026-04-22 17:00:02,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:00:02,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:00:02,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e8fa0a8327522856daea1f/lava_callback.json.gz DEBUG: Setup failed for 69e8fa0a8327522856daea1f. Transitting job node result: incomplete -> fail 2026-04-22 17:00:02,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:00:02,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa0a8327522856daea1f HTTP/1.1" 200 None 2026-04-22 17:00:02,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:00:02,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 17:00:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:00:02,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa0a8327522856daea1f HTTP/1.1" 200 None 2026-04-22 17:00:02,388 - lava_callback - INFO - Completed processing callback for node 69e8fa0a8327522856daea1f INFO: 172.20.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37504 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:00:26,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:00:26,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:01:10,624 - lava_callback - INFO - Received callback for node 69e8fa358327522856daeaa8 INFO: 172.20.0.1:54958 - "POST /node/69e8fa358327522856daeaa8 HTTP/1.0" 202 Accepted 2026-04-22 17:01:10,630 - lava_callback - INFO - Starting async job submit for node 69e8fa358327522856daeaa8 2026-04-22 17:01:10,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:10,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa358327522856daeaa8 HTTP/1.1" 200 None 2026-04-22 17:01:10,701 - lava_callback - DEBUG - Processing node 69e8fa358327522856daeaa8: ltp-watchqueue 2026-04-22 17:01:11,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:11,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:11,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8fa358327522856daeaa8/log.txt.gz 2026-04-22 17:01:11,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:11,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:11,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8fa358327522856daeaa8/lava-logs.yaml 2026-04-22 17:01:11,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:11,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:11,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8fa358327522856daeaa8/lava_callback.json.gz 2026-04-22 17:01:11,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:11,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fa358327522856daeaa8 HTTP/1.1" 200 None 2026-04-22 17:01:11,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 17:01:11,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:11,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fa358327522856daeaa8 HTTP/1.1" 200 None 2026-04-22 17:01:11,778 - lava_callback - INFO - Completed processing callback for node 69e8fa358327522856daeaa8 INFO: 172.20.0.1:54972 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 17:01:16,302 - lava_callback - INFO - Received callback for node 69e65bcb47863bb428fe4c01 INFO: 172.20.0.1:54976 - "POST /node/69e65bcb47863bb428fe4c01 HTTP/1.0" 202 Accepted 2026-04-22 17:01:16,310 - lava_callback - INFO - Starting async job submit for node 69e65bcb47863bb428fe4c01 2026-04-22 17:01:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:16,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65bcb47863bb428fe4c01 HTTP/1.1" 200 None 2026-04-22 17:01:16,326 - lava_callback - DEBUG - Processing node 69e65bcb47863bb428fe4c01: baseline-arm-clabbe 2026-04-22 17:01:16,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65bcb47863bb428fe4c01 2026-04-22 17:01:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:16,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65bcb47863bb428fe4c01 HTTP/1.1" 200 None 2026-04-22 17:01:16,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:16,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 17:01:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:16,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65bcb47863bb428fe4c01 HTTP/1.1" 200 None 2026-04-22 17:01:16,373 - lava_callback - ERROR - Error processing callback for node 69e65bcb47863bb428fe4c01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54982 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:01:16,955 - lava_callback - INFO - Received callback for node 69e8fed28327522856daede0 INFO: 172.20.0.1:54998 - "POST /node/69e8fed28327522856daede0 HTTP/1.0" 202 Accepted 2026-04-22 17:01:16,961 - lava_callback - INFO - Starting async job submit for node 69e8fed28327522856daede0 2026-04-22 17:01:16,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:16,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed28327522856daede0 HTTP/1.1" 200 None 2026-04-22 17:01:16,988 - lava_callback - DEBUG - Processing node 69e8fed28327522856daede0: baseline-x86 2026-04-22 17:01:16,993 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:01:16,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:17,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:17,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed28327522856daede0/lava-logs.yaml 2026-04-22 17:01:17,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:17,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:17,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed28327522856daede0/lava_callback.json.gz 2026-04-22 17:01:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:17,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed28327522856daede0 HTTP/1.1" 200 None 2026-04-22 17:01:17,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:17,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:01:17,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:17,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fed28327522856daede0 HTTP/1.1" 200 None 2026-04-22 17:01:17,230 - lava_callback - INFO - Completed processing callback for node 69e8fed28327522856daede0 2026-04-22 17:01:26,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:26,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:01:51,222 - lava_callback - INFO - Received callback for node 69e8fed58327522856daede9 INFO: 172.20.0.1:55648 - "POST /node/69e8fed58327522856daede9 HTTP/1.0" 202 Accepted 2026-04-22 17:01:51,229 - lava_callback - INFO - Starting async job submit for node 69e8fed58327522856daede9 2026-04-22 17:01:51,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:51,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed58327522856daede9 HTTP/1.1" 200 None 2026-04-22 17:01:51,271 - lava_callback - DEBUG - Processing node 69e8fed58327522856daede9: baseline-x86 2026-04-22 17:01:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:51,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:51,610 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed58327522856daede9/log.txt.gz 2026-04-22 17:01:51,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:51,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:51,945 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed58327522856daede9/lava-logs.yaml 2026-04-22 17:01:51,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:01:52,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:01:52,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed58327522856daede9/lava_callback.json.gz 2026-04-22 17:01:52,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:52,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed58327522856daede9 HTTP/1.1" 200 None 2026-04-22 17:01:52,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:52,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:01:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:52,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fed58327522856daede9 HTTP/1.1" 200 None 2026-04-22 17:01:52,164 - lava_callback - INFO - Completed processing callback for node 69e8fed58327522856daede9 2026-04-22 17:01:56,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:01:56,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47720 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:02:32,742 - lava_callback - INFO - Received callback for node 69e8fed48327522856daede6 INFO: 172.20.0.1:38236 - "POST /node/69e8fed48327522856daede6 HTTP/1.0" 202 Accepted 2026-04-22 17:02:32,748 - lava_callback - INFO - Starting async job submit for node 69e8fed48327522856daede6 2026-04-22 17:02:32,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:32,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed48327522856daede6 HTTP/1.1" 200 None 2026-04-22 17:02:32,789 - lava_callback - DEBUG - Processing node 69e8fed48327522856daede6: baseline-x86 2026-04-22 17:02:33,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:33,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:33,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed48327522856daede6/log.txt.gz 2026-04-22 17:02:33,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:33,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:33,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed48327522856daede6/lava-logs.yaml 2026-04-22 17:02:33,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:33,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:33,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed48327522856daede6/lava_callback.json.gz 2026-04-22 17:02:33,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:33,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed48327522856daede6 HTTP/1.1" 200 None 2026-04-22 17:02:33,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:33,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:02:33,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:33,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fed48327522856daede6 HTTP/1.1" 200 None 2026-04-22 17:02:33,783 - lava_callback - INFO - Completed processing callback for node 69e8fed48327522856daede6 2026-04-22 17:02:34,709 - lava_callback - INFO - Received callback for node 69e8fed38327522856daede3 INFO: 172.20.0.1:38240 - "POST /node/69e8fed38327522856daede3 HTTP/1.0" 202 Accepted 2026-04-22 17:02:34,715 - lava_callback - INFO - Starting async job submit for node 69e8fed38327522856daede3 2026-04-22 17:02:34,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:34,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed38327522856daede3 HTTP/1.1" 200 None 2026-04-22 17:02:34,747 - lava_callback - DEBUG - Processing node 69e8fed38327522856daede3: baseline-x86 2026-04-22 17:02:35,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:35,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:35,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed38327522856daede3/log.txt.gz 2026-04-22 17:02:35,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:35,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:35,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed38327522856daede3/lava-logs.yaml 2026-04-22 17:02:35,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:02:35,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:02:35,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed38327522856daede3/lava_callback.json.gz 2026-04-22 17:02:35,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:35,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed38327522856daede3 HTTP/1.1" 200 None 2026-04-22 17:02:35,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:35,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:02:35,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:35,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fed38327522856daede3 HTTP/1.1" 200 None 2026-04-22 17:02:35,852 - lava_callback - INFO - Completed processing callback for node 69e8fed38327522856daede3 INFO: 172.20.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44706 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:02:56,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:56,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 17:02:56,379 - lava_callback - INFO - Received callback for node 69e65c3147863bb428fe4c12 INFO: 172.20.0.1:37452 - "POST /node/69e65c3147863bb428fe4c12 HTTP/1.0" 202 Accepted 2026-04-22 17:02:56,384 - lava_callback - INFO - Starting async job submit for node 69e65c3147863bb428fe4c12 2026-04-22 17:02:56,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:56,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65c3147863bb428fe4c12 HTTP/1.1" 200 None 2026-04-22 17:02:56,414 - lava_callback - DEBUG - Processing node 69e65c3147863bb428fe4c12: baseline-arm-clabbe 2026-04-22 17:02:56,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65c3147863bb428fe4c12 2026-04-22 17:02:56,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:56,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65c3147863bb428fe4c12 HTTP/1.1" 200 None 2026-04-22 17:02:56,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:56,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 17:02:56,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:02:56,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65c3147863bb428fe4c12 HTTP/1.1" 200 None 2026-04-22 17:02:56,465 - lava_callback - ERROR - Error processing callback for node 69e65c3147863bb428fe4c12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:04:36,422 - lava_callback - INFO - Received callback for node 69e65c9b47863bb428fe4c23 INFO: 172.20.0.1:54624 - "POST /node/69e65c9b47863bb428fe4c23 HTTP/1.0" 202 Accepted 2026-04-22 17:04:36,429 - lava_callback - INFO - Starting async job submit for node 69e65c9b47863bb428fe4c23 2026-04-22 17:04:36,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:04:36,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65c9b47863bb428fe4c23 HTTP/1.1" 200 None 2026-04-22 17:04:36,445 - lava_callback - DEBUG - Processing node 69e65c9b47863bb428fe4c23: baseline-arm-clabbe 2026-04-22 17:04:36,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65c9b47863bb428fe4c23 2026-04-22 17:04:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:04:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65c9b47863bb428fe4c23 HTTP/1.1" 200 None 2026-04-22 17:04:36,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:04:36,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 17:04:36,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:04:36,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65c9b47863bb428fe4c23 HTTP/1.1" 200 None 2026-04-22 17:04:36,503 - lava_callback - ERROR - Error processing callback for node 69e65c9b47863bb428fe4c23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55266 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:06:16,778 - lava_callback - INFO - Received callback for node 69e65d0647863bb428fe4c38 INFO: 172.20.0.1:55268 - "POST /node/69e65d0647863bb428fe4c38 HTTP/1.0" 202 Accepted 2026-04-22 17:06:16,784 - lava_callback - INFO - Starting async job submit for node 69e65d0647863bb428fe4c38 2026-04-22 17:06:16,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:06:16,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65d0647863bb428fe4c38 HTTP/1.1" 200 None 2026-04-22 17:06:16,799 - lava_callback - DEBUG - Processing node 69e65d0647863bb428fe4c38: baseline-arm64-baylibre 2026-04-22 17:06:16,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65d0647863bb428fe4c38 2026-04-22 17:06:16,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:06:16,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65d0647863bb428fe4c38 HTTP/1.1" 200 None 2026-04-22 17:06:16,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:06:16,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:06:16,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:06:16,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65d0647863bb428fe4c38 HTTP/1.1" 200 None 2026-04-22 17:06:16,848 - lava_callback - ERROR - Error processing callback for node 69e65d0647863bb428fe4c38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54682 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:09:16,940 - lava_callback - INFO - Received callback for node 69e65db447863bb428fe4c63 INFO: 172.20.0.1:54696 - "POST /node/69e65db447863bb428fe4c63 HTTP/1.0" 202 Accepted 2026-04-22 17:09:16,945 - lava_callback - INFO - Starting async job submit for node 69e65db447863bb428fe4c63 2026-04-22 17:09:16,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:09:16,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65db447863bb428fe4c63 HTTP/1.1" 200 None 2026-04-22 17:09:16,960 - lava_callback - DEBUG - Processing node 69e65db447863bb428fe4c63: baseline-arm64-baylibre 2026-04-22 17:09:16,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65db447863bb428fe4c63 2026-04-22 17:09:16,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:09:16,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65db447863bb428fe4c63 HTTP/1.1" 200 None 2026-04-22 17:09:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:09:16,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:09:16,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:09:17,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65db447863bb428fe4c63 HTTP/1.1" 200 None 2026-04-22 17:09:17,017 - lava_callback - ERROR - Error processing callback for node 69e65db447863bb428fe4c63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57382 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:10:56,660 - lava_callback - INFO - Received callback for node 69e65e1747863bb428fe4c84 INFO: 172.20.0.1:57384 - "POST /node/69e65e1747863bb428fe4c84 HTTP/1.0" 202 Accepted 2026-04-22 17:10:56,665 - lava_callback - INFO - Starting async job submit for node 69e65e1747863bb428fe4c84 2026-04-22 17:10:56,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:10:56,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65e1747863bb428fe4c84 HTTP/1.1" 200 None 2026-04-22 17:10:56,680 - lava_callback - DEBUG - Processing node 69e65e1747863bb428fe4c84: baseline-arm64-baylibre 2026-04-22 17:10:56,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65e1747863bb428fe4c84 2026-04-22 17:10:56,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:10:56,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65e1747863bb428fe4c84 HTTP/1.1" 200 None 2026-04-22 17:10:56,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:10:56,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:10:56,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:10:56,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65e1747863bb428fe4c84 HTTP/1.1" 200 None 2026-04-22 17:10:56,726 - lava_callback - ERROR - Error processing callback for node 69e65e1747863bb428fe4c84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:12:16,805 - lava_callback - INFO - Received callback for node 69e65e6e47863bb428fe4c9c INFO: 172.20.0.1:52200 - "POST /node/69e65e6e47863bb428fe4c9c HTTP/1.0" 202 Accepted 2026-04-22 17:12:16,811 - lava_callback - INFO - Starting async job submit for node 69e65e6e47863bb428fe4c9c 2026-04-22 17:12:16,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:12:16,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65e6e47863bb428fe4c9c HTTP/1.1" 200 None 2026-04-22 17:12:16,828 - lava_callback - DEBUG - Processing node 69e65e6e47863bb428fe4c9c: baseline-arm64-baylibre 2026-04-22 17:12:16,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65e6e47863bb428fe4c9c 2026-04-22 17:12:16,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:12:16,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65e6e47863bb428fe4c9c HTTP/1.1" 200 None 2026-04-22 17:12:16,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:12:20,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:12:20,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:12:20,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65e6e47863bb428fe4c9c HTTP/1.1" 200 None 2026-04-22 17:12:20,886 - lava_callback - ERROR - Error processing callback for node 69e65e6e47863bb428fe4c9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:13:56,883 - lava_callback - INFO - Received callback for node 69e65ec547863bb428fe4cc1 INFO: 172.20.0.1:38772 - "POST /node/69e65ec547863bb428fe4cc1 HTTP/1.0" 202 Accepted 2026-04-22 17:13:56,890 - lava_callback - INFO - Starting async job submit for node 69e65ec547863bb428fe4cc1 2026-04-22 17:13:56,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:13:56,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65ec547863bb428fe4cc1 HTTP/1.1" 200 None 2026-04-22 17:13:56,908 - lava_callback - DEBUG - Processing node 69e65ec547863bb428fe4cc1: baseline-arm64-baylibre 2026-04-22 17:13:56,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65ec547863bb428fe4cc1 2026-04-22 17:13:56,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:13:56,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65ec547863bb428fe4cc1 HTTP/1.1" 200 None 2026-04-22 17:13:56,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:13:56,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:13:56,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:13:56,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65ec547863bb428fe4cc1 HTTP/1.1" 200 None 2026-04-22 17:13:56,958 - lava_callback - ERROR - Error processing callback for node 69e65ec547863bb428fe4cc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52368 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:15:17,004 - lava_callback - INFO - Received callback for node 69e65f1847863bb428fe4d0b INFO: 172.20.0.1:52382 - "POST /node/69e65f1847863bb428fe4d0b HTTP/1.0" 202 Accepted 2026-04-22 17:15:17,012 - lava_callback - INFO - Starting async job submit for node 69e65f1847863bb428fe4d0b 2026-04-22 17:15:17,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:15:17,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65f1847863bb428fe4d0b HTTP/1.1" 200 None 2026-04-22 17:15:17,035 - lava_callback - DEBUG - Processing node 69e65f1847863bb428fe4d0b: baseline-arm64-baylibre 2026-04-22 17:15:17,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65f1847863bb428fe4d0b 2026-04-22 17:15:17,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:15:17,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65f1847863bb428fe4d0b HTTP/1.1" 200 None 2026-04-22 17:15:17,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:15:17,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:15:17,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:15:17,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65f1847863bb428fe4d0b HTTP/1.1" 200 None 2026-04-22 17:15:17,088 - lava_callback - ERROR - Error processing callback for node 69e65f1847863bb428fe4d0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60304 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:16:56,903 - lava_callback - INFO - Received callback for node 69e65f7547863bb428fe4d2c INFO: 172.20.0.1:60320 - "POST /node/69e65f7547863bb428fe4d2c HTTP/1.0" 202 Accepted 2026-04-22 17:16:56,909 - lava_callback - INFO - Starting async job submit for node 69e65f7547863bb428fe4d2c 2026-04-22 17:16:56,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:16:56,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65f7547863bb428fe4d2c HTTP/1.1" 200 None 2026-04-22 17:16:56,925 - lava_callback - DEBUG - Processing node 69e65f7547863bb428fe4d2c: baseline-arm64-clabbe 2026-04-22 17:16:56,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65f7547863bb428fe4d2c 2026-04-22 17:16:56,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:16:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65f7547863bb428fe4d2c HTTP/1.1" 200 None 2026-04-22 17:16:56,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:16:56,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:16:56,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:16:57,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65f7547863bb428fe4d2c HTTP/1.1" 200 None 2026-04-22 17:16:57,019 - lava_callback - ERROR - Error processing callback for node 69e65f7547863bb428fe4d2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36872 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:18:16,960 - lava_callback - INFO - Received callback for node 69e65fcc47863bb428fe4d56 INFO: 172.20.0.1:36874 - "POST /node/69e65fcc47863bb428fe4d56 HTTP/1.0" 202 Accepted 2026-04-22 17:18:16,965 - lava_callback - INFO - Starting async job submit for node 69e65fcc47863bb428fe4d56 2026-04-22 17:18:16,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:18:16,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65fcc47863bb428fe4d56 HTTP/1.1" 200 None 2026-04-22 17:18:16,994 - lava_callback - DEBUG - Processing node 69e65fcc47863bb428fe4d56: baseline-arm64-clabbe 2026-04-22 17:18:16,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e65fcc47863bb428fe4d56 2026-04-22 17:18:16,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:18:17,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e65fcc47863bb428fe4d56 HTTP/1.1" 200 None 2026-04-22 17:18:17,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:18:17,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:18:17,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:18:17,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e65fcc47863bb428fe4d56 HTTP/1.1" 200 None 2026-04-22 17:18:17,079 - lava_callback - ERROR - Error processing callback for node 69e65fcc47863bb428fe4d56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51612 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:19:37,027 - lava_callback - INFO - Received callback for node 69e6602047863bb428fe4d86 INFO: 172.20.0.1:51624 - "POST /node/69e6602047863bb428fe4d86 HTTP/1.0" 202 Accepted 2026-04-22 17:19:37,032 - lava_callback - INFO - Starting async job submit for node 69e6602047863bb428fe4d86 2026-04-22 17:19:37,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:19:37,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6602047863bb428fe4d86 HTTP/1.1" 200 None 2026-04-22 17:19:37,046 - lava_callback - DEBUG - Processing node 69e6602047863bb428fe4d86: baseline-arm64-clabbe 2026-04-22 17:19:37,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6602047863bb428fe4d86 2026-04-22 17:19:37,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:19:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6602047863bb428fe4d86 HTTP/1.1" 200 None 2026-04-22 17:19:37,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:19:37,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:19:37,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:19:37,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6602047863bb428fe4d86 HTTP/1.1" 200 None 2026-04-22 17:19:37,093 - lava_callback - ERROR - Error processing callback for node 69e6602047863bb428fe4d86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:20:57,068 - lava_callback - INFO - Received callback for node 69e6607547863bb428fe4da8 INFO: 172.20.0.1:40214 - "POST /node/69e6607547863bb428fe4da8 HTTP/1.0" 202 Accepted 2026-04-22 17:20:57,076 - lava_callback - INFO - Starting async job submit for node 69e6607547863bb428fe4da8 2026-04-22 17:20:57,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:20:57,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6607547863bb428fe4da8 HTTP/1.1" 200 None 2026-04-22 17:20:57,092 - lava_callback - DEBUG - Processing node 69e6607547863bb428fe4da8: baseline-arm64-clabbe 2026-04-22 17:20:57,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6607547863bb428fe4da8 2026-04-22 17:20:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:20:57,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6607547863bb428fe4da8 HTTP/1.1" 200 None 2026-04-22 17:20:57,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:20:57,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:20:57,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:20:57,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6607547863bb428fe4da8 HTTP/1.1" 200 None 2026-04-22 17:20:57,148 - lava_callback - ERROR - Error processing callback for node 69e6607547863bb428fe4da8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55220 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:22:37,249 - lava_callback - INFO - Received callback for node 69e660cb47863bb428fe4dc9 INFO: 172.20.0.1:55230 - "POST /node/69e660cb47863bb428fe4dc9 HTTP/1.0" 202 Accepted 2026-04-22 17:22:37,255 - lava_callback - INFO - Starting async job submit for node 69e660cb47863bb428fe4dc9 2026-04-22 17:22:37,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:22:37,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e660cb47863bb428fe4dc9 HTTP/1.1" 200 None 2026-04-22 17:22:37,274 - lava_callback - DEBUG - Processing node 69e660cb47863bb428fe4dc9: baseline-arm64-clabbe 2026-04-22 17:22:37,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e660cb47863bb428fe4dc9 2026-04-22 17:22:37,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:22:37,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e660cb47863bb428fe4dc9 HTTP/1.1" 200 None 2026-04-22 17:22:37,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:22:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:22:37,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:22:37,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e660cb47863bb428fe4dc9 HTTP/1.1" 200 None 2026-04-22 17:22:37,361 - lava_callback - ERROR - Error processing callback for node 69e660cb47863bb428fe4dc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34908 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:23:57,222 - lava_callback - INFO - Received callback for node 69e6612247863bb428fe4de1 INFO: 172.20.0.1:34924 - "POST /node/69e6612247863bb428fe4de1 HTTP/1.0" 202 Accepted 2026-04-22 17:23:57,228 - lava_callback - INFO - Starting async job submit for node 69e6612247863bb428fe4de1 2026-04-22 17:23:57,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:23:57,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6612247863bb428fe4de1 HTTP/1.1" 200 None 2026-04-22 17:23:57,243 - lava_callback - DEBUG - Processing node 69e6612247863bb428fe4de1: baseline-arm64-clabbe 2026-04-22 17:23:57,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6612247863bb428fe4de1 2026-04-22 17:23:57,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:23:57,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6612247863bb428fe4de1 HTTP/1.1" 200 None 2026-04-22 17:23:57,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:23:57,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:23:57,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:23:57,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6612247863bb428fe4de1 HTTP/1.1" 200 None 2026-04-22 17:23:57,307 - lava_callback - ERROR - Error processing callback for node 69e6612247863bb428fe4de1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60812 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:25:17,279 - lava_callback - INFO - Received callback for node 69e6617747863bb428fe4e00 INFO: 172.20.0.1:60820 - "POST /node/69e6617747863bb428fe4e00 HTTP/1.0" 202 Accepted 2026-04-22 17:25:17,285 - lava_callback - INFO - Starting async job submit for node 69e6617747863bb428fe4e00 2026-04-22 17:25:17,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:25:17,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6617747863bb428fe4e00 HTTP/1.1" 200 None 2026-04-22 17:25:17,301 - lava_callback - DEBUG - Processing node 69e6617747863bb428fe4e00: baseline-arm64-clabbe 2026-04-22 17:25:17,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6617747863bb428fe4e00 2026-04-22 17:25:17,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:25:17,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6617747863bb428fe4e00 HTTP/1.1" 200 None 2026-04-22 17:25:17,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:25:17,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-22 17:25:17,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:25:17,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6617747863bb428fe4e00 HTTP/1.1" 200 None 2026-04-22 17:25:17,351 - lava_callback - ERROR - Error processing callback for node 69e6617747863bb428fe4e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33134 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:26:14,464 - lava_callback - INFO - Received callback for node 69e904aa8327522856daf1e6 INFO: 172.20.0.1:44048 - "POST /node/69e904aa8327522856daf1e6 HTTP/1.0" 202 Accepted 2026-04-22 17:26:14,471 - lava_callback - INFO - Starting async job submit for node 69e904aa8327522856daf1e6 2026-04-22 17:26:14,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:14,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904aa8327522856daf1e6 HTTP/1.1" 200 None 2026-04-22 17:26:14,502 - lava_callback - DEBUG - Processing node 69e904aa8327522856daf1e6: baseline-nfs-arm64 2026-04-22 17:26:14,505 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:26:14,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:14,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:14,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904aa8327522856daf1e6/lava-logs.yaml 2026-04-22 17:26:14,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:14,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:14,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904aa8327522856daf1e6/lava_callback.json.gz 2026-04-22 17:26:14,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904aa8327522856daf1e6 HTTP/1.1" 200 None 2026-04-22 17:26:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:26:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:14,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904aa8327522856daf1e6 HTTP/1.1" 200 None 2026-04-22 17:26:14,762 - lava_callback - INFO - Completed processing callback for node 69e904aa8327522856daf1e6 INFO: 172.20.0.1:44062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:26:26,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:26,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57466 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:26:40,171 - lava_callback - INFO - Received callback for node 69e904948327522856daf190 INFO: 172.20.0.1:43126 - "POST /node/69e904948327522856daf190 HTTP/1.0" 202 Accepted 2026-04-22 17:26:40,181 - lava_callback - INFO - Starting async job submit for node 69e904948327522856daf190 2026-04-22 17:26:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:40,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904948327522856daf190 HTTP/1.1" 200 None 2026-04-22 17:26:40,248 - lava_callback - DEBUG - Processing node 69e904948327522856daf190: baseline-arm64 2026-04-22 17:26:40,419 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:26:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:40,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:40,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904948327522856daf190/lava-logs.yaml 2026-04-22 17:26:40,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:40,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:40,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904948327522856daf190/lava_callback.json.gz 2026-04-22 17:26:40,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:40,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904948327522856daf190 HTTP/1.1" 200 None 2026-04-22 17:26:40,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:40,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:26:40,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:40,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904948327522856daf190 HTTP/1.1" 200 None 2026-04-22 17:26:40,965 - lava_callback - INFO - Completed processing callback for node 69e904948327522856daf190 2026-04-22 17:26:45,217 - lava_callback - INFO - Received callback for node 69e9049c8327522856daf1a5 INFO: 172.20.0.1:43142 - "POST /node/69e9049c8327522856daf1a5 HTTP/1.0" 202 Accepted 2026-04-22 17:26:45,224 - lava_callback - INFO - Starting async job submit for node 69e9049c8327522856daf1a5 2026-04-22 17:26:45,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:45,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049c8327522856daf1a5 HTTP/1.1" 200 None 2026-04-22 17:26:45,267 - lava_callback - DEBUG - Processing node 69e9049c8327522856daf1a5: baseline-arm64 2026-04-22 17:26:45,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:45,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:45,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049c8327522856daf1a5/log.txt.gz 2026-04-22 17:26:45,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:45,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:45,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049c8327522856daf1a5/lava-logs.yaml 2026-04-22 17:26:45,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:46,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:46,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049c8327522856daf1a5/lava_callback.json.gz 2026-04-22 17:26:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:46,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049c8327522856daf1a5 HTTP/1.1" 200 None 2026-04-22 17:26:46,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:46,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:26:46,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:46,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049c8327522856daf1a5 HTTP/1.1" 200 None 2026-04-22 17:26:46,183 - lava_callback - INFO - Completed processing callback for node 69e9049c8327522856daf1a5 INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:26:54,636 - lava_callback - INFO - Received callback for node 69e904928327522856daf18a INFO: 172.20.0.1:58110 - "POST /node/69e904928327522856daf18a HTTP/1.0" 202 Accepted 2026-04-22 17:26:54,643 - lava_callback - INFO - Starting async job submit for node 69e904928327522856daf18a 2026-04-22 17:26:54,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904928327522856daf18a HTTP/1.1" 200 None 2026-04-22 17:26:54,681 - lava_callback - DEBUG - Processing node 69e904928327522856daf18a: baseline-arm64 2026-04-22 17:26:55,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:55,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:55,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904928327522856daf18a/log.txt.gz 2026-04-22 17:26:55,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:55,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:55,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904928327522856daf18a/lava-logs.yaml 2026-04-22 17:26:55,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:55,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:55,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904928327522856daf18a/lava_callback.json.gz 2026-04-22 17:26:55,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:55,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904928327522856daf18a HTTP/1.1" 200 None 2026-04-22 17:26:55,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:55,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:26:55,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:55,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904928327522856daf18a HTTP/1.1" 200 None 2026-04-22 17:26:55,702 - lava_callback - INFO - Completed processing callback for node 69e904928327522856daf18a 2026-04-22 17:26:56,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:56,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:26:59,289 - lava_callback - INFO - Received callback for node 69e904958327522856daf193 INFO: 172.20.0.1:58130 - "POST /node/69e904958327522856daf193 HTTP/1.0" 202 Accepted 2026-04-22 17:26:59,298 - lava_callback - INFO - Starting async job submit for node 69e904958327522856daf193 2026-04-22 17:26:59,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:26:59,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904958327522856daf193 HTTP/1.1" 200 None 2026-04-22 17:26:59,345 - lava_callback - DEBUG - Processing node 69e904958327522856daf193: baseline-arm64 2026-04-22 17:26:59,567 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:26:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:59,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:59,906 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904958327522856daf193/lava-logs.yaml 2026-04-22 17:26:59,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:26:59,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:26:59,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904958327522856daf193/lava_callback.json.gz 2026-04-22 17:27:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:00,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904958327522856daf193 HTTP/1.1" 200 None 2026-04-22 17:27:00,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:00,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:00,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904958327522856daf193 HTTP/1.1" 200 None 2026-04-22 17:27:00,183 - lava_callback - INFO - Completed processing callback for node 69e904958327522856daf193 2026-04-22 17:27:03,872 - lava_callback - INFO - Received callback for node 69e904908327522856daf184 INFO: 172.20.0.1:44530 - "POST /node/69e904908327522856daf184 HTTP/1.0" 202 Accepted 2026-04-22 17:27:03,878 - lava_callback - INFO - Starting async job submit for node 69e904908327522856daf184 2026-04-22 17:27:03,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:03,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904908327522856daf184 HTTP/1.1" 200 None 2026-04-22 17:27:03,912 - lava_callback - DEBUG - Processing node 69e904908327522856daf184: baseline-arm64 2026-04-22 17:27:04,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:04,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:04,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904908327522856daf184/log.txt.gz 2026-04-22 17:27:04,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:04,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:04,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904908327522856daf184/lava-logs.yaml 2026-04-22 17:27:04,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:04,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:04,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904908327522856daf184/lava_callback.json.gz 2026-04-22 17:27:04,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:04,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904908327522856daf184 HTTP/1.1" 200 None 2026-04-22 17:27:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:04,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:04,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:04,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904908327522856daf184 HTTP/1.1" 200 None 2026-04-22 17:27:04,704 - lava_callback - INFO - Completed processing callback for node 69e904908327522856daf184 INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:27:13,565 - lava_callback - INFO - Received callback for node 69e9049f8327522856daf1c8 INFO: 172.20.0.1:57376 - "POST /node/69e9049f8327522856daf1c8 HTTP/1.0" 202 Accepted 2026-04-22 17:27:13,571 - lava_callback - INFO - Starting async job submit for node 69e9049f8327522856daf1c8 2026-04-22 17:27:13,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:13,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049f8327522856daf1c8 HTTP/1.1" 200 None 2026-04-22 17:27:13,613 - lava_callback - DEBUG - Processing node 69e9049f8327522856daf1c8: baseline-arm64 2026-04-22 17:27:13,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:14,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:14,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049f8327522856daf1c8/log.txt.gz 2026-04-22 17:27:14,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:14,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:14,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049f8327522856daf1c8/lava-logs.yaml 2026-04-22 17:27:14,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:14,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:14,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049f8327522856daf1c8/lava_callback.json.gz 2026-04-22 17:27:14,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:14,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049f8327522856daf1c8 HTTP/1.1" 200 None 2026-04-22 17:27:14,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:14,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:14,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:14,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049f8327522856daf1c8 HTTP/1.1" 200 None 2026-04-22 17:27:14,741 - lava_callback - INFO - Completed processing callback for node 69e9049f8327522856daf1c8 INFO: 172.20.0.1:57386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57392 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:27:20,544 - lava_callback - INFO - Received callback for node 69e904a18327522856daf1ce INFO: 172.20.0.1:37050 - "POST /node/69e904a18327522856daf1ce HTTP/1.0" 202 Accepted 2026-04-22 17:27:20,552 - lava_callback - INFO - Starting async job submit for node 69e904a18327522856daf1ce 2026-04-22 17:27:20,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:20,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a18327522856daf1ce HTTP/1.1" 200 None 2026-04-22 17:27:20,602 - lava_callback - DEBUG - Processing node 69e904a18327522856daf1ce: baseline-arm64 2026-04-22 17:27:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:21,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:21,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a18327522856daf1ce/log.txt.gz 2026-04-22 17:27:21,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:21,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:21,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a18327522856daf1ce/lava-logs.yaml 2026-04-22 17:27:21,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:21,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:21,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a18327522856daf1ce/lava_callback.json.gz 2026-04-22 17:27:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:21,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a18327522856daf1ce HTTP/1.1" 200 None 2026-04-22 17:27:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:21,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:21,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:21,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a18327522856daf1ce HTTP/1.1" 200 None 2026-04-22 17:27:21,667 - lava_callback - INFO - Completed processing callback for node 69e904a18327522856daf1ce 2026-04-22 17:27:26,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:26,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:37064 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:27:29,119 - lava_callback - INFO - Received callback for node 69e904918327522856daf187 INFO: 172.20.0.1:37076 - "POST /node/69e904918327522856daf187 HTTP/1.0" 202 Accepted 2026-04-22 17:27:29,128 - lava_callback - INFO - Starting async job submit for node 69e904918327522856daf187 2026-04-22 17:27:29,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:29,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904918327522856daf187 HTTP/1.1" 200 None 2026-04-22 17:27:29,172 - lava_callback - DEBUG - Processing node 69e904918327522856daf187: baseline-arm64 2026-04-22 17:27:29,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:29,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:29,558 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904918327522856daf187/log.txt.gz 2026-04-22 17:27:29,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:29,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:29,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904918327522856daf187/lava-logs.yaml 2026-04-22 17:27:29,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:29,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:29,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904918327522856daf187/lava_callback.json.gz 2026-04-22 17:27:29,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:30,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904918327522856daf187 HTTP/1.1" 200 None 2026-04-22 17:27:30,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:30,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:30,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:30,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904918327522856daf187 HTTP/1.1" 200 None 2026-04-22 17:27:30,046 - lava_callback - INFO - Completed processing callback for node 69e904918327522856daf187 2026-04-22 17:27:32,216 - lava_callback - INFO - Received callback for node 69e904a08327522856daf1cb INFO: 172.20.0.1:37716 - "POST /node/69e904a08327522856daf1cb HTTP/1.0" 202 Accepted 2026-04-22 17:27:32,223 - lava_callback - INFO - Starting async job submit for node 69e904a08327522856daf1cb 2026-04-22 17:27:32,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:32,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a08327522856daf1cb HTTP/1.1" 200 None 2026-04-22 17:27:32,263 - lava_callback - DEBUG - Processing node 69e904a08327522856daf1cb: baseline-arm64 2026-04-22 17:27:32,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:32,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:32,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a08327522856daf1cb/log.txt.gz 2026-04-22 17:27:32,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:32,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:32,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a08327522856daf1cb/lava-logs.yaml 2026-04-22 17:27:33,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:33,054 - lava_callback - INFO - Received callback for node 69e904998327522856daf19f INFO: 172.20.0.1:37732 - "POST /node/69e904998327522856daf19f HTTP/1.0" 202 Accepted 2026-04-22 17:27:33,062 - lava_callback - INFO - Starting async job submit for node 69e904998327522856daf19f 2026-04-22 17:27:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:33,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904998327522856daf19f HTTP/1.1" 200 None 2026-04-22 17:27:33,111 - lava_callback - DEBUG - Processing node 69e904998327522856daf19f: baseline-arm64 2026-04-22 17:27:33,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:33,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a08327522856daf1cb/lava_callback.json.gz 2026-04-22 17:27:33,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:33,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a08327522856daf1cb HTTP/1.1" 200 None 2026-04-22 17:27:33,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:33,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:33,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:33,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a08327522856daf1cb HTTP/1.1" 200 None 2026-04-22 17:27:33,569 - lava_callback - INFO - Completed processing callback for node 69e904a08327522856daf1cb 2026-04-22 17:27:33,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:33,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:33,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904998327522856daf19f/log.txt.gz 2026-04-22 17:27:34,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:34,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:34,184 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904998327522856daf19f/lava-logs.yaml 2026-04-22 17:27:34,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:34,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:34,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904998327522856daf19f/lava_callback.json.gz 2026-04-22 17:27:34,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:34,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904998327522856daf19f HTTP/1.1" 200 None 2026-04-22 17:27:34,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:34,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:34,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904998327522856daf19f HTTP/1.1" 200 None 2026-04-22 17:27:34,455 - lava_callback - INFO - Completed processing callback for node 69e904998327522856daf19f 2026-04-22 17:27:34,461 - lava_callback - INFO - Received callback for node 69e9049d8327522856daf1bf INFO: 172.20.0.1:37748 - "POST /node/69e9049d8327522856daf1bf HTTP/1.0" 202 Accepted 2026-04-22 17:27:34,472 - lava_callback - INFO - Starting async job submit for node 69e9049d8327522856daf1bf 2026-04-22 17:27:34,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:34,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049d8327522856daf1bf HTTP/1.1" 200 None 2026-04-22 17:27:34,544 - lava_callback - DEBUG - Processing node 69e9049d8327522856daf1bf: baseline-arm64 2026-04-22 17:27:34,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:34,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:34,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049d8327522856daf1bf/log.txt.gz 2026-04-22 17:27:35,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:35,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:35,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049d8327522856daf1bf/lava-logs.yaml 2026-04-22 17:27:35,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:35,292 - lava_callback - INFO - Received callback for node 69e904938327522856daf18d INFO: 172.20.0.1:37764 - "POST /node/69e904938327522856daf18d HTTP/1.0" 202 Accepted 2026-04-22 17:27:35,299 - lava_callback - INFO - Starting async job submit for node 69e904938327522856daf18d 2026-04-22 17:27:35,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:35,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:35,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049d8327522856daf1bf/lava_callback.json.gz 2026-04-22 17:27:35,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904938327522856daf18d HTTP/1.1" 200 None 2026-04-22 17:27:35,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:35,357 - lava_callback - DEBUG - Processing node 69e904938327522856daf18d: baseline-arm64 2026-04-22 17:27:35,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049d8327522856daf1bf HTTP/1.1" 200 None 2026-04-22 17:27:35,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:35,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:35,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:35,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049d8327522856daf1bf HTTP/1.1" 200 None 2026-04-22 17:27:35,653 - lava_callback - INFO - Completed processing callback for node 69e9049d8327522856daf1bf 2026-04-22 17:27:35,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:35,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904938327522856daf18d/log.txt.gz 2026-04-22 17:27:35,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:36,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:36,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904938327522856daf18d/lava-logs.yaml 2026-04-22 17:27:36,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:36,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:36,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904938327522856daf18d/lava_callback.json.gz 2026-04-22 17:27:36,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:36,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904938327522856daf18d HTTP/1.1" 200 None 2026-04-22 17:27:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:36,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:36,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904938327522856daf18d HTTP/1.1" 200 None 2026-04-22 17:27:36,274 - lava_callback - INFO - Completed processing callback for node 69e904938327522856daf18d INFO: 172.20.0.1:37770 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:27:37,020 - lava_callback - INFO - Received callback for node 69e904988327522856daf19c INFO: 172.20.0.1:37774 - "POST /node/69e904988327522856daf19c HTTP/1.0" 202 Accepted 2026-04-22 17:27:37,031 - lava_callback - INFO - Starting async job submit for node 69e904988327522856daf19c 2026-04-22 17:27:37,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:37,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904988327522856daf19c HTTP/1.1" 200 None 2026-04-22 17:27:37,112 - lava_callback - DEBUG - Processing node 69e904988327522856daf19c: baseline-arm64 2026-04-22 17:27:37,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:37,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:37,575 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904988327522856daf19c/log.txt.gz 2026-04-22 17:27:37,670 - lava_callback - INFO - Received callback for node 69e6620247863bb428fe4e35 INFO: 172.20.0.1:37786 - "POST /node/69e6620247863bb428fe4e35 HTTP/1.0" 202 Accepted 2026-04-22 17:27:37,687 - lava_callback - INFO - Starting async job submit for node 69e6620247863bb428fe4e35 2026-04-22 17:27:37,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:37,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6620247863bb428fe4e35 HTTP/1.1" 200 None 2026-04-22 17:27:37,775 - lava_callback - DEBUG - Processing node 69e6620247863bb428fe4e35: baseline-arm64-baylibre 2026-04-22 17:27:37,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6620247863bb428fe4e35 2026-04-22 17:27:37,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:37,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:37,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6620247863bb428fe4e35 HTTP/1.1" 200 None 2026-04-22 17:27:37,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:37,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:27:37,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:37,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6620247863bb428fe4e35 HTTP/1.1" 200 None 2026-04-22 17:27:37,870 - lava_callback - ERROR - Error processing callback for node 69e6620247863bb428fe4e35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 17:27:38,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:38,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904988327522856daf19c/lava-logs.yaml 2026-04-22 17:27:38,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:38,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:38,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904988327522856daf19c/lava_callback.json.gz 2026-04-22 17:27:38,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:38,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904988327522856daf19c HTTP/1.1" 200 None 2026-04-22 17:27:38,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:38,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:38,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:38,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904988327522856daf19c HTTP/1.1" 200 None 2026-04-22 17:27:38,199 - lava_callback - INFO - Completed processing callback for node 69e904988327522856daf19c 2026-04-22 17:27:41,967 - lava_callback - INFO - Received callback for node 69e904d28327522856daf26f INFO: 172.20.0.1:53428 - "POST /node/69e904d28327522856daf26f HTTP/1.0" 202 Accepted 2026-04-22 17:27:41,973 - lava_callback - INFO - Starting async job submit for node 69e904d28327522856daf26f 2026-04-22 17:27:41,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:42,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d28327522856daf26f HTTP/1.1" 200 None 2026-04-22 17:27:42,010 - lava_callback - DEBUG - Processing node 69e904d28327522856daf26f: baseline-arm64-pengutronix 2026-04-22 17:27:42,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:42,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:42,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d28327522856daf26f/log.txt.gz 2026-04-22 17:27:42,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:42,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:42,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d28327522856daf26f/lava-logs.yaml 2026-04-22 17:27:42,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:42,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:42,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d28327522856daf26f/lava_callback.json.gz 2026-04-22 17:27:42,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d28327522856daf26f HTTP/1.1" 200 None 2026-04-22 17:27:42,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:42,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:42,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:42,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d28327522856daf26f HTTP/1.1" 200 None 2026-04-22 17:27:42,772 - lava_callback - INFO - Completed processing callback for node 69e904d28327522856daf26f 2026-04-22 17:27:45,732 - lava_callback - INFO - Received callback for node 69e904d18327522856daf26c INFO: 172.20.0.1:53442 - "POST /node/69e904d18327522856daf26c HTTP/1.0" 202 Accepted 2026-04-22 17:27:45,739 - lava_callback - INFO - Starting async job submit for node 69e904d18327522856daf26c 2026-04-22 17:27:45,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d18327522856daf26c HTTP/1.1" 200 None 2026-04-22 17:27:45,796 - lava_callback - DEBUG - Processing node 69e904d18327522856daf26c: baseline-arm64-kontron 2026-04-22 17:27:46,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:46,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:46,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e904d18327522856daf26c/log.txt.gz 2026-04-22 17:27:46,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53448 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:27:46,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:46,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e904d18327522856daf26c/lava-logs.yaml 2026-04-22 17:27:46,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:46,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:46,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e904d18327522856daf26c/lava_callback.json.gz 2026-04-22 17:27:46,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:46,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d18327522856daf26c HTTP/1.1" 200 None 2026-04-22 17:27:46,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:46,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:46,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:46,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d18327522856daf26c HTTP/1.1" 200 None 2026-04-22 17:27:46,772 - lava_callback - INFO - Completed processing callback for node 69e904d18327522856daf26c 2026-04-22 17:27:47,553 - lava_callback - INFO - Received callback for node 69e904978327522856daf199 INFO: 172.20.0.1:53460 - "POST /node/69e904978327522856daf199 HTTP/1.0" 202 Accepted 2026-04-22 17:27:47,564 - lava_callback - INFO - Starting async job submit for node 69e904978327522856daf199 2026-04-22 17:27:47,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:47,611 - lava_callback - INFO - Received callback for node 69e904d38327522856daf272 INFO: 172.20.0.1:53466 - "POST /node/69e904d38327522856daf272 HTTP/1.0" 202 Accepted 2026-04-22 17:27:47,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904978327522856daf199 HTTP/1.1" 200 None 2026-04-22 17:27:47,621 - lava_callback - INFO - Starting async job submit for node 69e904d38327522856daf272 2026-04-22 17:27:47,638 - lava_callback - DEBUG - Processing node 69e904978327522856daf199: baseline-arm64 2026-04-22 17:27:47,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:47,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d38327522856daf272 HTTP/1.1" 200 None 2026-04-22 17:27:47,745 - lava_callback - DEBUG - Processing node 69e904d38327522856daf272: baseline-arm64-pengutronix 2026-04-22 17:27:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:48,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:48,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:48,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904978327522856daf199/log.txt.gz 2026-04-22 17:27:48,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:48,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d38327522856daf272/log.txt.gz 2026-04-22 17:27:48,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:48,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:48,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:48,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d38327522856daf272/lava-logs.yaml 2026-04-22 17:27:48,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:48,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:48,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904978327522856daf199/lava-logs.yaml 2026-04-22 17:27:49,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:49,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:49,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:49,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d38327522856daf272/lava_callback.json.gz 2026-04-22 17:27:49,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904978327522856daf199/lava_callback.json.gz 2026-04-22 17:27:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d38327522856daf272 HTTP/1.1" 200 None 2026-04-22 17:27:49,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904978327522856daf199 HTTP/1.1" 200 None 2026-04-22 17:27:49,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:49,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:49,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d38327522856daf272 HTTP/1.1" 200 None 2026-04-22 17:27:49,233 - lava_callback - INFO - Completed processing callback for node 69e904d38327522856daf272 2026-04-22 17:27:49,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904978327522856daf199 HTTP/1.1" 200 None 2026-04-22 17:27:49,237 - lava_callback - INFO - Completed processing callback for node 69e904978327522856daf199 2026-04-22 17:27:49,496 - lava_callback - INFO - Received callback for node 69e904a68327522856daf1da INFO: 172.20.0.1:53470 - "POST /node/69e904a68327522856daf1da HTTP/1.0" 202 Accepted 2026-04-22 17:27:49,503 - lava_callback - INFO - Starting async job submit for node 69e904a68327522856daf1da 2026-04-22 17:27:49,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:49,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a68327522856daf1da HTTP/1.1" 200 None 2026-04-22 17:27:49,543 - lava_callback - DEBUG - Processing node 69e904a68327522856daf1da: baseline-nfs-arm64 2026-04-22 17:27:50,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:50,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:50,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a68327522856daf1da/log.txt.gz 2026-04-22 17:27:50,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:50,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:50,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a68327522856daf1da/lava-logs.yaml 2026-04-22 17:27:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:50,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:50,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a68327522856daf1da/lava_callback.json.gz 2026-04-22 17:27:50,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:50,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a68327522856daf1da HTTP/1.1" 200 None 2026-04-22 17:27:50,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:50,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:50,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:50,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a68327522856daf1da HTTP/1.1" 200 None 2026-04-22 17:27:50,865 - lava_callback - INFO - Completed processing callback for node 69e904a68327522856daf1da 2026-04-22 17:27:51,009 - lava_callback - INFO - Received callback for node 69e9049a8327522856daf1a2 INFO: 172.20.0.1:45994 - "POST /node/69e9049a8327522856daf1a2 HTTP/1.0" 202 Accepted 2026-04-22 17:27:51,016 - lava_callback - INFO - Starting async job submit for node 69e9049a8327522856daf1a2 2026-04-22 17:27:51,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:51,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049a8327522856daf1a2 HTTP/1.1" 200 None 2026-04-22 17:27:51,062 - lava_callback - DEBUG - Processing node 69e9049a8327522856daf1a2: baseline-arm64 2026-04-22 17:27:51,406 - lava_callback - INFO - Received callback for node 69e904d68327522856daf279 INFO: 172.20.0.1:45998 - "POST /node/69e904d68327522856daf279 HTTP/1.0" 202 Accepted 2026-04-22 17:27:51,420 - lava_callback - INFO - Starting async job submit for node 69e904d68327522856daf279 2026-04-22 17:27:51,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:51,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d68327522856daf279 HTTP/1.1" 200 None 2026-04-22 17:27:51,590 - lava_callback - DEBUG - Processing node 69e904d68327522856daf279: baseline-arm64-foundriesio 2026-04-22 17:27:51,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:51,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:51,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:51,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049a8327522856daf1a2/log.txt.gz 2026-04-22 17:27:51,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:51,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf279/log.txt.gz 2026-04-22 17:27:52,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:52,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:52,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:52,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf279/lava-logs.yaml 2026-04-22 17:27:52,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:52,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:52,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049a8327522856daf1a2/lava-logs.yaml 2026-04-22 17:27:52,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:52,719 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf279/lava_callback.json.gz 2026-04-22 17:27:52,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:27:52,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:52,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d68327522856daf279 HTTP/1.1" 200 None 2026-04-22 17:27:52,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:52,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:52,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:52,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d68327522856daf279 HTTP/1.1" 200 None 2026-04-22 17:27:52,815 - lava_callback - INFO - Completed processing callback for node 69e904d68327522856daf279 2026-04-22 17:27:52,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:27:52,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049a8327522856daf1a2/lava_callback.json.gz 2026-04-22 17:27:52,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:52,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049a8327522856daf1a2 HTTP/1.1" 200 None 2026-04-22 17:27:53,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:53,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:27:53,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:53,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049a8327522856daf1a2 HTTP/1.1" 200 None 2026-04-22 17:27:53,114 - lava_callback - INFO - Completed processing callback for node 69e9049a8327522856daf1a2 2026-04-22 17:27:56,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:27:56,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:08,246 - lava_callback - INFO - Received callback for node 69e904d48327522856daf276 INFO: 172.20.0.1:55204 - "POST /node/69e904d48327522856daf276 HTTP/1.0" 202 Accepted 2026-04-22 17:28:08,252 - lava_callback - INFO - Starting async job submit for node 69e904d48327522856daf276 2026-04-22 17:28:08,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:08,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d48327522856daf276 HTTP/1.1" 200 None 2026-04-22 17:28:08,298 - lava_callback - DEBUG - Processing node 69e904d48327522856daf276: baseline-arm64-pengutronix 2026-04-22 17:28:08,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:08,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:08,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d48327522856daf276/log.txt.gz 2026-04-22 17:28:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:08,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:08,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d48327522856daf276/lava-logs.yaml 2026-04-22 17:28:08,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:08,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:08,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e904d48327522856daf276/lava_callback.json.gz 2026-04-22 17:28:09,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:09,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d48327522856daf276 HTTP/1.1" 200 None 2026-04-22 17:28:09,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:09,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:09,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:09,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d48327522856daf276 HTTP/1.1" 200 None 2026-04-22 17:28:09,058 - lava_callback - INFO - Completed processing callback for node 69e904d48327522856daf276 2026-04-22 17:28:13,136 - lava_callback - INFO - Received callback for node 69e904a88327522856daf1e0 INFO: 172.20.0.1:46868 - "POST /node/69e904a88327522856daf1e0 HTTP/1.0" 202 Accepted 2026-04-22 17:28:13,144 - lava_callback - INFO - Starting async job submit for node 69e904a88327522856daf1e0 2026-04-22 17:28:13,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:13,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a88327522856daf1e0 HTTP/1.1" 200 None 2026-04-22 17:28:13,190 - lava_callback - DEBUG - Processing node 69e904a88327522856daf1e0: baseline-nfs-arm64 2026-04-22 17:28:13,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:13,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:13,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a88327522856daf1e0/log.txt.gz 2026-04-22 17:28:14,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:14,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:14,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a88327522856daf1e0/lava-logs.yaml 2026-04-22 17:28:14,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:14,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:14,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a88327522856daf1e0/lava_callback.json.gz 2026-04-22 17:28:14,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:14,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a88327522856daf1e0 HTTP/1.1" 200 None 2026-04-22 17:28:14,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:14,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:14,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:14,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a88327522856daf1e0 HTTP/1.1" 200 None 2026-04-22 17:28:14,743 - lava_callback - INFO - Completed processing callback for node 69e904a88327522856daf1e0 INFO: 172.20.0.1:46884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46896 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:19,746 - lava_callback - INFO - Received callback for node 69e904a98327522856daf1e3 INFO: 172.20.0.1:44324 - "POST /node/69e904a98327522856daf1e3 HTTP/1.0" 202 Accepted 2026-04-22 17:28:19,755 - lava_callback - INFO - Starting async job submit for node 69e904a98327522856daf1e3 2026-04-22 17:28:19,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:19,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a98327522856daf1e3 HTTP/1.1" 200 None 2026-04-22 17:28:19,794 - lava_callback - DEBUG - Processing node 69e904a98327522856daf1e3: baseline-nfs-arm64 2026-04-22 17:28:20,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:20,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:20,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a98327522856daf1e3/log.txt.gz 2026-04-22 17:28:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:21,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:21,193 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a98327522856daf1e3/lava-logs.yaml 2026-04-22 17:28:21,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:21,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:21,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a98327522856daf1e3/lava_callback.json.gz 2026-04-22 17:28:21,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:21,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a98327522856daf1e3 HTTP/1.1" 200 None 2026-04-22 17:28:21,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:21,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:21,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:21,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a98327522856daf1e3 HTTP/1.1" 200 None 2026-04-22 17:28:21,402 - lava_callback - INFO - Completed processing callback for node 69e904a98327522856daf1e3 2026-04-22 17:28:26,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:26,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44326 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:31,453 - lava_callback - INFO - Received callback for node 69e904c28327522856daf243 INFO: 172.20.0.1:41022 - "POST /node/69e904c28327522856daf243 HTTP/1.0" 202 Accepted 2026-04-22 17:28:31,460 - lava_callback - INFO - Starting async job submit for node 69e904c28327522856daf243 2026-04-22 17:28:31,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:31,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c28327522856daf243 HTTP/1.1" 200 None 2026-04-22 17:28:31,501 - lava_callback - DEBUG - Processing node 69e904c28327522856daf243: baseline-arm64-broonie 2026-04-22 17:28:31,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:31,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:31,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c28327522856daf243/log.txt.gz 2026-04-22 17:28:32,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:32,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:32,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c28327522856daf243/lava-logs.yaml 2026-04-22 17:28:32,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:32,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:32,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c28327522856daf243/lava_callback.json.gz 2026-04-22 17:28:32,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:32,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c28327522856daf243 HTTP/1.1" 200 None 2026-04-22 17:28:32,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:32,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:32,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c28327522856daf243 HTTP/1.1" 200 None 2026-04-22 17:28:32,395 - lava_callback - INFO - Completed processing callback for node 69e904c28327522856daf243 2026-04-22 17:28:32,844 - lava_callback - INFO - Received callback for node 69e904ac8327522856daf1e9 INFO: 172.20.0.1:41026 - "POST /node/69e904ac8327522856daf1e9 HTTP/1.0" 202 Accepted 2026-04-22 17:28:32,851 - lava_callback - INFO - Starting async job submit for node 69e904ac8327522856daf1e9 2026-04-22 17:28:32,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:32,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ac8327522856daf1e9 HTTP/1.1" 200 None 2026-04-22 17:28:32,892 - lava_callback - DEBUG - Processing node 69e904ac8327522856daf1e9: baseline-nfs-arm64 2026-04-22 17:28:33,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:33,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:33,384 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ac8327522856daf1e9/log.txt.gz 2026-04-22 17:28:33,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:33,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:33,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ac8327522856daf1e9/lava-logs.yaml 2026-04-22 17:28:33,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:33,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:33,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ac8327522856daf1e9/lava_callback.json.gz 2026-04-22 17:28:33,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:33,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ac8327522856daf1e9 HTTP/1.1" 200 None 2026-04-22 17:28:33,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:33,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:33,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:33,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904ac8327522856daf1e9 HTTP/1.1" 200 None 2026-04-22 17:28:33,954 - lava_callback - INFO - Completed processing callback for node 69e904ac8327522856daf1e9 INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:38,082 - lava_callback - INFO - Received callback for node 69e904ae8327522856daf1ef INFO: 172.20.0.1:41046 - "POST /node/69e904ae8327522856daf1ef HTTP/1.0" 202 Accepted 2026-04-22 17:28:38,088 - lava_callback - INFO - Starting async job submit for node 69e904ae8327522856daf1ef 2026-04-22 17:28:38,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:38,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ae8327522856daf1ef HTTP/1.1" 200 None 2026-04-22 17:28:38,129 - lava_callback - DEBUG - Processing node 69e904ae8327522856daf1ef: baseline-nfs-arm64 2026-04-22 17:28:38,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:38,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:38,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ae8327522856daf1ef/log.txt.gz 2026-04-22 17:28:38,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:39,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:39,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ae8327522856daf1ef/lava-logs.yaml 2026-04-22 17:28:39,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:39,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:39,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ae8327522856daf1ef/lava_callback.json.gz 2026-04-22 17:28:39,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ae8327522856daf1ef HTTP/1.1" 200 None 2026-04-22 17:28:39,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:39,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:39,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:39,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904ae8327522856daf1ef HTTP/1.1" 200 None 2026-04-22 17:28:39,344 - lava_callback - INFO - Completed processing callback for node 69e904ae8327522856daf1ef 2026-04-22 17:28:41,855 - lava_callback - INFO - Received callback for node 69e904b18327522856daf1f5 INFO: 172.20.0.1:44816 - "POST /node/69e904b18327522856daf1f5 HTTP/1.0" 202 Accepted 2026-04-22 17:28:41,866 - lava_callback - INFO - Starting async job submit for node 69e904b18327522856daf1f5 2026-04-22 17:28:41,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904b18327522856daf1f5 HTTP/1.1" 200 None 2026-04-22 17:28:41,917 - lava_callback - DEBUG - Processing node 69e904b18327522856daf1f5: baseline-nfs-arm64 2026-04-22 17:28:42,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:42,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:42,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904b18327522856daf1f5/log.txt.gz 2026-04-22 17:28:42,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:42,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:42,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904b18327522856daf1f5/lava-logs.yaml 2026-04-22 17:28:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:43,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:43,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904b18327522856daf1f5/lava_callback.json.gz 2026-04-22 17:28:43,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:43,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904b18327522856daf1f5 HTTP/1.1" 200 None 2026-04-22 17:28:43,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:43,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:43,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:43,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904b18327522856daf1f5 HTTP/1.1" 200 None 2026-04-22 17:28:43,200 - lava_callback - INFO - Completed processing callback for node 69e904b18327522856daf1f5 INFO: 172.20.0.1:44820 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:54,313 - lava_callback - INFO - Received callback for node 69e904c98327522856daf24f INFO: 172.20.0.1:36166 - "POST /node/69e904c98327522856daf24f HTTP/1.0" 202 Accepted 2026-04-22 17:28:54,323 - lava_callback - INFO - Starting async job submit for node 69e904c98327522856daf24f 2026-04-22 17:28:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:54,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c98327522856daf24f HTTP/1.1" 200 None 2026-04-22 17:28:54,371 - lava_callback - DEBUG - Processing node 69e904c98327522856daf24f: baseline-arm64-broonie 2026-04-22 17:28:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:54,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:54,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c98327522856daf24f/log.txt.gz 2026-04-22 17:28:54,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:55,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:55,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c98327522856daf24f/lava-logs.yaml 2026-04-22 17:28:55,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:55,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:55,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c98327522856daf24f/lava_callback.json.gz 2026-04-22 17:28:55,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:55,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c98327522856daf24f HTTP/1.1" 200 None 2026-04-22 17:28:55,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:55,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:55,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:55,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c98327522856daf24f HTTP/1.1" 200 None 2026-04-22 17:28:55,344 - lava_callback - INFO - Completed processing callback for node 69e904c98327522856daf24f 2026-04-22 17:28:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:56,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:28:57,440 - lava_callback - INFO - Received callback for node 69e904a48327522856daf1d4 INFO: 172.20.0.1:36184 - "POST /node/69e904a48327522856daf1d4 HTTP/1.0" 202 Accepted 2026-04-22 17:28:57,446 - lava_callback - INFO - Starting async job submit for node 69e904a48327522856daf1d4 2026-04-22 17:28:57,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:57,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a48327522856daf1d4 HTTP/1.1" 200 None 2026-04-22 17:28:57,490 - lava_callback - DEBUG - Processing node 69e904a48327522856daf1d4: baseline-nfs-arm64 2026-04-22 17:28:57,685 - lava_callback - INFO - Received callback for node 69e904af8327522856daf1f2 INFO: 172.20.0.1:36190 - "POST /node/69e904af8327522856daf1f2 HTTP/1.0" 202 Accepted 2026-04-22 17:28:57,707 - lava_callback - INFO - Starting async job submit for node 69e904af8327522856daf1f2 2026-04-22 17:28:57,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:57,773 - lava_callback - INFO - Received callback for node 69e6625647863bb428fe4e5d 2026-04-22 17:28:57,794 - lava_callback - INFO - Starting async job submit for node 69e6625647863bb428fe4e5d INFO: 172.20.0.1:36206 - "POST /node/69e6625647863bb428fe4e5d HTTP/1.0" 202 Accepted 2026-04-22 17:28:57,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:57,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904af8327522856daf1f2 HTTP/1.1" 200 None 2026-04-22 17:28:57,903 - lava_callback - DEBUG - Processing node 69e904af8327522856daf1f2: baseline-nfs-arm64 2026-04-22 17:28:57,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6625647863bb428fe4e5d HTTP/1.1" 200 None 2026-04-22 17:28:57,942 - lava_callback - DEBUG - Processing node 69e6625647863bb428fe4e5d: baseline-arm64-baylibre 2026-04-22 17:28:57,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6625647863bb428fe4e5d 2026-04-22 17:28:57,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:58,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:58,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6625647863bb428fe4e5d HTTP/1.1" 200 None 2026-04-22 17:28:58,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:58,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:28:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:58,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:58,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a48327522856daf1d4/log.txt.gz 2026-04-22 17:28:58,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6625647863bb428fe4e5d HTTP/1.1" 200 None 2026-04-22 17:28:58,353 - lava_callback - ERROR - Error processing callback for node 69e6625647863bb428fe4e5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 17:28:58,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:58,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:58,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904af8327522856daf1f2/log.txt.gz 2026-04-22 17:28:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:58,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:58,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a48327522856daf1d4/lava-logs.yaml 2026-04-22 17:28:58,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:58,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:59,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:59,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a48327522856daf1d4/lava_callback.json.gz 2026-04-22 17:28:59,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:59,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904af8327522856daf1f2/lava-logs.yaml 2026-04-22 17:28:59,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:28:59,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a48327522856daf1d4 HTTP/1.1" 200 None 2026-04-22 17:28:59,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:59,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a48327522856daf1d4 HTTP/1.1" 200 None 2026-04-22 17:28:59,115 - lava_callback - INFO - Completed processing callback for node 69e904a48327522856daf1d4 2026-04-22 17:28:59,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:28:59,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904af8327522856daf1f2/lava_callback.json.gz 2026-04-22 17:28:59,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904af8327522856daf1f2 HTTP/1.1" 200 None 2026-04-22 17:28:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:28:59,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:28:59,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904af8327522856daf1f2 HTTP/1.1" 200 None 2026-04-22 17:28:59,314 - lava_callback - INFO - Completed processing callback for node 69e904af8327522856daf1f2 INFO: 172.20.0.1:51476 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:29:13,068 - lava_callback - INFO - Received callback for node 69e904968327522856daf196 INFO: 172.20.0.1:39782 - "POST /node/69e904968327522856daf196 HTTP/1.0" 202 Accepted 2026-04-22 17:29:13,073 - lava_callback - INFO - Starting async job submit for node 69e904968327522856daf196 2026-04-22 17:29:13,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:29:13,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904968327522856daf196 HTTP/1.1" 200 None 2026-04-22 17:29:13,116 - lava_callback - DEBUG - Processing node 69e904968327522856daf196: baseline-arm64 2026-04-22 17:29:13,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:29:13,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:29:13,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904968327522856daf196/log.txt.gz 2026-04-22 17:29:13,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:29:13,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:29:13,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904968327522856daf196/lava-logs.yaml 2026-04-22 17:29:13,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:29:14,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:29:14,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904968327522856daf196/lava_callback.json.gz 2026-04-22 17:29:14,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:29:14,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904968327522856daf196 HTTP/1.1" 200 None 2026-04-22 17:29:14,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:29:14,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:29:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:29:14,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904968327522856daf196 HTTP/1.1" 200 None 2026-04-22 17:29:14,188 - lava_callback - INFO - Completed processing callback for node 69e904968327522856daf196 INFO: 172.20.0.1:39792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:29:26,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:29:26,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:30:05,505 - lava_callback - INFO - Received callback for node 69e904d68327522856daf280 INFO: 172.20.0.1:38724 - "POST /node/69e904d68327522856daf280 HTTP/1.0" 202 Accepted 2026-04-22 17:30:05,518 - lava_callback - INFO - Starting async job submit for node 69e904d68327522856daf280 2026-04-22 17:30:05,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:05,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d68327522856daf280 HTTP/1.1" 200 None 2026-04-22 17:30:05,598 - lava_callback - DEBUG - Processing node 69e904d68327522856daf280: baseline-arm64-foundriesio 2026-04-22 17:30:06,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38732 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:30:06,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:06,553 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf280/log.txt.gz 2026-04-22 17:30:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:07,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:07,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf280/lava-logs.yaml 2026-04-22 17:30:07,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:07,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:07,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e904d68327522856daf280/lava_callback.json.gz DEBUG: 69e904d68327522856daf280 Transitting job node result: pass -> incomplete 2026-04-22 17:30:07,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:07,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904d68327522856daf280 HTTP/1.1" 200 None 2026-04-22 17:30:07,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:07,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:30:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:07,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904d68327522856daf280 HTTP/1.1" 200 None 2026-04-22 17:30:07,528 - lava_callback - INFO - Completed processing callback for node 69e904d68327522856daf280 INFO: 172.20.0.1:34498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:30:22,627 - lava_callback - INFO - Received callback for node 69e904a58327522856daf1d7 INFO: 172.20.0.1:33370 - "POST /node/69e904a58327522856daf1d7 HTTP/1.0" 202 Accepted 2026-04-22 17:30:22,634 - lava_callback - INFO - Starting async job submit for node 69e904a58327522856daf1d7 2026-04-22 17:30:22,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:22,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a58327522856daf1d7 HTTP/1.1" 200 None 2026-04-22 17:30:22,668 - lava_callback - DEBUG - Processing node 69e904a58327522856daf1d7: baseline-nfs-arm64 2026-04-22 17:30:23,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:23,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:23,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a58327522856daf1d7/log.txt.gz 2026-04-22 17:30:23,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:23,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:23,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a58327522856daf1d7/lava-logs.yaml 2026-04-22 17:30:23,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:23,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:23,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a58327522856daf1d7/lava_callback.json.gz 2026-04-22 17:30:23,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:23,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a58327522856daf1d7 HTTP/1.1" 200 None 2026-04-22 17:30:23,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:23,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:30:23,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:23,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a58327522856daf1d7 HTTP/1.1" 200 None 2026-04-22 17:30:23,800 - lava_callback - INFO - Completed processing callback for node 69e904a58327522856daf1d7 2026-04-22 17:30:26,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:26,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37434 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:30:37,761 - lava_callback - INFO - Received callback for node 69e662aa47863bb428fe4e89 INFO: 172.20.0.1:37448 - "POST /node/69e662aa47863bb428fe4e89 HTTP/1.0" 202 Accepted 2026-04-22 17:30:37,766 - lava_callback - INFO - Starting async job submit for node 69e662aa47863bb428fe4e89 2026-04-22 17:30:37,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:37,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e662aa47863bb428fe4e89 HTTP/1.1" 200 None 2026-04-22 17:30:37,781 - lava_callback - DEBUG - Processing node 69e662aa47863bb428fe4e89: baseline-arm64-baylibre 2026-04-22 17:30:37,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e662aa47863bb428fe4e89 2026-04-22 17:30:37,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:37,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e662aa47863bb428fe4e89 HTTP/1.1" 200 None 2026-04-22 17:30:37,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:37,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:30:37,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:37,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e662aa47863bb428fe4e89 HTTP/1.1" 200 None 2026-04-22 17:30:37,839 - lava_callback - ERROR - Error processing callback for node 69e662aa47863bb428fe4e89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:30:55,039 - lava_callback - INFO - Received callback for node 69e904c38327522856daf246 INFO: 172.20.0.1:40742 - "POST /node/69e904c38327522856daf246 HTTP/1.0" 202 Accepted 2026-04-22 17:30:55,045 - lava_callback - INFO - Starting async job submit for node 69e904c38327522856daf246 2026-04-22 17:30:55,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:55,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c38327522856daf246 HTTP/1.1" 200 None 2026-04-22 17:30:55,082 - lava_callback - DEBUG - Processing node 69e904c38327522856daf246: baseline-arm64-broonie 2026-04-22 17:30:55,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:55,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:55,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c38327522856daf246/log.txt.gz 2026-04-22 17:30:55,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:55,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:55,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c38327522856daf246/lava-logs.yaml 2026-04-22 17:30:55,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:30:55,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:30:55,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c38327522856daf246/lava_callback.json.gz 2026-04-22 17:30:55,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:55,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c38327522856daf246 HTTP/1.1" 200 None 2026-04-22 17:30:55,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:55,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:30:55,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:55,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c38327522856daf246 HTTP/1.1" 200 None 2026-04-22 17:30:55,961 - lava_callback - INFO - Completed processing callback for node 69e904c38327522856daf246 2026-04-22 17:30:56,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:30:56,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49348 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:31:28,419 - lava_callback - INFO - Received callback for node 69e905d58327522856daf3e7 INFO: 172.20.0.1:49364 - "POST /node/69e905d58327522856daf3e7 HTTP/1.0" 202 Accepted 2026-04-22 17:31:28,427 - lava_callback - INFO - Starting async job submit for node 69e905d58327522856daf3e7 2026-04-22 17:31:28,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:28,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905d58327522856daf3e7 HTTP/1.1" 200 None 2026-04-22 17:31:28,473 - lava_callback - DEBUG - Processing node 69e905d58327522856daf3e7: baseline-x86 2026-04-22 17:31:28,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:28,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:28,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d58327522856daf3e7/log.txt.gz 2026-04-22 17:31:28,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:29,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:29,032 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d58327522856daf3e7/lava-logs.yaml 2026-04-22 17:31:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:29,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:29,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d58327522856daf3e7/lava_callback.json.gz 2026-04-22 17:31:29,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:29,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905d58327522856daf3e7 HTTP/1.1" 200 None 2026-04-22 17:31:29,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:29,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:31:29,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:29,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e905d58327522856daf3e7 HTTP/1.1" 200 None 2026-04-22 17:31:29,219 - lava_callback - INFO - Completed processing callback for node 69e905d58327522856daf3e7 2026-04-22 17:31:32,892 - lava_callback - INFO - Received callback for node 69e905d68327522856daf3ea INFO: 172.20.0.1:35942 - "POST /node/69e905d68327522856daf3ea HTTP/1.0" 202 Accepted 2026-04-22 17:31:32,898 - lava_callback - INFO - Starting async job submit for node 69e905d68327522856daf3ea 2026-04-22 17:31:32,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:32,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905d68327522856daf3ea HTTP/1.1" 200 None 2026-04-22 17:31:32,983 - lava_callback - DEBUG - Processing node 69e905d68327522856daf3ea: baseline-x86 2026-04-22 17:31:33,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:33,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:33,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d68327522856daf3ea/log.txt.gz 2026-04-22 17:31:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:33,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:33,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d68327522856daf3ea/lava-logs.yaml 2026-04-22 17:31:33,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:31:33,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:31:33,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e905d68327522856daf3ea/lava_callback.json.gz 2026-04-22 17:31:33,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:33,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905d68327522856daf3ea HTTP/1.1" 200 None 2026-04-22 17:31:33,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:33,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 17:31:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:33,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e905d68327522856daf3ea HTTP/1.1" 200 None 2026-04-22 17:31:33,737 - lava_callback - INFO - Completed processing callback for node 69e905d68327522856daf3ea INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58854 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:31:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:56,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48600 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:31:57,616 - lava_callback - INFO - Received callback for node 69e6630447863bb428fe4ebf INFO: 172.20.0.1:48604 - "POST /node/69e6630447863bb428fe4ebf HTTP/1.0" 202 Accepted 2026-04-22 17:31:57,621 - lava_callback - INFO - Starting async job submit for node 69e6630447863bb428fe4ebf 2026-04-22 17:31:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6630447863bb428fe4ebf HTTP/1.1" 200 None 2026-04-22 17:31:57,636 - lava_callback - DEBUG - Processing node 69e6630447863bb428fe4ebf: baseline-arm64-clabbe 2026-04-22 17:31:57,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6630447863bb428fe4ebf 2026-04-22 17:31:57,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:57,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6630447863bb428fe4ebf HTTP/1.1" 200 None 2026-04-22 17:31:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:57,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:31:57,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:31:57,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6630447863bb428fe4ebf HTTP/1.1" 200 None 2026-04-22 17:31:57,692 - lava_callback - ERROR - Error processing callback for node 69e6630447863bb428fe4ebf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42358 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:34:04,656 - lava_callback - INFO - Received callback for node 69e904a28327522856daf1d1 INFO: 172.20.0.1:52368 - "POST /node/69e904a28327522856daf1d1 HTTP/1.0" 202 Accepted 2026-04-22 17:34:04,663 - lava_callback - INFO - Starting async job submit for node 69e904a28327522856daf1d1 2026-04-22 17:34:04,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a28327522856daf1d1 HTTP/1.1" 200 None 2026-04-22 17:34:04,714 - lava_callback - DEBUG - Processing node 69e904a28327522856daf1d1: baseline-arm64 2026-04-22 17:34:05,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:34:05,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:34:05,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a28327522856daf1d1/log.txt.gz 2026-04-22 17:34:05,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:34:05,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:34:05,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a28327522856daf1d1/lava-logs.yaml 2026-04-22 17:34:05,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:34:05,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:34:05,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e904a28327522856daf1d1/lava_callback.json.gz DEBUG: Setup failed for 69e904a28327522856daf1d1. Transitting job node result: incomplete -> fail 2026-04-22 17:34:05,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a28327522856daf1d1 HTTP/1.1" 200 None 2026-04-22 17:34:05,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:06,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:34:06,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:06,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a28327522856daf1d1 HTTP/1.1" 200 None 2026-04-22 17:34:06,085 - lava_callback - INFO - Completed processing callback for node 69e904a28327522856daf1d1 INFO: 172.20.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43464 - "GET /node/699279ec98a8bdb31c3940cf%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-22 17:34:26,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:26,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:34:57,693 - lava_callback - INFO - Received callback for node 69e663b247863bb428fe4ed9 INFO: 172.20.0.1:49866 - "POST /node/69e663b247863bb428fe4ed9 HTTP/1.0" 202 Accepted 2026-04-22 17:34:57,700 - lava_callback - INFO - Starting async job submit for node 69e663b247863bb428fe4ed9 2026-04-22 17:34:57,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e663b247863bb428fe4ed9 HTTP/1.1" 200 None 2026-04-22 17:34:57,719 - lava_callback - DEBUG - Processing node 69e663b247863bb428fe4ed9: baseline-arm64-clabbe 2026-04-22 17:34:57,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e663b247863bb428fe4ed9 2026-04-22 17:34:57,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:57,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e663b247863bb428fe4ed9 HTTP/1.1" 200 None 2026-04-22 17:34:57,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:57,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:34:57,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:34:57,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e663b247863bb428fe4ed9 HTTP/1.1" 200 None 2026-04-22 17:34:57,770 - lava_callback - ERROR - Error processing callback for node 69e663b247863bb428fe4ed9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET /node/6992e68031166481c8dd745e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54330 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:37:03,392 - lava_callback - INFO - Received callback for node 69e9049e8327522856daf1c4 INFO: 172.20.0.1:38732 - "POST /node/69e9049e8327522856daf1c4 HTTP/1.0" 202 Accepted 2026-04-22 17:37:03,401 - lava_callback - INFO - Starting async job submit for node 69e9049e8327522856daf1c4 2026-04-22 17:37:03,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:03,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049e8327522856daf1c4 HTTP/1.1" 200 None 2026-04-22 17:37:03,443 - lava_callback - DEBUG - Processing node 69e9049e8327522856daf1c4: baseline-arm64 2026-04-22 17:37:04,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:04,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:04,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049e8327522856daf1c4/log.txt.gz 2026-04-22 17:37:04,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:04,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:04,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049e8327522856daf1c4/lava-logs.yaml 2026-04-22 17:37:04,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:04,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:04,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9049e8327522856daf1c4/lava_callback.json.gz 2026-04-22 17:37:04,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:04,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049e8327522856daf1c4 HTTP/1.1" 200 None 2026-04-22 17:37:04,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:04,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:37:04,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:04,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049e8327522856daf1c4 HTTP/1.1" 200 None 2026-04-22 17:37:05,041 - lava_callback - INFO - Completed processing callback for node 69e9049e8327522856daf1c4 INFO: 172.20.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:37:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:26,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:37:32,199 - lava_callback - INFO - Received callback for node 69e904ad8327522856daf1ec INFO: 172.20.0.1:44626 - "POST /node/69e904ad8327522856daf1ec HTTP/1.0" 202 Accepted 2026-04-22 17:37:32,208 - lava_callback - INFO - Starting async job submit for node 69e904ad8327522856daf1ec 2026-04-22 17:37:32,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:32,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ad8327522856daf1ec HTTP/1.1" 200 None 2026-04-22 17:37:32,256 - lava_callback - DEBUG - Processing node 69e904ad8327522856daf1ec: baseline-nfs-arm64 2026-04-22 17:37:33,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:33,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:33,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ad8327522856daf1ec/log.txt.gz 2026-04-22 17:37:33,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:33,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:33,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ad8327522856daf1ec/lava-logs.yaml 2026-04-22 17:37:33,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:33,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:33,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904ad8327522856daf1ec/lava_callback.json.gz 2026-04-22 17:37:33,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:33,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904ad8327522856daf1ec HTTP/1.1" 200 None 2026-04-22 17:37:33,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:33,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:37:33,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:33,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904ad8327522856daf1ec HTTP/1.1" 200 None 2026-04-22 17:37:33,804 - lava_callback - INFO - Completed processing callback for node 69e904ad8327522856daf1ec INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:37:37,770 - lava_callback - INFO - Received callback for node 69e6645347863bb428fe4f0a INFO: 172.20.0.1:44646 - "POST /node/69e6645347863bb428fe4f0a HTTP/1.0" 202 Accepted 2026-04-22 17:37:37,776 - lava_callback - INFO - Starting async job submit for node 69e6645347863bb428fe4f0a 2026-04-22 17:37:37,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:37,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6645347863bb428fe4f0a HTTP/1.1" 200 None 2026-04-22 17:37:37,790 - lava_callback - DEBUG - Processing node 69e6645347863bb428fe4f0a: baseline-arm64-clabbe 2026-04-22 17:37:37,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6645347863bb428fe4f0a 2026-04-22 17:37:37,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:37,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6645347863bb428fe4f0a HTTP/1.1" 200 None 2026-04-22 17:37:37,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:37,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:37:37,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:37,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6645347863bb428fe4f0a HTTP/1.1" 200 None 2026-04-22 17:37:37,835 - lava_callback - ERROR - Error processing callback for node 69e6645347863bb428fe4f0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:37:52,120 - lava_callback - INFO - Received callback for node 69e904c78327522856daf24c INFO: 172.20.0.1:44692 - "POST /node/69e904c78327522856daf24c HTTP/1.0" 202 Accepted 2026-04-22 17:37:52,131 - lava_callback - INFO - Starting async job submit for node 69e904c78327522856daf24c 2026-04-22 17:37:52,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:52,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c78327522856daf24c HTTP/1.1" 200 None 2026-04-22 17:37:52,182 - lava_callback - DEBUG - Processing node 69e904c78327522856daf24c: baseline-arm64-broonie 2026-04-22 17:37:52,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:52,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:52,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c78327522856daf24c/log.txt.gz 2026-04-22 17:37:52,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:52,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:52,952 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c78327522856daf24c/lava-logs.yaml 2026-04-22 17:37:52,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:37:53,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:37:53,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c78327522856daf24c/lava_callback.json.gz 2026-04-22 17:37:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:53,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c78327522856daf24c HTTP/1.1" 200 None 2026-04-22 17:37:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:53,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:37:53,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:53,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c78327522856daf24c HTTP/1.1" 200 None 2026-04-22 17:37:53,132 - lava_callback - INFO - Completed processing callback for node 69e904c78327522856daf24c 2026-04-22 17:37:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:37:56,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET /node/6983787166dc8a56088a52bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:38:57,839 - lava_callback - INFO - Received callback for node 69e664ab47863bb428fe4f37 INFO: 172.20.0.1:45178 - "POST /node/69e664ab47863bb428fe4f37 HTTP/1.0" 202 Accepted 2026-04-22 17:38:57,848 - lava_callback - INFO - Starting async job submit for node 69e664ab47863bb428fe4f37 2026-04-22 17:38:57,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:38:57,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e664ab47863bb428fe4f37 HTTP/1.1" 200 None 2026-04-22 17:38:57,865 - lava_callback - DEBUG - Processing node 69e664ab47863bb428fe4f37: baseline-arm64-clabbe 2026-04-22 17:38:57,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e664ab47863bb428fe4f37 2026-04-22 17:38:57,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:38:57,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e664ab47863bb428fe4f37 HTTP/1.1" 200 None 2026-04-22 17:38:57,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:38:57,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:38:57,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:38:57,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e664ab47863bb428fe4f37 HTTP/1.1" 200 None 2026-04-22 17:38:57,929 - lava_callback - ERROR - Error processing callback for node 69e664ab47863bb428fe4f37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:40:37,957 - lava_callback - INFO - Received callback for node 69e6650347863bb428fe4f5d INFO: 172.20.0.1:56976 - "POST /node/69e6650347863bb428fe4f5d HTTP/1.0" 202 Accepted 2026-04-22 17:40:37,962 - lava_callback - INFO - Starting async job submit for node 69e6650347863bb428fe4f5d 2026-04-22 17:40:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:40:37,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6650347863bb428fe4f5d HTTP/1.1" 200 None 2026-04-22 17:40:37,977 - lava_callback - DEBUG - Processing node 69e6650347863bb428fe4f5d: baseline-arm64-clabbe 2026-04-22 17:40:37,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6650347863bb428fe4f5d 2026-04-22 17:40:37,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:40:37,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6650347863bb428fe4f5d HTTP/1.1" 200 None 2026-04-22 17:40:37,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:40:38,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:40:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:40:38,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6650347863bb428fe4f5d HTTP/1.1" 200 None 2026-04-22 17:40:38,022 - lava_callback - ERROR - Error processing callback for node 69e6650347863bb428fe4f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:41:57,987 - lava_callback - INFO - Received callback for node 69e6655947863bb428fe4f70 INFO: 172.20.0.1:34836 - "POST /node/69e6655947863bb428fe4f70 HTTP/1.0" 202 Accepted 2026-04-22 17:41:57,993 - lava_callback - INFO - Starting async job submit for node 69e6655947863bb428fe4f70 2026-04-22 17:41:57,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:41:58,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6655947863bb428fe4f70 HTTP/1.1" 200 None 2026-04-22 17:41:58,007 - lava_callback - DEBUG - Processing node 69e6655947863bb428fe4f70: baseline-arm64-clabbe 2026-04-22 17:41:58,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6655947863bb428fe4f70 2026-04-22 17:41:58,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:41:58,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6655947863bb428fe4f70 HTTP/1.1" 200 None 2026-04-22 17:41:58,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:41:58,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:41:58,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:41:58,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6655947863bb428fe4f70 HTTP/1.1" 200 None 2026-04-22 17:41:58,097 - lava_callback - ERROR - Error processing callback for node 69e6655947863bb428fe4f70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:42:16,902 - lava_callback - INFO - Received callback for node 69e904518327522856daf157 INFO: 172.20.0.1:49786 - "POST /node/69e904518327522856daf157 HTTP/1.0" 202 Accepted 2026-04-22 17:42:16,909 - lava_callback - INFO - Starting async job submit for node 69e904518327522856daf157 2026-04-22 17:42:16,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:42:16,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904518327522856daf157 HTTP/1.1" 200 None 2026-04-22 17:42:17,000 - lava_callback - DEBUG - Processing node 69e904518327522856daf157: ltp-smoke 2026-04-22 17:42:17,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:42:17,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:42:17,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e904518327522856daf157/log.txt.gz 2026-04-22 17:42:17,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:42:18,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:42:18,055 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e904518327522856daf157/lava-logs.yaml 2026-04-22 17:42:18,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:42:18,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:42:18,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e904518327522856daf157/lava_callback.json.gz 2026-04-22 17:42:18,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:42:18,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904518327522856daf157 HTTP/1.1" 200 None 2026-04-22 17:42:18,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:42:18,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4cc8327522856dac252 HTTP/1.1" 200 None 2026-04-22 17:42:18,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:42:18,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904518327522856daf157 HTTP/1.1" 200 None 2026-04-22 17:42:18,465 - lava_callback - INFO - Completed processing callback for node 69e904518327522856daf157 2026-04-22 17:42:26,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:42:26,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:43:14,359 - lava_callback - INFO - Received callback for node 69e9049e8327522856daf1c2 INFO: 172.20.0.1:37452 - "POST /node/69e9049e8327522856daf1c2 HTTP/1.0" 202 Accepted 2026-04-22 17:43:14,366 - lava_callback - INFO - Starting async job submit for node 69e9049e8327522856daf1c2 2026-04-22 17:43:14,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:14,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049e8327522856daf1c2 HTTP/1.1" 200 None 2026-04-22 17:43:14,455 - lava_callback - DEBUG - Processing node 69e9049e8327522856daf1c2: baseline-arm 2026-04-22 17:43:15,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:43:15,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:43:15,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e9049e8327522856daf1c2/log.txt.gz INFO: 172.20.0.1:37468 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 17:43:15,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:43:15,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:43:15,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e9049e8327522856daf1c2/lava-logs.yaml 2026-04-22 17:43:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:43:15,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:43:15,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e9049e8327522856daf1c2/lava_callback.json.gz DEBUG: Setup failed for 69e9049e8327522856daf1c2. Transitting job node result: incomplete -> fail 2026-04-22 17:43:16,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:16,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9049e8327522856daf1c2 HTTP/1.1" 200 None 2026-04-22 17:43:16,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:16,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 17:43:16,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:16,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9049e8327522856daf1c2 HTTP/1.1" 200 None 2026-04-22 17:43:16,192 - lava_callback - INFO - Completed processing callback for node 69e9049e8327522856daf1c2 INFO: 172.20.0.1:37480 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:43:18,030 - lava_callback - INFO - Received callback for node 69e665af47863bb428fe4fa0 INFO: 172.20.0.1:37494 - "POST /node/69e665af47863bb428fe4fa0 HTTP/1.0" 202 Accepted 2026-04-22 17:43:18,039 - lava_callback - INFO - Starting async job submit for node 69e665af47863bb428fe4fa0 2026-04-22 17:43:18,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:18,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e665af47863bb428fe4fa0 HTTP/1.1" 200 None 2026-04-22 17:43:18,061 - lava_callback - DEBUG - Processing node 69e665af47863bb428fe4fa0: baseline-arm64-clabbe 2026-04-22 17:43:18,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e665af47863bb428fe4fa0 2026-04-22 17:43:18,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:18,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e665af47863bb428fe4fa0 HTTP/1.1" 200 None 2026-04-22 17:43:18,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:18,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3af097f5347282fbdbc87 HTTP/1.1" 200 None 2026-04-22 17:43:18,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:18,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e665af47863bb428fe4fa0 HTTP/1.1" 200 None 2026-04-22 17:43:18,120 - lava_callback - ERROR - Error processing callback for node 69e665af47863bb428fe4fa0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 17:43:26,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:43:26,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60920 - "GET /node/6951848f2df1719e393ca1b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET /node/69884cffe408e9ea60fad779%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET /node/69523be65318368af0c49cbe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:46:42,185 - lava_callback - INFO - Received callback for node 69e904a78327522856daf1dd INFO: 172.20.0.1:36170 - "POST /node/69e904a78327522856daf1dd HTTP/1.0" 202 Accepted 2026-04-22 17:46:42,195 - lava_callback - INFO - Starting async job submit for node 69e904a78327522856daf1dd 2026-04-22 17:46:42,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:46:42,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a78327522856daf1dd HTTP/1.1" 200 None 2026-04-22 17:46:42,271 - lava_callback - DEBUG - Processing node 69e904a78327522856daf1dd: baseline-nfs-arm64 2026-04-22 17:46:43,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:46:43,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:46:43,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a78327522856daf1dd/log.txt.gz 2026-04-22 17:46:44,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:46:44,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:46:44,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a78327522856daf1dd/lava-logs.yaml 2026-04-22 17:46:44,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:46:44,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:46:44,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e904a78327522856daf1dd/lava_callback.json.gz DEBUG: Setup failed for 69e904a78327522856daf1dd. Transitting job node result: incomplete -> fail 2026-04-22 17:46:44,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:46:45,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904a78327522856daf1dd HTTP/1.1" 200 None 2026-04-22 17:46:45,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:46:45,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:46:45,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:46:45,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904a78327522856daf1dd HTTP/1.1" 200 None 2026-04-22 17:46:45,127 - lava_callback - INFO - Completed processing callback for node 69e904a78327522856daf1dd INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:46:56,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:46:56,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46740 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:47:15,112 - lava_callback - INFO - Received callback for node 69e905198327522856daf334 INFO: 172.20.0.1:33520 - "POST /node/69e905198327522856daf334 HTTP/1.0" 202 Accepted 2026-04-22 17:47:15,161 - lava_callback - INFO - Starting async job submit for node 69e905198327522856daf334 INFO: 172.20.0.1:33536 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 17:47:15,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:47:15,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905198327522856daf334 HTTP/1.1" 200 None 2026-04-22 17:47:15,201 - lava_callback - DEBUG - Processing node 69e905198327522856daf334: baseline-arm-pengutronix 2026-04-22 17:47:15,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:47:15,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:47:15,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e905198327522856daf334/log.txt.gz 2026-04-22 17:47:15,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:47:15,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:47:15,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e905198327522856daf334/lava-logs.yaml 2026-04-22 17:47:15,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:47:15,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:47:15,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e905198327522856daf334/lava_callback.json.gz DEBUG: Setup failed for 69e905198327522856daf334. Transitting job node result: incomplete -> fail 2026-04-22 17:47:15,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:47:15,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e905198327522856daf334 HTTP/1.1" 200 None 2026-04-22 17:47:15,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:47:15,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 17:47:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:47:15,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e905198327522856daf334 HTTP/1.1" 200 None 2026-04-22 17:47:15,875 - lava_callback - INFO - Completed processing callback for node 69e905198327522856daf334 INFO: 172.20.0.1:33548 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:47:26,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:47:26,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40892 - "GET /node/6990ace1c45febfe44521a97%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49664 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:50:54,583 - lava_callback - INFO - Received callback for node 69e90a6d8327522856daf718 INFO: 172.20.0.1:60330 - "POST /node/69e90a6d8327522856daf718 HTTP/1.0" 202 Accepted 2026-04-22 17:50:54,592 - lava_callback - INFO - Starting async job submit for node 69e90a6d8327522856daf718 2026-04-22 17:50:54,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:50:54,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90a6d8327522856daf718 HTTP/1.1" 200 None 2026-04-22 17:50:54,611 - lava_callback - DEBUG - Processing node 69e90a6d8327522856daf718: baseline-nfs-arm64 2026-04-22 17:50:54,613 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:50:54,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:50:54,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:50:54,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e90a6d8327522856daf718/lava-logs.yaml 2026-04-22 17:50:54,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:50:54,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:50:54,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e90a6d8327522856daf718/lava_callback.json.gz 2026-04-22 17:50:54,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:50:54,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90a6d8327522856daf718 HTTP/1.1" 200 None 2026-04-22 17:50:54,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:50:54,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:50:54,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:50:54,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90a6d8327522856daf718 HTTP/1.1" 200 None 2026-04-22 17:50:54,890 - lava_callback - INFO - Completed processing callback for node 69e90a6d8327522856daf718 2026-04-22 17:50:56,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:50:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET /node/6940c6851e3c24e95681d942%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:54:09,944 - lava_callback - INFO - Received callback for node 69e90b128327522856daf772 INFO: 172.20.0.1:50512 - "POST /node/69e90b128327522856daf772 HTTP/1.0" 202 Accepted 2026-04-22 17:54:09,950 - lava_callback - INFO - Starting async job submit for node 69e90b128327522856daf772 2026-04-22 17:54:09,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:54:09,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90b128327522856daf772 HTTP/1.1" 200 None 2026-04-22 17:54:09,994 - lava_callback - DEBUG - Processing node 69e90b128327522856daf772: baseline-arm64 2026-04-22 17:54:10,146 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:54:10,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:54:10,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:54:10,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90b128327522856daf772/lava-logs.yaml 2026-04-22 17:54:10,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:54:10,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:54:10,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90b128327522856daf772/lava_callback.json.gz 2026-04-22 17:54:10,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:54:10,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90b128327522856daf772 HTTP/1.1" 200 None 2026-04-22 17:54:10,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:54:10,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:54:10,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:54:10,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90b128327522856daf772 HTTP/1.1" 200 None 2026-04-22 17:54:10,617 - lava_callback - INFO - Completed processing callback for node 69e90b128327522856daf772 INFO: 172.20.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:54:26,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:54:26,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:56:27,698 - lava_callback - INFO - Received callback for node 69e90b698327522856daf79d INFO: 172.20.0.1:57042 - "POST /node/69e90b698327522856daf79d HTTP/1.0" 202 Accepted 2026-04-22 17:56:27,705 - lava_callback - INFO - Starting async job submit for node 69e90b698327522856daf79d 2026-04-22 17:56:27,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:56:27,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90b698327522856daf79d HTTP/1.1" 200 None 2026-04-22 17:56:27,752 - lava_callback - DEBUG - Processing node 69e90b698327522856daf79d: baseline-arm64 2026-04-22 17:56:27,964 - lava_callback - WARNING - Failed to upload log 2026-04-22 17:56:28,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:56:28,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:56:28,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90b698327522856daf79d/lava-logs.yaml 2026-04-22 17:56:28,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:56:28,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:56:28,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90b698327522856daf79d/lava_callback.json.gz 2026-04-22 17:56:28,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:56:28,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90b698327522856daf79d HTTP/1.1" 200 None 2026-04-22 17:56:28,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:56:28,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:56:28,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:56:28,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90b698327522856daf79d HTTP/1.1" 200 None 2026-04-22 17:56:28,512 - lava_callback - INFO - Completed processing callback for node 69e90b698327522856daf79d INFO: 172.20.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:56:56,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:56:56,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42060 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:59:09,337 - lava_callback - INFO - Received callback for node 69e90c108327522856daf80b INFO: 172.20.0.1:42062 - "POST /node/69e90c108327522856daf80b HTTP/1.0" 202 Accepted 2026-04-22 17:59:09,344 - lava_callback - INFO - Starting async job submit for node 69e90c108327522856daf80b 2026-04-22 17:59:09,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:59:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90c108327522856daf80b HTTP/1.1" 200 None 2026-04-22 17:59:09,380 - lava_callback - DEBUG - Processing node 69e90c108327522856daf80b: baseline-arm64 2026-04-22 17:59:09,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:59:09,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:59:09,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90c108327522856daf80b/log.txt.gz 2026-04-22 17:59:10,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:59:10,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:59:10,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90c108327522856daf80b/lava-logs.yaml 2026-04-22 17:59:10,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 17:59:10,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 17:59:10,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90c108327522856daf80b/lava_callback.json.gz 2026-04-22 17:59:10,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:59:10,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90c108327522856daf80b HTTP/1.1" 200 None 2026-04-22 17:59:10,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:59:10,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 17:59:10,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:59:10,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90c108327522856daf80b HTTP/1.1" 200 None 2026-04-22 17:59:10,868 - lava_callback - INFO - Completed processing callback for node 69e90c108327522856daf80b INFO: 172.20.0.1:57302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54474 - "GET / HTTP/1.0" 200 OK 2026-04-22 17:59:26,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 17:59:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:04:12,567 - lava_callback - INFO - Received callback for node 69e90cb08327522856daf878 INFO: 172.20.0.1:34158 - "POST /node/69e90cb08327522856daf878 HTTP/1.0" 202 Accepted 2026-04-22 18:04:12,572 - lava_callback - INFO - Starting async job submit for node 69e90cb08327522856daf878 2026-04-22 18:04:12,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:04:12,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90cb08327522856daf878 HTTP/1.1" 200 None 2026-04-22 18:04:12,614 - lava_callback - DEBUG - Processing node 69e90cb08327522856daf878: baseline-arm64 2026-04-22 18:04:12,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:04:13,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:04:13,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90cb08327522856daf878/log.txt.gz 2026-04-22 18:04:13,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:04:13,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:04:13,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90cb08327522856daf878/lava-logs.yaml 2026-04-22 18:04:13,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:04:13,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:04:13,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90cb08327522856daf878/lava_callback.json.gz 2026-04-22 18:04:13,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:04:13,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90cb08327522856daf878 HTTP/1.1" 200 None 2026-04-22 18:04:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:04:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:04:13,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:04:13,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90cb08327522856daf878 HTTP/1.1" 200 None 2026-04-22 18:04:13,930 - lava_callback - INFO - Completed processing callback for node 69e90cb08327522856daf878 INFO: 172.20.0.1:34162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36624 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:04:26,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:04:26,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:09:00,854 - lava_callback - INFO - Received callback for node 69e90d5b8327522856daf8c1 INFO: 172.20.0.1:34048 - "POST /node/69e90d5b8327522856daf8c1 HTTP/1.0" 202 Accepted 2026-04-22 18:09:00,865 - lava_callback - INFO - Starting async job submit for node 69e90d5b8327522856daf8c1 2026-04-22 18:09:00,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:09:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90d5b8327522856daf8c1 HTTP/1.1" 200 None 2026-04-22 18:09:00,954 - lava_callback - DEBUG - Processing node 69e90d5b8327522856daf8c1: baseline-arm64-foundriesio 2026-04-22 18:09:02,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:09:02,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:09:02,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e90d5b8327522856daf8c1/log.txt.gz 2026-04-22 18:09:03,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:09:03,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:09:03,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e90d5b8327522856daf8c1/lava-logs.yaml 2026-04-22 18:09:03,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:09:03,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:09:03,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e90d5b8327522856daf8c1/lava_callback.json.gz DEBUG: Setup failed for 69e90d5b8327522856daf8c1. Transitting job node result: incomplete -> fail 2026-04-22 18:09:03,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:09:03,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90d5b8327522856daf8c1 HTTP/1.1" 200 None 2026-04-22 18:09:03,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:09:03,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:09:03,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:09:03,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90d5b8327522856daf8c1 HTTP/1.1" 200 None 2026-04-22 18:09:03,994 - lava_callback - INFO - Completed processing callback for node 69e90d5b8327522856daf8c1 INFO: 172.20.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:09:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:09:26,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:14:39,973 - lava_callback - INFO - Received callback for node 69e90e408327522856daf975 INFO: 172.20.0.1:51582 - "POST /node/69e90e408327522856daf975 HTTP/1.0" 202 Accepted 2026-04-22 18:14:39,980 - lava_callback - INFO - Starting async job submit for node 69e90e408327522856daf975 2026-04-22 18:14:40,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:14:40,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90e408327522856daf975 HTTP/1.1" 200 None 2026-04-22 18:14:40,035 - lava_callback - DEBUG - Processing node 69e90e408327522856daf975: baseline-arm64 2026-04-22 18:14:40,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:14:40,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:14:40,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90e408327522856daf975/log.txt.gz 2026-04-22 18:14:40,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:14:41,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:14:41,108 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90e408327522856daf975/lava-logs.yaml 2026-04-22 18:14:41,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:14:41,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:14:41,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90e408327522856daf975/lava_callback.json.gz DEBUG: Setup failed for 69e90e408327522856daf975. Transitting job node result: incomplete -> fail 2026-04-22 18:14:41,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:14:41,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90e408327522856daf975 HTTP/1.1" 200 None 2026-04-22 18:14:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:14:41,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:14:41,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:14:41,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90e408327522856daf975 HTTP/1.1" 200 None 2026-04-22 18:14:41,476 - lava_callback - INFO - Completed processing callback for node 69e90e408327522856daf975 INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39800 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:14:56,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:14:56,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36026 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:20:15,099 - lava_callback - INFO - Received callback for node 69e90ee68327522856daf9de INFO: 172.20.0.1:60498 - "POST /node/69e90ee68327522856daf9de HTTP/1.0" 202 Accepted 2026-04-22 18:20:15,106 - lava_callback - INFO - Starting async job submit for node 69e90ee68327522856daf9de 2026-04-22 18:20:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:20:15,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90ee68327522856daf9de HTTP/1.1" 200 None 2026-04-22 18:20:15,149 - lava_callback - DEBUG - Processing node 69e90ee68327522856daf9de: baseline-arm64 INFO: 172.20.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 18:20:15,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:20:15,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:20:15,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90ee68327522856daf9de/log.txt.gz 2026-04-22 18:20:16,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:20:16,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:20:16,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90ee68327522856daf9de/lava-logs.yaml 2026-04-22 18:20:16,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:20:16,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:20:16,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e90ee68327522856daf9de/lava_callback.json.gz 2026-04-22 18:20:16,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:20:16,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90ee68327522856daf9de HTTP/1.1" 200 None 2026-04-22 18:20:16,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60520 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:20:16,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:20:16,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:20:16,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90ee68327522856daf9de HTTP/1.1" 200 None 2026-04-22 18:20:16,603 - lava_callback - INFO - Completed processing callback for node 69e90ee68327522856daf9de INFO: 172.20.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:20:26,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:20:26,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:21:00,645 - lava_callback - INFO - Received callback for node 69e66e85dc041e577b778638 INFO: 172.20.0.1:45316 - "POST /node/69e66e85dc041e577b778638 HTTP/1.0" 202 Accepted 2026-04-22 18:21:00,651 - lava_callback - INFO - Starting async job submit for node 69e66e85dc041e577b778638 2026-04-22 18:21:00,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:00,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e85dc041e577b778638 HTTP/1.1" 200 None 2026-04-22 18:21:00,668 - lava_callback - DEBUG - Processing node 69e66e85dc041e577b778638: baseline-arm-baylibre 2026-04-22 18:21:00,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e85dc041e577b778638 2026-04-22 18:21:00,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:00,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e85dc041e577b778638 HTTP/1.1" 200 None 2026-04-22 18:21:00,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:00,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:00,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e85dc041e577b778638 HTTP/1.1" 200 None 2026-04-22 18:21:00,719 - lava_callback - ERROR - Error processing callback for node 69e66e85dc041e577b778638: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:01,315 - lava_callback - INFO - Received callback for node 69e66e86dc041e577b77863b INFO: 172.20.0.1:45332 - "POST /node/69e66e86dc041e577b77863b HTTP/1.0" 202 Accepted 2026-04-22 18:21:01,324 - lava_callback - INFO - Starting async job submit for node 69e66e86dc041e577b77863b 2026-04-22 18:21:01,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:01,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e86dc041e577b77863b HTTP/1.1" 200 None 2026-04-22 18:21:01,341 - lava_callback - DEBUG - Processing node 69e66e86dc041e577b77863b: baseline-arm-baylibre 2026-04-22 18:21:01,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e86dc041e577b77863b 2026-04-22 18:21:01,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:01,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e86dc041e577b77863b HTTP/1.1" 200 None 2026-04-22 18:21:01,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:01,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:01,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:01,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e86dc041e577b77863b HTTP/1.1" 200 None 2026-04-22 18:21:01,406 - lava_callback - ERROR - Error processing callback for node 69e66e86dc041e577b77863b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:01,996 - lava_callback - INFO - Received callback for node 69e66e88dc041e577b77863f INFO: 172.20.0.1:45340 - "POST /node/69e66e88dc041e577b77863f HTTP/1.0" 202 Accepted 2026-04-22 18:21:02,002 - lava_callback - INFO - Starting async job submit for node 69e66e88dc041e577b77863f 2026-04-22 18:21:02,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e88dc041e577b77863f HTTP/1.1" 200 None 2026-04-22 18:21:02,018 - lava_callback - DEBUG - Processing node 69e66e88dc041e577b77863f: baseline-arm-baylibre 2026-04-22 18:21:02,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e88dc041e577b77863f 2026-04-22 18:21:02,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e88dc041e577b77863f HTTP/1.1" 200 None 2026-04-22 18:21:02,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:02,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e88dc041e577b77863f HTTP/1.1" 200 None 2026-04-22 18:21:02,077 - lava_callback - ERROR - Error processing callback for node 69e66e88dc041e577b77863f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:02,666 - lava_callback - INFO - Received callback for node 69e66e8bdc041e577b77864a INFO: 172.20.0.1:45352 - "POST /node/69e66e8bdc041e577b77864a HTTP/1.0" 202 Accepted 2026-04-22 18:21:02,673 - lava_callback - INFO - Starting async job submit for node 69e66e8bdc041e577b77864a 2026-04-22 18:21:02,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e8bdc041e577b77864a HTTP/1.1" 200 None 2026-04-22 18:21:02,690 - lava_callback - DEBUG - Processing node 69e66e8bdc041e577b77864a: baseline-arm-baylibre 2026-04-22 18:21:02,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e8bdc041e577b77864a 2026-04-22 18:21:02,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e8bdc041e577b77864a HTTP/1.1" 200 None 2026-04-22 18:21:02,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:02,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:02,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e8bdc041e577b77864a HTTP/1.1" 200 None 2026-04-22 18:21:02,749 - lava_callback - ERROR - Error processing callback for node 69e66e8bdc041e577b77864a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:03,336 - lava_callback - INFO - Received callback for node 69e66e84dc041e577b778635 INFO: 172.20.0.1:45360 - "POST /node/69e66e84dc041e577b778635 HTTP/1.0" 202 Accepted 2026-04-22 18:21:03,341 - lava_callback - INFO - Starting async job submit for node 69e66e84dc041e577b778635 2026-04-22 18:21:03,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:03,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e84dc041e577b778635 HTTP/1.1" 200 None 2026-04-22 18:21:03,356 - lava_callback - DEBUG - Processing node 69e66e84dc041e577b778635: baseline-arm-baylibre 2026-04-22 18:21:03,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e84dc041e577b778635 2026-04-22 18:21:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:03,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e84dc041e577b778635 HTTP/1.1" 200 None 2026-04-22 18:21:03,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:03,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e84dc041e577b778635 HTTP/1.1" 200 None 2026-04-22 18:21:03,409 - lava_callback - ERROR - Error processing callback for node 69e66e84dc041e577b778635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39956 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:21:19,555 - lava_callback - INFO - Received callback for node 69e66e95dc041e577b778666 INFO: 172.20.0.1:39962 - "POST /node/69e66e95dc041e577b778666 HTTP/1.0" 202 Accepted 2026-04-22 18:21:19,561 - lava_callback - INFO - Starting async job submit for node 69e66e95dc041e577b778666 2026-04-22 18:21:19,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:19,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e95dc041e577b778666 HTTP/1.1" 200 None 2026-04-22 18:21:19,577 - lava_callback - DEBUG - Processing node 69e66e95dc041e577b778666: baseline-arm-clabbe 2026-04-22 18:21:19,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e95dc041e577b778666 2026-04-22 18:21:19,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:19,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e95dc041e577b778666 HTTP/1.1" 200 None 2026-04-22 18:21:19,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:19,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:19,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:19,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e95dc041e577b778666 HTTP/1.1" 200 None 2026-04-22 18:21:19,627 - lava_callback - ERROR - Error processing callback for node 69e66e95dc041e577b778666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:20,253 - lava_callback - INFO - Received callback for node 69e66e97dc041e577b77866e INFO: 172.20.0.1:48348 - "POST /node/69e66e97dc041e577b77866e HTTP/1.0" 202 Accepted 2026-04-22 18:21:20,259 - lava_callback - INFO - Starting async job submit for node 69e66e97dc041e577b77866e 2026-04-22 18:21:20,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e97dc041e577b77866e HTTP/1.1" 200 None 2026-04-22 18:21:20,274 - lava_callback - DEBUG - Processing node 69e66e97dc041e577b77866e: baseline-arm-clabbe 2026-04-22 18:21:20,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e97dc041e577b77866e 2026-04-22 18:21:20,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e97dc041e577b77866e HTTP/1.1" 200 None 2026-04-22 18:21:20,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e97dc041e577b77866e HTTP/1.1" 200 None 2026-04-22 18:21:20,318 - lava_callback - ERROR - Error processing callback for node 69e66e97dc041e577b77866e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:20,525 - lava_callback - INFO - Received callback for node 69e66e8cdc041e577b77864d INFO: 172.20.0.1:48350 - "POST /node/69e66e8cdc041e577b77864d HTTP/1.0" 202 Accepted 2026-04-22 18:21:20,531 - lava_callback - INFO - Starting async job submit for node 69e66e8cdc041e577b77864d 2026-04-22 18:21:20,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e8cdc041e577b77864d HTTP/1.1" 200 None 2026-04-22 18:21:20,556 - lava_callback - DEBUG - Processing node 69e66e8cdc041e577b77864d: baseline-arm-baylibre 2026-04-22 18:21:20,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e8cdc041e577b77864d 2026-04-22 18:21:20,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e8cdc041e577b77864d HTTP/1.1" 200 None 2026-04-22 18:21:20,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:20,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e8cdc041e577b77864d HTTP/1.1" 200 None 2026-04-22 18:21:20,624 - lava_callback - ERROR - Error processing callback for node 69e66e8cdc041e577b77864d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:20,948 - lava_callback - INFO - Received callback for node 69e66e98dc041e577b778672 INFO: 172.20.0.1:48358 - "POST /node/69e66e98dc041e577b778672 HTTP/1.0" 202 Accepted 2026-04-22 18:21:20,954 - lava_callback - INFO - Starting async job submit for node 69e66e98dc041e577b778672 2026-04-22 18:21:20,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e98dc041e577b778672 HTTP/1.1" 200 None 2026-04-22 18:21:20,970 - lava_callback - DEBUG - Processing node 69e66e98dc041e577b778672: baseline-arm-clabbe 2026-04-22 18:21:20,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e98dc041e577b778672 2026-04-22 18:21:20,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:20,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e98dc041e577b778672 HTTP/1.1" 200 None 2026-04-22 18:21:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:21,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e98dc041e577b778672 HTTP/1.1" 200 None 2026-04-22 18:21:21,036 - lava_callback - ERROR - Error processing callback for node 69e66e98dc041e577b778672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:21,663 - lava_callback - INFO - Received callback for node 69e66e99dc041e577b77869d INFO: 172.20.0.1:48372 - "POST /node/69e66e99dc041e577b77869d HTTP/1.0" 202 Accepted 2026-04-22 18:21:21,672 - lava_callback - INFO - Starting async job submit for node 69e66e99dc041e577b77869d 2026-04-22 18:21:21,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e99dc041e577b77869d HTTP/1.1" 200 None 2026-04-22 18:21:21,689 - lava_callback - DEBUG - Processing node 69e66e99dc041e577b77869d: baseline-arm-clabbe 2026-04-22 18:21:21,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e99dc041e577b77869d 2026-04-22 18:21:21,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e99dc041e577b77869d HTTP/1.1" 200 None 2026-04-22 18:21:21,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:21,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:21,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e99dc041e577b77869d HTTP/1.1" 200 None 2026-04-22 18:21:21,750 - lava_callback - ERROR - Error processing callback for node 69e66e99dc041e577b77869d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:22,333 - lava_callback - INFO - Received callback for node 69e66e9adc041e577b7786a0 INFO: 172.20.0.1:48380 - "POST /node/69e66e9adc041e577b7786a0 HTTP/1.0" 202 Accepted 2026-04-22 18:21:22,339 - lava_callback - INFO - Starting async job submit for node 69e66e9adc041e577b7786a0 2026-04-22 18:21:22,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:22,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9adc041e577b7786a0 HTTP/1.1" 200 None 2026-04-22 18:21:22,360 - lava_callback - DEBUG - Processing node 69e66e9adc041e577b7786a0: baseline-arm-clabbe 2026-04-22 18:21:22,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e9adc041e577b7786a0 2026-04-22 18:21:22,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:22,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9adc041e577b7786a0 HTTP/1.1" 200 None 2026-04-22 18:21:22,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:22,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:22,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:22,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e9adc041e577b7786a0 HTTP/1.1" 200 None 2026-04-22 18:21:22,423 - lava_callback - ERROR - Error processing callback for node 69e66e9adc041e577b7786a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:23,018 - lava_callback - INFO - Received callback for node 69e66e9bdc041e577b7786a3 INFO: 172.20.0.1:48392 - "POST /node/69e66e9bdc041e577b7786a3 HTTP/1.0" 202 Accepted 2026-04-22 18:21:23,023 - lava_callback - INFO - Starting async job submit for node 69e66e9bdc041e577b7786a3 2026-04-22 18:21:23,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9bdc041e577b7786a3 HTTP/1.1" 200 None 2026-04-22 18:21:23,040 - lava_callback - DEBUG - Processing node 69e66e9bdc041e577b7786a3: baseline-arm-clabbe 2026-04-22 18:21:23,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e9bdc041e577b7786a3 2026-04-22 18:21:23,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9bdc041e577b7786a3 HTTP/1.1" 200 None 2026-04-22 18:21:23,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:23,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e9bdc041e577b7786a3 HTTP/1.1" 200 None 2026-04-22 18:21:23,086 - lava_callback - ERROR - Error processing callback for node 69e66e9bdc041e577b7786a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:23,686 - lava_callback - INFO - Received callback for node 69e66e9bdc041e577b7786a6 INFO: 172.20.0.1:48400 - "POST /node/69e66e9bdc041e577b7786a6 HTTP/1.0" 202 Accepted 2026-04-22 18:21:23,692 - lava_callback - INFO - Starting async job submit for node 69e66e9bdc041e577b7786a6 2026-04-22 18:21:23,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9bdc041e577b7786a6 HTTP/1.1" 200 None 2026-04-22 18:21:23,706 - lava_callback - DEBUG - Processing node 69e66e9bdc041e577b7786a6: baseline-arm-clabbe 2026-04-22 18:21:23,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e9bdc041e577b7786a6 2026-04-22 18:21:23,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9bdc041e577b7786a6 HTTP/1.1" 200 None 2026-04-22 18:21:23,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:23,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:23,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e9bdc041e577b7786a6 HTTP/1.1" 200 None 2026-04-22 18:21:23,759 - lava_callback - ERROR - Error processing callback for node 69e66e9bdc041e577b7786a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:24,351 - lava_callback - INFO - Received callback for node 69e66e9cdc041e577b7786a9 INFO: 172.20.0.1:48414 - "POST /node/69e66e9cdc041e577b7786a9 HTTP/1.0" 202 Accepted 2026-04-22 18:21:24,360 - lava_callback - INFO - Starting async job submit for node 69e66e9cdc041e577b7786a9 2026-04-22 18:21:24,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:24,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9cdc041e577b7786a9 HTTP/1.1" 200 None 2026-04-22 18:21:24,380 - lava_callback - DEBUG - Processing node 69e66e9cdc041e577b7786a9: baseline-arm-clabbe 2026-04-22 18:21:24,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e9cdc041e577b7786a9 2026-04-22 18:21:24,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:24,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9cdc041e577b7786a9 HTTP/1.1" 200 None 2026-04-22 18:21:24,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:24,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:24,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:24,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e9cdc041e577b7786a9 HTTP/1.1" 200 None 2026-04-22 18:21:24,428 - lava_callback - ERROR - Error processing callback for node 69e66e9cdc041e577b7786a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:21:25,046 - lava_callback - INFO - Received callback for node 69e66e9ddc041e577b7786ac INFO: 172.20.0.1:48426 - "POST /node/69e66e9ddc041e577b7786ac HTTP/1.0" 202 Accepted 2026-04-22 18:21:25,053 - lava_callback - INFO - Starting async job submit for node 69e66e9ddc041e577b7786ac 2026-04-22 18:21:25,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:25,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9ddc041e577b7786ac HTTP/1.1" 200 None 2026-04-22 18:21:25,074 - lava_callback - DEBUG - Processing node 69e66e9ddc041e577b7786ac: baseline-arm-clabbe 2026-04-22 18:21:25,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e66e9ddc041e577b7786ac 2026-04-22 18:21:25,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:25,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66e9ddc041e577b7786ac HTTP/1.1" 200 None 2026-04-22 18:21:25,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:25,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a5edc041e577b7785c2 HTTP/1.1" 200 None 2026-04-22 18:21:25,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:21:25,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e66e9ddc041e577b7786ac HTTP/1.1" 200 None 2026-04-22 18:21:25,134 - lava_callback - ERROR - Error processing callback for node 69e66e9ddc041e577b7786ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 18:22:16,154 - lava_callback - INFO - Received callback for node 69e911ca8327522856dafbe2 INFO: 172.20.0.1:33708 - "POST /node/69e911ca8327522856dafbe2 HTTP/1.0" 202 Accepted 2026-04-22 18:22:16,160 - lava_callback - INFO - Starting async job submit for node 69e911ca8327522856dafbe2 2026-04-22 18:22:16,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:16,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911ca8327522856dafbe2 HTTP/1.1" 200 None 2026-04-22 18:22:16,176 - lava_callback - DEBUG - Processing node 69e911ca8327522856dafbe2: baseline-nfs-arm64 2026-04-22 18:22:16,178 - lava_callback - WARNING - Failed to upload log 2026-04-22 18:22:16,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:22:16,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:22:16,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e911ca8327522856dafbe2/lava-logs.yaml 2026-04-22 18:22:16,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:22:16,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:22:16,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e911ca8327522856dafbe2/lava_callback.json.gz 2026-04-22 18:22:16,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:16,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911ca8327522856dafbe2 HTTP/1.1" 200 None 2026-04-22 18:22:16,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:16,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:22:16,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:16,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e911ca8327522856dafbe2 HTTP/1.1" 200 None 2026-04-22 18:22:16,379 - lava_callback - INFO - Completed processing callback for node 69e911ca8327522856dafbe2 INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58676 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:22:26,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:26,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 18:22:27,583 - lava_callback - INFO - Received callback for node 69e90f3f8327522856dafa17 INFO: 172.20.0.1:58678 - "POST /node/69e90f3f8327522856dafa17 HTTP/1.0" 202 Accepted 2026-04-22 18:22:27,590 - lava_callback - INFO - Starting async job submit for node 69e90f3f8327522856dafa17 2026-04-22 18:22:27,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:27,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90f3f8327522856dafa17 HTTP/1.1" 200 None 2026-04-22 18:22:27,635 - lava_callback - DEBUG - Processing node 69e90f3f8327522856dafa17: baseline-nfs-arm64 2026-04-22 18:22:28,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:22:28,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:22:28,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e90f3f8327522856dafa17/log.txt.gz 2026-04-22 18:22:28,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:22:28,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:22:28,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e90f3f8327522856dafa17/lava-logs.yaml 2026-04-22 18:22:28,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:22:29,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:22:29,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e90f3f8327522856dafa17/lava_callback.json.gz 2026-04-22 18:22:29,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:29,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e90f3f8327522856dafa17 HTTP/1.1" 200 None 2026-04-22 18:22:29,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:29,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:22:29,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e90f3f8327522856dafa17 HTTP/1.1" 200 None 2026-04-22 18:22:29,207 - lava_callback - INFO - Completed processing callback for node 69e90f3f8327522856dafa17 INFO: 172.20.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:22:56,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:22:56,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:25:30,384 - lava_callback - INFO - Received callback for node 69e9126b8327522856dafc40 INFO: 172.20.0.1:46916 - "POST /node/69e9126b8327522856dafc40 HTTP/1.0" 202 Accepted 2026-04-22 18:25:30,391 - lava_callback - INFO - Starting async job submit for node 69e9126b8327522856dafc40 2026-04-22 18:25:30,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:25:30,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9126b8327522856dafc40 HTTP/1.1" 200 None 2026-04-22 18:25:30,434 - lava_callback - DEBUG - Processing node 69e9126b8327522856dafc40: baseline-arm64 2026-04-22 18:25:30,595 - lava_callback - WARNING - Failed to upload log 2026-04-22 18:25:30,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:25:30,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:25:30,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9126b8327522856dafc40/lava-logs.yaml 2026-04-22 18:25:30,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:25:30,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:25:30,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9126b8327522856dafc40/lava_callback.json.gz 2026-04-22 18:25:30,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:25:30,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9126b8327522856dafc40 HTTP/1.1" 200 None 2026-04-22 18:25:30,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:25:30,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:25:30,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:25:30,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9126b8327522856dafc40 HTTP/1.1" 200 None 2026-04-22 18:25:30,999 - lava_callback - INFO - Completed processing callback for node 69e9126b8327522856dafc40 INFO: 172.20.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44488 - "GET /node/6929900409677735f68af881%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45702 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:25:56,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:25:56,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33908 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:26:50,514 - lava_callback - INFO - Received callback for node 69e912bf8327522856dafc6f INFO: 172.20.0.1:56226 - "POST /node/69e912bf8327522856dafc6f HTTP/1.0" 202 Accepted 2026-04-22 18:26:50,521 - lava_callback - INFO - Starting async job submit for node 69e912bf8327522856dafc6f 2026-04-22 18:26:50,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:26:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e912bf8327522856dafc6f HTTP/1.1" 200 None 2026-04-22 18:26:50,573 - lava_callback - DEBUG - Processing node 69e912bf8327522856dafc6f: baseline-arm64 2026-04-22 18:26:50,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:26:50,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:26:50,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e912bf8327522856dafc6f/log.txt.gz 2026-04-22 18:26:50,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:26:50,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:26:50,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e912bf8327522856dafc6f/lava-logs.yaml 2026-04-22 18:26:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:26:51,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:26:51,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e912bf8327522856dafc6f/lava_callback.json.gz 2026-04-22 18:26:51,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:26:51,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e912bf8327522856dafc6f HTTP/1.1" 200 None 2026-04-22 18:26:51,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:26:51,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:26:51,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:26:51,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e912bf8327522856dafc6f HTTP/1.1" 200 None 2026-04-22 18:26:51,222 - lava_callback - INFO - Completed processing callback for node 69e912bf8327522856dafc6f INFO: 172.20.0.1:56232 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:26:56,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:26:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:29:21,031 - lava_callback - INFO - Received callback for node 69e67074dc041e577b778810 INFO: 172.20.0.1:60472 - "POST /node/69e67074dc041e577b778810 HTTP/1.0" 202 Accepted 2026-04-22 18:29:21,036 - lava_callback - INFO - Starting async job submit for node 69e67074dc041e577b778810 2026-04-22 18:29:21,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:21,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67074dc041e577b778810 HTTP/1.1" 200 None 2026-04-22 18:29:21,051 - lava_callback - DEBUG - Processing node 69e67074dc041e577b778810: baseline-arm-baylibre 2026-04-22 18:29:21,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67074dc041e577b778810 2026-04-22 18:29:21,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:21,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67074dc041e577b778810 HTTP/1.1" 200 None 2026-04-22 18:29:21,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:21,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:29:21,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:21,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67074dc041e577b778810 HTTP/1.1" 200 None 2026-04-22 18:29:21,117 - lava_callback - ERROR - Error processing callback for node 69e67074dc041e577b778810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47324 - "GET /node/6952ede89912bd6bbcea5d78%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36660 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:29:50,880 - lava_callback - INFO - Received callback for node 69e913158327522856dafc9f INFO: 172.20.0.1:35330 - "POST /node/69e913158327522856dafc9f HTTP/1.0" 202 Accepted 2026-04-22 18:29:50,887 - lava_callback - INFO - Starting async job submit for node 69e913158327522856dafc9f 2026-04-22 18:29:50,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e913158327522856dafc9f HTTP/1.1" 200 None 2026-04-22 18:29:50,926 - lava_callback - DEBUG - Processing node 69e913158327522856dafc9f: baseline-arm64 2026-04-22 18:29:51,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:29:51,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:29:51,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913158327522856dafc9f/log.txt.gz 2026-04-22 18:29:52,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:29:52,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:29:52,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913158327522856dafc9f/lava-logs.yaml 2026-04-22 18:29:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:29:52,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:29:52,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913158327522856dafc9f/lava_callback.json.gz 2026-04-22 18:29:52,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:52,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e913158327522856dafc9f HTTP/1.1" 200 None 2026-04-22 18:29:52,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:29:52,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:52,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e913158327522856dafc9f HTTP/1.1" 200 None 2026-04-22 18:29:52,655 - lava_callback - INFO - Completed processing callback for node 69e913158327522856dafc9f INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:29:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:29:56,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:30:41,381 - lava_callback - INFO - Received callback for node 69e670cddc041e577b778832 INFO: 172.20.0.1:55406 - "POST /node/69e670cddc041e577b778832 HTTP/1.0" 202 Accepted 2026-04-22 18:30:41,390 - lava_callback - INFO - Starting async job submit for node 69e670cddc041e577b778832 2026-04-22 18:30:41,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:30:41,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e670cddc041e577b778832 HTTP/1.1" 200 None 2026-04-22 18:30:41,410 - lava_callback - DEBUG - Processing node 69e670cddc041e577b778832: baseline-arm-baylibre 2026-04-22 18:30:41,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e670cddc041e577b778832 2026-04-22 18:30:41,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:30:41,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e670cddc041e577b778832 HTTP/1.1" 200 None 2026-04-22 18:30:41,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:30:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:30:41,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:30:41,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e670cddc041e577b778832 HTTP/1.1" 200 None 2026-04-22 18:30:41,485 - lava_callback - ERROR - Error processing callback for node 69e670cddc041e577b778832: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:32:21,194 - lava_callback - INFO - Received callback for node 69e67126dc041e577b77af26 INFO: 172.20.0.1:52830 - "POST /node/69e67126dc041e577b77af26 HTTP/1.0" 202 Accepted 2026-04-22 18:32:21,199 - lava_callback - INFO - Starting async job submit for node 69e67126dc041e577b77af26 2026-04-22 18:32:21,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:21,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67126dc041e577b77af26 HTTP/1.1" 200 None 2026-04-22 18:32:21,215 - lava_callback - DEBUG - Processing node 69e67126dc041e577b77af26: baseline-arm-baylibre 2026-04-22 18:32:21,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67126dc041e577b77af26 2026-04-22 18:32:21,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:21,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67126dc041e577b77af26 HTTP/1.1" 200 None 2026-04-22 18:32:21,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:21,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:32:21,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:21,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67126dc041e577b77af26 HTTP/1.1" 200 None 2026-04-22 18:32:21,263 - lava_callback - ERROR - Error processing callback for node 69e67126dc041e577b77af26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58916 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:32:37,035 - lava_callback - INFO - Received callback for node 69e910dc8327522856dafb27 INFO: 172.20.0.1:58920 - "POST /node/69e910dc8327522856dafb27 HTTP/1.0" 202 Accepted 2026-04-22 18:32:37,042 - lava_callback - INFO - Starting async job submit for node 69e910dc8327522856dafb27 2026-04-22 18:32:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:37,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e910dc8327522856dafb27 HTTP/1.1" 200 None 2026-04-22 18:32:37,107 - lava_callback - DEBUG - Processing node 69e910dc8327522856dafb27: baseline-arm 2026-04-22 18:32:37,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:32:37,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:32:37,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e910dc8327522856dafb27/log.txt.gz 2026-04-22 18:32:38,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:32:38,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:32:38,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e910dc8327522856dafb27/lava-logs.yaml 2026-04-22 18:32:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:32:38,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:32:38,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e910dc8327522856dafb27/lava_callback.json.gz DEBUG: Setup failed for 69e910dc8327522856dafb27. Transitting job node result: incomplete -> fail 2026-04-22 18:32:38,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:38,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e910dc8327522856dafb27 HTTP/1.1" 200 None 2026-04-22 18:32:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:38,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 18:32:38,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:38,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e910dc8327522856dafb27 HTTP/1.1" 200 None 2026-04-22 18:32:38,621 - lava_callback - INFO - Completed processing callback for node 69e910dc8327522856dafb27 INFO: 172.20.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38784 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:32:56,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:32:56,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55756 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:33:10,801 - lava_callback - INFO - Received callback for node 69e914128327522856dafd0b INFO: 172.20.0.1:33480 - "POST /node/69e914128327522856dafd0b HTTP/1.0" 202 Accepted 2026-04-22 18:33:10,808 - lava_callback - INFO - Starting async job submit for node 69e914128327522856dafd0b 2026-04-22 18:33:10,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:10,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e914128327522856dafd0b HTTP/1.1" 200 None 2026-04-22 18:33:10,850 - lava_callback - DEBUG - Processing node 69e914128327522856dafd0b: baseline-arm64-foundriesio 2026-04-22 18:33:11,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:11,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:11,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e914128327522856dafd0b/log.txt.gz 2026-04-22 18:33:11,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:11,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:11,953 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e914128327522856dafd0b/lava-logs.yaml 2026-04-22 18:33:11,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:12,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:12,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e914128327522856dafd0b/lava_callback.json.gz 2026-04-22 18:33:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:12,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e914128327522856dafd0b HTTP/1.1" 200 None 2026-04-22 18:33:12,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:12,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:33:12,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:12,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e914128327522856dafd0b HTTP/1.1" 200 None 2026-04-22 18:33:12,178 - lava_callback - INFO - Completed processing callback for node 69e914128327522856dafd0b INFO: 172.20.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:33:26,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:33:41,296 - lava_callback - INFO - Received callback for node 69e6717fdc041e577b77af78 INFO: 172.20.0.1:53930 - "POST /node/69e6717fdc041e577b77af78 HTTP/1.0" 202 Accepted 2026-04-22 18:33:41,302 - lava_callback - INFO - Starting async job submit for node 69e6717fdc041e577b77af78 2026-04-22 18:33:41,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:41,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6717fdc041e577b77af78 HTTP/1.1" 200 None 2026-04-22 18:33:41,320 - lava_callback - DEBUG - Processing node 69e6717fdc041e577b77af78: baseline-arm-baylibre 2026-04-22 18:33:41,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6717fdc041e577b77af78 2026-04-22 18:33:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:41,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6717fdc041e577b77af78 HTTP/1.1" 200 None 2026-04-22 18:33:41,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:33:41,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:41,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6717fdc041e577b77af78 HTTP/1.1" 200 None 2026-04-22 18:33:41,375 - lava_callback - ERROR - Error processing callback for node 69e6717fdc041e577b77af78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:33:54,522 - lava_callback - INFO - Received callback for node 69e913a48327522856dafcd7 INFO: 172.20.0.1:52102 - "POST /node/69e913a48327522856dafcd7 HTTP/1.0" 202 Accepted 2026-04-22 18:33:54,528 - lava_callback - INFO - Starting async job submit for node 69e913a48327522856dafcd7 2026-04-22 18:33:54,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:54,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e913a48327522856dafcd7 HTTP/1.1" 200 None 2026-04-22 18:33:54,572 - lava_callback - DEBUG - Processing node 69e913a48327522856dafcd7: baseline-arm64 2026-04-22 18:33:54,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:55,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:55,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913a48327522856dafcd7/log.txt.gz 2026-04-22 18:33:55,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:55,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:55,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913a48327522856dafcd7/lava-logs.yaml 2026-04-22 18:33:55,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:33:55,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:33:55,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e913a48327522856dafcd7/lava_callback.json.gz 2026-04-22 18:33:55,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:55,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e913a48327522856dafcd7 HTTP/1.1" 200 None 2026-04-22 18:33:55,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:55,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:33:55,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:55,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e913a48327522856dafcd7 HTTP/1.1" 200 None 2026-04-22 18:33:55,763 - lava_callback - INFO - Completed processing callback for node 69e913a48327522856dafcd7 INFO: 172.20.0.1:52114 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:33:56,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:33:56,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:35:21,364 - lava_callback - INFO - Received callback for node 69e671d7dc041e577b77afde INFO: 172.20.0.1:45820 - "POST /node/69e671d7dc041e577b77afde HTTP/1.0" 202 Accepted 2026-04-22 18:35:21,370 - lava_callback - INFO - Starting async job submit for node 69e671d7dc041e577b77afde 2026-04-22 18:35:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:21,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e671d7dc041e577b77afde HTTP/1.1" 200 None 2026-04-22 18:35:21,392 - lava_callback - DEBUG - Processing node 69e671d7dc041e577b77afde: baseline-arm-baylibre 2026-04-22 18:35:21,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e671d7dc041e577b77afde 2026-04-22 18:35:21,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:21,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e671d7dc041e577b77afde HTTP/1.1" 200 None 2026-04-22 18:35:21,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:21,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:35:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:21,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e671d7dc041e577b77afde HTTP/1.1" 200 None 2026-04-22 18:35:21,443 - lava_callback - ERROR - Error processing callback for node 69e671d7dc041e577b77afde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:35:57,863 - lava_callback - INFO - Received callback for node 69e910da8327522856dafb24 INFO: 172.20.0.1:44310 - "POST /node/69e910da8327522856dafb24 HTTP/1.0" 202 Accepted 2026-04-22 18:35:57,870 - lava_callback - INFO - Starting async job submit for node 69e910da8327522856dafb24 2026-04-22 18:35:57,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:57,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e910da8327522856dafb24 HTTP/1.1" 200 None 2026-04-22 18:35:57,942 - lava_callback - DEBUG - Processing node 69e910da8327522856dafb24: ltp-smoke INFO: 172.20.0.1:44316 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:35:58,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:35:58,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:35:58,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e910da8327522856dafb24/log.txt.gz 2026-04-22 18:35:59,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:35:59,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:35:59,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e910da8327522856dafb24/lava-logs.yaml 2026-04-22 18:35:59,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:35:59,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:35:59,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e910da8327522856dafb24/lava_callback.json.gz 2026-04-22 18:35:59,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:59,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e910da8327522856dafb24 HTTP/1.1" 200 None 2026-04-22 18:35:59,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:59,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4cc8327522856dac252 HTTP/1.1" 200 None 2026-04-22 18:35:59,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:35:59,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e910da8327522856dafb24 HTTP/1.1" 200 None 2026-04-22 18:35:59,837 - lava_callback - INFO - Completed processing callback for node 69e910da8327522856dafb24 2026-04-22 18:36:01,340 - lava_callback - INFO - Received callback for node 69e67203dc041e577b77b024 INFO: 172.20.0.1:52182 - "POST /node/69e67203dc041e577b77b024 HTTP/1.0" 202 Accepted 2026-04-22 18:36:01,345 - lava_callback - INFO - Starting async job submit for node 69e67203dc041e577b77b024 2026-04-22 18:36:01,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:36:01,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67203dc041e577b77b024 HTTP/1.1" 200 None 2026-04-22 18:36:01,361 - lava_callback - DEBUG - Processing node 69e67203dc041e577b77b024: baseline-arm-baylibre 2026-04-22 18:36:01,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67203dc041e577b77b024 2026-04-22 18:36:01,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:36:01,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67203dc041e577b77b024 HTTP/1.1" 200 None 2026-04-22 18:36:01,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:36:01,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:36:01,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:36:01,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67203dc041e577b77b024 HTTP/1.1" 200 None 2026-04-22 18:36:01,419 - lava_callback - ERROR - Error processing callback for node 69e67203dc041e577b77b024: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57496 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:36:26,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:36:26,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:37:40,256 - lava_callback - INFO - Received callback for node 69e67260dc041e577b77b08c INFO: 172.20.0.1:54088 - "POST /node/69e67260dc041e577b77b08c HTTP/1.0" 202 Accepted 2026-04-22 18:37:40,264 - lava_callback - INFO - Starting async job submit for node 69e67260dc041e577b77b08c 2026-04-22 18:37:40,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:37:40,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67260dc041e577b77b08c HTTP/1.1" 200 None 2026-04-22 18:37:40,282 - lava_callback - DEBUG - Processing node 69e67260dc041e577b77b08c: baseline-arm-clabbe 2026-04-22 18:37:40,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67260dc041e577b77b08c 2026-04-22 18:37:40,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:37:40,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67260dc041e577b77b08c HTTP/1.1" 200 None 2026-04-22 18:37:40,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:37:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:37:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:37:40,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67260dc041e577b77b08c HTTP/1.1" 200 None 2026-04-22 18:37:40,346 - lava_callback - ERROR - Error processing callback for node 69e67260dc041e577b77b08c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:38:20,150 - lava_callback - INFO - Received callback for node 69e6728edc041e577b77b0a9 INFO: 172.20.0.1:45152 - "POST /node/69e6728edc041e577b77b0a9 HTTP/1.0" 202 Accepted 2026-04-22 18:38:20,156 - lava_callback - INFO - Starting async job submit for node 69e6728edc041e577b77b0a9 2026-04-22 18:38:20,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:38:20,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6728edc041e577b77b0a9 HTTP/1.1" 200 None 2026-04-22 18:38:20,171 - lava_callback - DEBUG - Processing node 69e6728edc041e577b77b0a9: baseline-arm-clabbe 2026-04-22 18:38:20,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6728edc041e577b77b0a9 2026-04-22 18:38:20,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:38:20,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6728edc041e577b77b0a9 HTTP/1.1" 200 None 2026-04-22 18:38:20,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:38:20,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:38:20,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:38:20,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6728edc041e577b77b0a9 HTTP/1.1" 200 None 2026-04-22 18:38:20,222 - lava_callback - ERROR - Error processing callback for node 69e6728edc041e577b77b0a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:39:59,400 - lava_callback - INFO - Received callback for node 69e914508327522856dafd3d INFO: 172.20.0.1:36880 - "POST /node/69e914508327522856dafd3d HTTP/1.0" 202 Accepted 2026-04-22 18:39:59,410 - lava_callback - INFO - Starting async job submit for node 69e914508327522856dafd3d 2026-04-22 18:39:59,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:39:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e914508327522856dafd3d HTTP/1.1" 200 None 2026-04-22 18:39:59,477 - lava_callback - DEBUG - Processing node 69e914508327522856dafd3d: baseline-arm64 2026-04-22 18:39:59,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:00,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:00,107 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e914508327522856dafd3d/log.txt.gz 2026-04-22 18:40:00,287 - lava_callback - INFO - Received callback for node 69e672eadc041e577b77b10d INFO: 172.20.0.1:50758 - "POST /node/69e672eadc041e577b77b10d HTTP/1.0" 202 Accepted 2026-04-22 18:40:00,304 - lava_callback - INFO - Starting async job submit for node 69e672eadc041e577b77b10d 2026-04-22 18:40:00,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:00,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e672eadc041e577b77b10d HTTP/1.1" 200 None 2026-04-22 18:40:00,369 - lava_callback - DEBUG - Processing node 69e672eadc041e577b77b10d: baseline-arm-clabbe 2026-04-22 18:40:00,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e672eadc041e577b77b10d 2026-04-22 18:40:00,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e672eadc041e577b77b10d HTTP/1.1" 200 None 2026-04-22 18:40:00,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:40:00,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e672eadc041e577b77b10d HTTP/1.1" 200 None 2026-04-22 18:40:00,456 - lava_callback - ERROR - Error processing callback for node 69e672eadc041e577b77b10d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 18:40:00,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:00,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e914508327522856dafd3d/lava-logs.yaml 2026-04-22 18:40:00,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:00,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:00,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e914508327522856dafd3d/lava_callback.json.gz DEBUG: Setup failed for 69e914508327522856dafd3d. Transitting job node result: incomplete -> fail 2026-04-22 18:40:00,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e914508327522856dafd3d HTTP/1.1" 200 None 2026-04-22 18:40:00,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:40:00,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:00,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e914508327522856dafd3d HTTP/1.1" 200 None 2026-04-22 18:40:00,999 - lava_callback - INFO - Completed processing callback for node 69e914508327522856dafd3d INFO: 172.20.0.1:50766 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:40:11,154 - lava_callback - INFO - Received callback for node 69e911588327522856dafb71 INFO: 172.20.0.1:35574 - "POST /node/69e911588327522856dafb71 HTTP/1.0" 202 Accepted 2026-04-22 18:40:11,163 - lava_callback - INFO - Starting async job submit for node 69e911588327522856dafb71 2026-04-22 18:40:11,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911588327522856dafb71 HTTP/1.1" 200 None 2026-04-22 18:40:11,222 - lava_callback - DEBUG - Processing node 69e911588327522856dafb71: baseline-nfs-arm64 2026-04-22 18:40:12,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:12,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:12,686 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e911588327522856dafb71/log.txt.gz 2026-04-22 18:40:13,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:13,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:13,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e911588327522856dafb71/lava-logs.yaml 2026-04-22 18:40:13,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:13,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:13,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e911588327522856dafb71/lava_callback.json.gz DEBUG: Setup failed for 69e911588327522856dafb71. Transitting job node result: incomplete -> fail 2026-04-22 18:40:14,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:14,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911588327522856dafb71 HTTP/1.1" 200 None 2026-04-22 18:40:14,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:14,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:40:14,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:14,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e911588327522856dafb71 HTTP/1.1" 200 None 2026-04-22 18:40:14,146 - lava_callback - INFO - Completed processing callback for node 69e911588327522856dafb71 INFO: 172.20.0.1:35580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53542 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:40:26,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:26,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45230 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:40:37,667 - lava_callback - INFO - Received callback for node 69e911a88327522856dafbd9 INFO: 172.20.0.1:45242 - "POST /node/69e911a88327522856dafbd9 HTTP/1.0" 202 Accepted 2026-04-22 18:40:37,713 - lava_callback - INFO - Starting async job submit for node 69e911a88327522856dafbd9 2026-04-22 18:40:37,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:37,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911a88327522856dafbd9 HTTP/1.1" 200 None 2026-04-22 18:40:37,752 - lava_callback - DEBUG - Processing node 69e911a88327522856dafbd9: baseline-arm-pengutronix 2026-04-22 18:40:37,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:37,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:37,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e911a88327522856dafbd9/log.txt.gz 2026-04-22 18:40:38,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:38,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:38,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e911a88327522856dafbd9/lava-logs.yaml 2026-04-22 18:40:38,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:40:38,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:40:38,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e911a88327522856dafbd9/lava_callback.json.gz DEBUG: Setup failed for 69e911a88327522856dafbd9. Transitting job node result: incomplete -> fail 2026-04-22 18:40:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:38,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e911a88327522856dafbd9 HTTP/1.1" 200 None 2026-04-22 18:40:38,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:38,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 18:40:38,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:38,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e911a88327522856dafbd9 HTTP/1.1" 200 None 2026-04-22 18:40:38,401 - lava_callback - INFO - Completed processing callback for node 69e911a88327522856dafbd9 2026-04-22 18:40:40,262 - lava_callback - INFO - Received callback for node 69e67317dc041e577b77b157 INFO: 172.20.0.1:33328 - "POST /node/69e67317dc041e577b77b157 HTTP/1.0" 202 Accepted 2026-04-22 18:40:40,267 - lava_callback - INFO - Starting async job submit for node 69e67317dc041e577b77b157 2026-04-22 18:40:40,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:40,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67317dc041e577b77b157 HTTP/1.1" 200 None 2026-04-22 18:40:40,290 - lava_callback - DEBUG - Processing node 69e67317dc041e577b77b157: baseline-arm-clabbe 2026-04-22 18:40:40,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67317dc041e577b77b157 2026-04-22 18:40:40,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67317dc041e577b77b157 HTTP/1.1" 200 None 2026-04-22 18:40:40,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:40,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:40:40,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:40,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67317dc041e577b77b157 HTTP/1.1" 200 None 2026-04-22 18:40:40,345 - lava_callback - ERROR - Error processing callback for node 69e67317dc041e577b77b157: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:40:56,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:40:56,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:41:20,345 - lava_callback - INFO - Received callback for node 69e67345dc041e577b77b172 INFO: 172.20.0.1:54238 - "POST /node/69e67345dc041e577b77b172 HTTP/1.0" 202 Accepted 2026-04-22 18:41:20,350 - lava_callback - INFO - Starting async job submit for node 69e67345dc041e577b77b172 2026-04-22 18:41:20,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:41:20,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67345dc041e577b77b172 HTTP/1.1" 200 None 2026-04-22 18:41:20,365 - lava_callback - DEBUG - Processing node 69e67345dc041e577b77b172: baseline-arm-clabbe 2026-04-22 18:41:20,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67345dc041e577b77b172 2026-04-22 18:41:20,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:41:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67345dc041e577b77b172 HTTP/1.1" 200 None 2026-04-22 18:41:20,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:41:20,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:41:20,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:41:20,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67345dc041e577b77b172 HTTP/1.1" 200 None 2026-04-22 18:41:20,410 - lava_callback - ERROR - Error processing callback for node 69e67345dc041e577b77b172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55508 - "GET /node/695227b15318368af0c4881b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57020 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:43:00,460 - lava_callback - INFO - Received callback for node 69e6739edc041e577b77b1a7 INFO: 172.20.0.1:42550 - "POST /node/69e6739edc041e577b77b1a7 HTTP/1.0" 202 Accepted 2026-04-22 18:43:00,465 - lava_callback - INFO - Starting async job submit for node 69e6739edc041e577b77b1a7 2026-04-22 18:43:00,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:00,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6739edc041e577b77b1a7 HTTP/1.1" 200 None 2026-04-22 18:43:00,482 - lava_callback - DEBUG - Processing node 69e6739edc041e577b77b1a7: baseline-arm-clabbe 2026-04-22 18:43:00,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6739edc041e577b77b1a7 2026-04-22 18:43:00,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:00,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6739edc041e577b77b1a7 HTTP/1.1" 200 None 2026-04-22 18:43:00,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:00,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:43:00,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:00,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6739edc041e577b77b1a7 HTTP/1.1" 200 None 2026-04-22 18:43:00,527 - lava_callback - ERROR - Error processing callback for node 69e6739edc041e577b77b1a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:43:40,377 - lava_callback - INFO - Received callback for node 69e673cbdc041e577b77b1b9 INFO: 172.20.0.1:43978 - "POST /node/69e673cbdc041e577b77b1b9 HTTP/1.0" 202 Accepted 2026-04-22 18:43:40,382 - lava_callback - INFO - Starting async job submit for node 69e673cbdc041e577b77b1b9 2026-04-22 18:43:40,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:40,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e673cbdc041e577b77b1b9 HTTP/1.1" 200 None 2026-04-22 18:43:40,397 - lava_callback - DEBUG - Processing node 69e673cbdc041e577b77b1b9: baseline-arm-clabbe 2026-04-22 18:43:40,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e673cbdc041e577b77b1b9 2026-04-22 18:43:40,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:40,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e673cbdc041e577b77b1b9 HTTP/1.1" 200 None 2026-04-22 18:43:40,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:40,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:43:40,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:43:40,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e673cbdc041e577b77b1b9 HTTP/1.1" 200 None 2026-04-22 18:43:40,443 - lava_callback - ERROR - Error processing callback for node 69e673cbdc041e577b77b1b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42308 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:44:36,313 - lava_callback - INFO - Received callback for node 69e9149a8327522856dafda1 INFO: 172.20.0.1:48428 - "POST /node/69e9149a8327522856dafda1 HTTP/1.0" 202 Accepted 2026-04-22 18:44:36,319 - lava_callback - INFO - Starting async job submit for node 69e9149a8327522856dafda1 2026-04-22 18:44:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:36,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9149a8327522856dafda1 HTTP/1.1" 200 None 2026-04-22 18:44:36,357 - lava_callback - DEBUG - Processing node 69e9149a8327522856dafda1: baseline-arm64 INFO: 172.20.0.1:48438 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:44:36,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:44:37,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:44:37,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9149a8327522856dafda1/log.txt.gz 2026-04-22 18:44:37,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:44:37,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:44:37,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9149a8327522856dafda1/lava-logs.yaml 2026-04-22 18:44:37,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:44:37,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:44:37,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e9149a8327522856dafda1/lava_callback.json.gz 2026-04-22 18:44:37,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9149a8327522856dafda1 HTTP/1.1" 200 None 2026-04-22 18:44:37,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:37,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:44:38,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:38,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9149a8327522856dafda1 HTTP/1.1" 200 None 2026-04-22 18:44:38,090 - lava_callback - INFO - Completed processing callback for node 69e9149a8327522856dafda1 INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:44:56,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:56,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:44:59,234 - lava_callback - INFO - Received callback for node 69e9171b8327522856dafec7 INFO: 172.20.0.1:40196 - "POST /node/69e9171b8327522856dafec7 HTTP/1.0" 202 Accepted 2026-04-22 18:44:59,240 - lava_callback - INFO - Starting async job submit for node 69e9171b8327522856dafec7 2026-04-22 18:44:59,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:59,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9171b8327522856dafec7 HTTP/1.1" 200 None 2026-04-22 18:44:59,256 - lava_callback - DEBUG - Processing node 69e9171b8327522856dafec7: baseline-nfs-arm64 2026-04-22 18:44:59,258 - lava_callback - WARNING - Failed to upload log 2026-04-22 18:44:59,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:44:59,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:44:59,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9171b8327522856dafec7/lava-logs.yaml 2026-04-22 18:44:59,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:44:59,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:44:59,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e9171b8327522856dafec7/lava_callback.json.gz 2026-04-22 18:44:59,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:59,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e9171b8327522856dafec7 HTTP/1.1" 200 None 2026-04-22 18:44:59,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:59,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:44:59,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:44:59,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e9171b8327522856dafec7 HTTP/1.1" 200 None 2026-04-22 18:44:59,461 - lava_callback - INFO - Completed processing callback for node 69e9171b8327522856dafec7 2026-04-22 18:45:00,510 - lava_callback - INFO - Received callback for node 69e67423dc041e577b77b1d6 INFO: 172.20.0.1:40010 - "POST /node/69e67423dc041e577b77b1d6 HTTP/1.0" 202 Accepted 2026-04-22 18:45:00,516 - lava_callback - INFO - Starting async job submit for node 69e67423dc041e577b77b1d6 2026-04-22 18:45:00,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:00,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67423dc041e577b77b1d6 HTTP/1.1" 200 None 2026-04-22 18:45:00,531 - lava_callback - DEBUG - Processing node 69e67423dc041e577b77b1d6: baseline-arm-clabbe 2026-04-22 18:45:00,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67423dc041e577b77b1d6 2026-04-22 18:45:00,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:00,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67423dc041e577b77b1d6 HTTP/1.1" 200 None 2026-04-22 18:45:00,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:00,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:45:00,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:00,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67423dc041e577b77b1d6 HTTP/1.1" 200 None 2026-04-22 18:45:00,581 - lava_callback - ERROR - Error processing callback for node 69e67423dc041e577b77b1d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57042 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:45:26,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:26,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40026 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:45:40,446 - lava_callback - INFO - Received callback for node 69e67450dc041e577b77b1e2 INFO: 172.20.0.1:59132 - "POST /node/69e67450dc041e577b77b1e2 HTTP/1.0" 202 Accepted 2026-04-22 18:45:40,452 - lava_callback - INFO - Starting async job submit for node 69e67450dc041e577b77b1e2 2026-04-22 18:45:40,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:40,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67450dc041e577b77b1e2 HTTP/1.1" 200 None 2026-04-22 18:45:40,469 - lava_callback - DEBUG - Processing node 69e67450dc041e577b77b1e2: baseline-arm-clabbe 2026-04-22 18:45:40,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67450dc041e577b77b1e2 2026-04-22 18:45:40,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:40,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67450dc041e577b77b1e2 HTTP/1.1" 200 None 2026-04-22 18:45:40,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:40,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bb42eed175ae971a585 HTTP/1.1" 200 None 2026-04-22 18:45:40,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:45:40,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67450dc041e577b77b1e2 HTTP/1.1" 200 None 2026-04-22 18:45:40,533 - lava_callback - ERROR - Error processing callback for node 69e67450dc041e577b77b1e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:48:42,152 - lava_callback - INFO - Received callback for node 69e674fcdc041e577b77b21a INFO: 172.20.0.1:55572 - "POST /node/69e674fcdc041e577b77b21a HTTP/1.0" 202 Accepted 2026-04-22 18:48:42,161 - lava_callback - INFO - Starting async job submit for node 69e674fcdc041e577b77b21a 2026-04-22 18:48:42,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:48:42,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e674fcdc041e577b77b21a HTTP/1.1" 200 None 2026-04-22 18:48:42,176 - lava_callback - DEBUG - Processing node 69e674fcdc041e577b77b21a: baseline-arm-baylibre 2026-04-22 18:48:42,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e674fcdc041e577b77b21a 2026-04-22 18:48:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:48:42,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e674fcdc041e577b77b21a HTTP/1.1" 200 None 2026-04-22 18:48:42,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:48:42,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68a3f6535ffd5b3ed8af HTTP/1.1" 200 None 2026-04-22 18:48:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:48:42,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e674fcdc041e577b77b21a HTTP/1.1" 200 None 2026-04-22 18:48:42,230 - lava_callback - ERROR - Error processing callback for node 69e674fcdc041e577b77b21a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38486 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:49:38,707 - lava_callback - INFO - Received callback for node 69e918108327522856daff69 INFO: 172.20.0.1:38502 - "POST /node/69e918108327522856daff69 HTTP/1.0" 202 Accepted 2026-04-22 18:49:38,713 - lava_callback - INFO - Starting async job submit for node 69e918108327522856daff69 2026-04-22 18:49:38,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:49:38,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918108327522856daff69 HTTP/1.1" 200 None 2026-04-22 18:49:38,781 - lava_callback - DEBUG - Processing node 69e918108327522856daff69: baseline-arm64 2026-04-22 18:49:38,913 - lava_callback - WARNING - Failed to upload log 2026-04-22 18:49:38,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:49:39,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:49:39,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918108327522856daff69/lava-logs.yaml 2026-04-22 18:49:39,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:49:39,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:49:39,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918108327522856daff69/lava_callback.json.gz 2026-04-22 18:49:39,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:49:39,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918108327522856daff69 HTTP/1.1" 200 None 2026-04-22 18:49:39,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:49:39,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:49:39,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:49:39,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e918108327522856daff69 HTTP/1.1" 200 None 2026-04-22 18:49:39,425 - lava_callback - INFO - Completed processing callback for node 69e918108327522856daff69 INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50612 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:49:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:49:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:51:24,131 - lava_callback - INFO - Received callback for node 69e918658327522856daffb1 INFO: 172.20.0.1:40592 - "POST /node/69e918658327522856daffb1 HTTP/1.0" 202 Accepted 2026-04-22 18:51:24,138 - lava_callback - INFO - Starting async job submit for node 69e918658327522856daffb1 2026-04-22 18:51:24,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:51:24,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918658327522856daffb1 HTTP/1.1" 200 None 2026-04-22 18:51:24,188 - lava_callback - DEBUG - Processing node 69e918658327522856daffb1: baseline-arm64 2026-04-22 18:51:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:51:24,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:51:24,439 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918658327522856daffb1/log.txt.gz 2026-04-22 18:51:24,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:51:24,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:51:24,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918658327522856daffb1/lava-logs.yaml 2026-04-22 18:51:24,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:51:24,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:51:24,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918658327522856daffb1/lava_callback.json.gz 2026-04-22 18:51:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:51:24,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918658327522856daffb1 HTTP/1.1" 200 None 2026-04-22 18:51:24,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:51:24,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:51:24,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:51:24,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e918658327522856daffb1 HTTP/1.1" 200 None 2026-04-22 18:51:24,955 - lava_callback - INFO - Completed processing callback for node 69e918658327522856daffb1 INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:51:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:51:26,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36696 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.20.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:54:29,684 - lava_callback - INFO - Received callback for node 69e918df8327522856daffec INFO: 172.20.0.1:41262 - "POST /node/69e918df8327522856daffec HTTP/1.0" 202 Accepted 2026-04-22 18:54:29,693 - lava_callback - INFO - Starting async job submit for node 69e918df8327522856daffec 2026-04-22 18:54:29,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:54:29,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918df8327522856daffec HTTP/1.1" 200 None 2026-04-22 18:54:29,747 - lava_callback - DEBUG - Processing node 69e918df8327522856daffec: baseline-arm64 2026-04-22 18:54:30,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:54:30,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:54:30,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918df8327522856daffec/log.txt.gz 2026-04-22 18:54:30,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:54:31,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:54:31,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918df8327522856daffec/lava-logs.yaml 2026-04-22 18:54:31,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:54:31,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:54:31,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e918df8327522856daffec/lava_callback.json.gz 2026-04-22 18:54:31,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:54:31,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e918df8327522856daffec HTTP/1.1" 200 None 2026-04-22 18:54:31,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:54:31,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:54:31,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:54:31,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e918df8327522856daffec HTTP/1.1" 200 None 2026-04-22 18:54:31,404 - lava_callback - INFO - Completed processing callback for node 69e918df8327522856daffec INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:54:56,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:54:56,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:56:54,880 - lava_callback - INFO - Received callback for node 69e917708327522856dafeff INFO: 172.20.0.1:54952 - "POST /node/69e917708327522856dafeff HTTP/1.0" 202 Accepted 2026-04-22 18:56:54,886 - lava_callback - INFO - Starting async job submit for node 69e917708327522856dafeff 2026-04-22 18:56:54,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:56:54,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e917708327522856dafeff HTTP/1.1" 200 None 2026-04-22 18:56:54,925 - lava_callback - DEBUG - Processing node 69e917708327522856dafeff: baseline-nfs-arm64 2026-04-22 18:56:55,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:56:55,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:56:55,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e917708327522856dafeff/log.txt.gz 2026-04-22 18:56:55,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:56:56,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:56:56,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e917708327522856dafeff/lava-logs.yaml 2026-04-22 18:56:56,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:56:56,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:56:56,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e917708327522856dafeff/lava_callback.json.gz 2026-04-22 18:56:56,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:56:56,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e917708327522856dafeff HTTP/1.1" 200 None 2026-04-22 18:56:56,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:56:56,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:56:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:56:56,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e917708327522856dafeff HTTP/1.1" 200 None 2026-04-22 18:56:56,379 - lava_callback - INFO - Completed processing callback for node 69e917708327522856dafeff INFO: 172.20.0.1:54962 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:56:56,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:56:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:59:29,237 - lava_callback - INFO - Received callback for node 69e919c08327522856db004b INFO: 172.20.0.1:57874 - "POST /node/69e919c08327522856db004b HTTP/1.0" 202 Accepted 2026-04-22 18:59:29,243 - lava_callback - INFO - Starting async job submit for node 69e919c08327522856db004b 2026-04-22 18:59:29,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:59:29,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e919c08327522856db004b HTTP/1.1" 200 None 2026-04-22 18:59:29,275 - lava_callback - DEBUG - Processing node 69e919c08327522856db004b: baseline-arm64 2026-04-22 18:59:29,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:59:29,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:59:29,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e919c08327522856db004b/log.txt.gz 2026-04-22 18:59:29,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:59:30,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:59:30,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e919c08327522856db004b/lava-logs.yaml 2026-04-22 18:59:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 18:59:30,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 18:59:30,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e919c08327522856db004b/lava_callback.json.gz 2026-04-22 18:59:30,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:59:30,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e919c08327522856db004b HTTP/1.1" 200 None 2026-04-22 18:59:30,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:59:30,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 18:59:30,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:59:30,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e919c08327522856db004b HTTP/1.1" 200 None 2026-04-22 18:59:30,423 - lava_callback - INFO - Completed processing callback for node 69e919c08327522856db004b INFO: 172.20.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK 2026-04-22 18:59:56,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 18:59:56,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:04:22,982 - lava_callback - INFO - Received callback for node 69e678b2dc041e577b77b2d4 INFO: 172.20.0.1:52098 - "POST /node/69e678b2dc041e577b77b2d4 HTTP/1.0" 202 Accepted 2026-04-22 19:04:22,988 - lava_callback - INFO - Starting async job submit for node 69e678b2dc041e577b77b2d4 2026-04-22 19:04:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b2dc041e577b77b2d4 HTTP/1.1" 200 None 2026-04-22 19:04:23,029 - lava_callback - DEBUG - Processing node 69e678b2dc041e577b77b2d4: baseline-arm64-baylibre 2026-04-22 19:04:23,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b2dc041e577b77b2d4 2026-04-22 19:04:23,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b2dc041e577b77b2d4 HTTP/1.1" 200 None 2026-04-22 19:04:23,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:23,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b2dc041e577b77b2d4 HTTP/1.1" 200 None 2026-04-22 19:04:23,110 - lava_callback - ERROR - Error processing callback for node 69e678b2dc041e577b77b2d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:04:23,650 - lava_callback - INFO - Received callback for node 69e678b4dc041e577b77b2d7 INFO: 172.20.0.1:52114 - "POST /node/69e678b4dc041e577b77b2d7 HTTP/1.0" 202 Accepted 2026-04-22 19:04:23,656 - lava_callback - INFO - Starting async job submit for node 69e678b4dc041e577b77b2d7 2026-04-22 19:04:23,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b4dc041e577b77b2d7 HTTP/1.1" 200 None 2026-04-22 19:04:23,671 - lava_callback - DEBUG - Processing node 69e678b4dc041e577b77b2d7: baseline-arm64-baylibre 2026-04-22 19:04:23,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b4dc041e577b77b2d7 2026-04-22 19:04:23,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b4dc041e577b77b2d7 HTTP/1.1" 200 None 2026-04-22 19:04:23,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:23,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:23,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b4dc041e577b77b2d7 HTTP/1.1" 200 None 2026-04-22 19:04:23,719 - lava_callback - ERROR - Error processing callback for node 69e678b4dc041e577b77b2d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:04:24,353 - lava_callback - INFO - Received callback for node 69e678a1dc041e577b77b28e INFO: 172.20.0.1:52128 - "POST /node/69e678a1dc041e577b77b28e HTTP/1.0" 202 Accepted 2026-04-22 19:04:24,358 - lava_callback - INFO - Starting async job submit for node 69e678a1dc041e577b77b28e 2026-04-22 19:04:24,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:24,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678a1dc041e577b77b28e HTTP/1.1" 200 None 2026-04-22 19:04:24,373 - lava_callback - DEBUG - Processing node 69e678a1dc041e577b77b28e: baseline-arm64-baylibre 2026-04-22 19:04:24,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678a1dc041e577b77b28e 2026-04-22 19:04:24,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:24,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678a1dc041e577b77b28e HTTP/1.1" 200 None 2026-04-22 19:04:24,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:24,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:04:24,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:24,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678a1dc041e577b77b28e HTTP/1.1" 200 None 2026-04-22 19:04:24,420 - lava_callback - ERROR - Error processing callback for node 69e678a1dc041e577b77b28e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:04:25,049 - lava_callback - INFO - Received callback for node 69e678b1dc041e577b77b2d1 INFO: 172.20.0.1:52140 - "POST /node/69e678b1dc041e577b77b2d1 HTTP/1.0" 202 Accepted 2026-04-22 19:04:25,055 - lava_callback - INFO - Starting async job submit for node 69e678b1dc041e577b77b2d1 2026-04-22 19:04:25,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:25,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b1dc041e577b77b2d1 HTTP/1.1" 200 None 2026-04-22 19:04:25,070 - lava_callback - DEBUG - Processing node 69e678b1dc041e577b77b2d1: baseline-arm64-baylibre 2026-04-22 19:04:25,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b1dc041e577b77b2d1 2026-04-22 19:04:25,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:25,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b1dc041e577b77b2d1 HTTP/1.1" 200 None 2026-04-22 19:04:25,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:25,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:25,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:25,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b1dc041e577b77b2d1 HTTP/1.1" 200 None 2026-04-22 19:04:25,116 - lava_callback - ERROR - Error processing callback for node 69e678b1dc041e577b77b2d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:04:42,980 - lava_callback - INFO - Received callback for node 69e678b9dc041e577b77b2eb INFO: 172.20.0.1:56428 - "POST /node/69e678b9dc041e577b77b2eb HTTP/1.0" 202 Accepted 2026-04-22 19:04:42,989 - lava_callback - INFO - Starting async job submit for node 69e678b9dc041e577b77b2eb 2026-04-22 19:04:42,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b9dc041e577b77b2eb HTTP/1.1" 200 None 2026-04-22 19:04:43,005 - lava_callback - DEBUG - Processing node 69e678b9dc041e577b77b2eb: baseline-arm64-baylibre 2026-04-22 19:04:43,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b9dc041e577b77b2eb 2026-04-22 19:04:43,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b9dc041e577b77b2eb HTTP/1.1" 200 None 2026-04-22 19:04:43,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:43,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b9dc041e577b77b2eb HTTP/1.1" 200 None 2026-04-22 19:04:43,061 - lava_callback - ERROR - Error processing callback for node 69e678b9dc041e577b77b2eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:04:43,679 - lava_callback - INFO - Received callback for node 69e678b6dc041e577b77b2e0 INFO: 172.20.0.1:56430 - "POST /node/69e678b6dc041e577b77b2e0 HTTP/1.0" 202 Accepted 2026-04-22 19:04:43,685 - lava_callback - INFO - Starting async job submit for node 69e678b6dc041e577b77b2e0 2026-04-22 19:04:43,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b6dc041e577b77b2e0 HTTP/1.1" 200 None 2026-04-22 19:04:43,711 - lava_callback - DEBUG - Processing node 69e678b6dc041e577b77b2e0: baseline-arm64-baylibre 2026-04-22 19:04:43,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b6dc041e577b77b2e0 2026-04-22 19:04:43,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b6dc041e577b77b2e0 HTTP/1.1" 200 None 2026-04-22 19:04:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:43,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:43,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b6dc041e577b77b2e0 HTTP/1.1" 200 None 2026-04-22 19:04:43,839 - lava_callback - ERROR - Error processing callback for node 69e678b6dc041e577b77b2e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:04:44,345 - lava_callback - INFO - Received callback for node 69e678b8dc041e577b77b2e8 INFO: 172.20.0.1:56446 - "POST /node/69e678b8dc041e577b77b2e8 HTTP/1.0" 202 Accepted 2026-04-22 19:04:44,350 - lava_callback - INFO - Starting async job submit for node 69e678b8dc041e577b77b2e8 2026-04-22 19:04:44,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:44,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b8dc041e577b77b2e8 HTTP/1.1" 200 None 2026-04-22 19:04:44,366 - lava_callback - DEBUG - Processing node 69e678b8dc041e577b77b2e8: baseline-arm64-baylibre 2026-04-22 19:04:44,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678b8dc041e577b77b2e8 2026-04-22 19:04:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:44,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678b8dc041e577b77b2e8 HTTP/1.1" 200 None 2026-04-22 19:04:44,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:44,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:04:44,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:04:44,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678b8dc041e577b77b2e8 HTTP/1.1" 200 None 2026-04-22 19:04:44,411 - lava_callback - ERROR - Error processing callback for node 69e678b8dc041e577b77b2e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51634 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:05:01,361 - lava_callback - INFO - Received callback for node 69e678ccdc041e577b77b313 INFO: 172.20.0.1:40906 - "POST /node/69e678ccdc041e577b77b313 HTTP/1.0" 202 Accepted 2026-04-22 19:05:01,367 - lava_callback - INFO - Starting async job submit for node 69e678ccdc041e577b77b313 2026-04-22 19:05:01,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:01,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678ccdc041e577b77b313 HTTP/1.1" 200 None 2026-04-22 19:05:01,382 - lava_callback - DEBUG - Processing node 69e678ccdc041e577b77b313: baseline-arm64-clabbe 2026-04-22 19:05:01,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678ccdc041e577b77b313 2026-04-22 19:05:01,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:01,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678ccdc041e577b77b313 HTTP/1.1" 200 None 2026-04-22 19:05:01,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:01,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:01,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:01,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678ccdc041e577b77b313 HTTP/1.1" 200 None 2026-04-22 19:05:01,439 - lava_callback - ERROR - Error processing callback for node 69e678ccdc041e577b77b313: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:02,064 - lava_callback - INFO - Received callback for node 69e678cedc041e577b77b338 INFO: 172.20.0.1:40908 - "POST /node/69e678cedc041e577b77b338 HTTP/1.0" 202 Accepted 2026-04-22 19:05:02,070 - lava_callback - INFO - Starting async job submit for node 69e678cedc041e577b77b338 2026-04-22 19:05:02,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cedc041e577b77b338 HTTP/1.1" 200 None 2026-04-22 19:05:02,085 - lava_callback - DEBUG - Processing node 69e678cedc041e577b77b338: baseline-arm64-clabbe 2026-04-22 19:05:02,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678cedc041e577b77b338 2026-04-22 19:05:02,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cedc041e577b77b338 HTTP/1.1" 200 None 2026-04-22 19:05:02,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:02,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678cedc041e577b77b338 HTTP/1.1" 200 None 2026-04-22 19:05:02,132 - lava_callback - ERROR - Error processing callback for node 69e678cedc041e577b77b338: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:02,739 - lava_callback - INFO - Received callback for node 69e678cfdc041e577b77b33b INFO: 172.20.0.1:40912 - "POST /node/69e678cfdc041e577b77b33b HTTP/1.0" 202 Accepted 2026-04-22 19:05:02,745 - lava_callback - INFO - Starting async job submit for node 69e678cfdc041e577b77b33b 2026-04-22 19:05:02,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cfdc041e577b77b33b HTTP/1.1" 200 None 2026-04-22 19:05:02,761 - lava_callback - DEBUG - Processing node 69e678cfdc041e577b77b33b: baseline-arm64-clabbe 2026-04-22 19:05:02,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678cfdc041e577b77b33b 2026-04-22 19:05:02,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cfdc041e577b77b33b HTTP/1.1" 200 None 2026-04-22 19:05:02,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:02,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:02,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678cfdc041e577b77b33b HTTP/1.1" 200 None 2026-04-22 19:05:02,822 - lava_callback - ERROR - Error processing callback for node 69e678cfdc041e577b77b33b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:03,419 - lava_callback - INFO - Received callback for node 69e678cfdc041e577b77b33e INFO: 172.20.0.1:40916 - "POST /node/69e678cfdc041e577b77b33e HTTP/1.0" 202 Accepted 2026-04-22 19:05:03,425 - lava_callback - INFO - Starting async job submit for node 69e678cfdc041e577b77b33e 2026-04-22 19:05:03,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:03,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cfdc041e577b77b33e HTTP/1.1" 200 None 2026-04-22 19:05:03,447 - lava_callback - DEBUG - Processing node 69e678cfdc041e577b77b33e: baseline-arm64-clabbe 2026-04-22 19:05:03,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678cfdc041e577b77b33e 2026-04-22 19:05:03,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:03,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678cfdc041e577b77b33e HTTP/1.1" 200 None 2026-04-22 19:05:03,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:03,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:03,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:03,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678cfdc041e577b77b33e HTTP/1.1" 200 None 2026-04-22 19:05:03,506 - lava_callback - ERROR - Error processing callback for node 69e678cfdc041e577b77b33e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:04,118 - lava_callback - INFO - Received callback for node 69e678d0dc041e577b77b341 INFO: 172.20.0.1:40922 - "POST /node/69e678d0dc041e577b77b341 HTTP/1.0" 202 Accepted 2026-04-22 19:05:04,124 - lava_callback - INFO - Starting async job submit for node 69e678d0dc041e577b77b341 2026-04-22 19:05:04,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d0dc041e577b77b341 HTTP/1.1" 200 None 2026-04-22 19:05:04,139 - lava_callback - DEBUG - Processing node 69e678d0dc041e577b77b341: baseline-arm64-clabbe 2026-04-22 19:05:04,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678d0dc041e577b77b341 2026-04-22 19:05:04,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d0dc041e577b77b341 HTTP/1.1" 200 None 2026-04-22 19:05:04,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:04,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678d0dc041e577b77b341 HTTP/1.1" 200 None 2026-04-22 19:05:04,190 - lava_callback - ERROR - Error processing callback for node 69e678d0dc041e577b77b341: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:04,826 - lava_callback - INFO - Received callback for node 69e678d1dc041e577b77b347 INFO: 172.20.0.1:40928 - "POST /node/69e678d1dc041e577b77b347 HTTP/1.0" 202 Accepted 2026-04-22 19:05:04,832 - lava_callback - INFO - Starting async job submit for node 69e678d1dc041e577b77b347 2026-04-22 19:05:04,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d1dc041e577b77b347 HTTP/1.1" 200 None 2026-04-22 19:05:04,847 - lava_callback - DEBUG - Processing node 69e678d1dc041e577b77b347: baseline-arm64-clabbe 2026-04-22 19:05:04,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678d1dc041e577b77b347 2026-04-22 19:05:04,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d1dc041e577b77b347 HTTP/1.1" 200 None 2026-04-22 19:05:04,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:04,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:04,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678d1dc041e577b77b347 HTTP/1.1" 200 None 2026-04-22 19:05:04,898 - lava_callback - ERROR - Error processing callback for node 69e678d1dc041e577b77b347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:05:05,507 - lava_callback - INFO - Received callback for node 69e678d1dc041e577b77b344 INFO: 172.20.0.1:40942 - "POST /node/69e678d1dc041e577b77b344 HTTP/1.0" 202 Accepted 2026-04-22 19:05:05,512 - lava_callback - INFO - Starting async job submit for node 69e678d1dc041e577b77b344 2026-04-22 19:05:05,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:05,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d1dc041e577b77b344 HTTP/1.1" 200 None 2026-04-22 19:05:05,530 - lava_callback - DEBUG - Processing node 69e678d1dc041e577b77b344: baseline-arm64-clabbe 2026-04-22 19:05:05,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e678d1dc041e577b77b344 2026-04-22 19:05:05,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:05,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e678d1dc041e577b77b344 HTTP/1.1" 200 None 2026-04-22 19:05:05,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:05,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e66a77dc041e577b7785d5 HTTP/1.1" 200 None 2026-04-22 19:05:05,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:05:05,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e678d1dc041e577b77b344 HTTP/1.1" 200 None 2026-04-22 19:05:05,597 - lava_callback - ERROR - Error processing callback for node 69e678d1dc041e577b77b344: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60352 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:07:41,043 - lava_callback - INFO - Received callback for node 69e91b438327522856db0110 INFO: 172.20.0.1:48868 - "POST /node/69e91b438327522856db0110 HTTP/1.0" 202 Accepted 2026-04-22 19:07:41,050 - lava_callback - INFO - Starting async job submit for node 69e91b438327522856db0110 2026-04-22 19:07:41,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:07:41,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91b438327522856db0110 HTTP/1.1" 200 None 2026-04-22 19:07:41,102 - lava_callback - DEBUG - Processing node 69e91b438327522856db0110: baseline-arm64 2026-04-22 19:07:41,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:07:41,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:07:41,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91b438327522856db0110/log.txt.gz 2026-04-22 19:07:41,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:07:41,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:07:41,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91b438327522856db0110/lava-logs.yaml 2026-04-22 19:07:41,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:07:42,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:07:42,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91b438327522856db0110/lava_callback.json.gz DEBUG: Setup failed for 69e91b438327522856db0110. Transitting job node result: incomplete -> fail 2026-04-22 19:07:42,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:07:42,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91b438327522856db0110 HTTP/1.1" 200 None 2026-04-22 19:07:42,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:07:42,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 19:07:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:07:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91b438327522856db0110 HTTP/1.1" 200 None 2026-04-22 19:07:42,325 - lava_callback - INFO - Completed processing callback for node 69e91b438327522856db0110 INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35962 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:07:56,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:07:56,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:12:23,737 - lava_callback - INFO - Received callback for node 69e67a82dc041e577b77b507 INFO: 172.20.0.1:51198 - "POST /node/69e67a82dc041e577b77b507 HTTP/1.0" 202 Accepted 2026-04-22 19:12:23,742 - lava_callback - INFO - Starting async job submit for node 69e67a82dc041e577b77b507 2026-04-22 19:12:23,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:23,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67a82dc041e577b77b507 HTTP/1.1" 200 None 2026-04-22 19:12:23,761 - lava_callback - DEBUG - Processing node 69e67a82dc041e577b77b507: baseline-arm64-baylibre 2026-04-22 19:12:23,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67a82dc041e577b77b507 2026-04-22 19:12:23,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:23,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67a82dc041e577b77b507 HTTP/1.1" 200 None 2026-04-22 19:12:23,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:23,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:12:23,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:23,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67a82dc041e577b77b507 HTTP/1.1" 200 None 2026-04-22 19:12:23,808 - lava_callback - ERROR - Error processing callback for node 69e67a82dc041e577b77b507: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:12:24,911 - lava_callback - INFO - Received callback for node 69e919778327522856db002f INFO: 172.20.0.1:51214 - "POST /node/69e919778327522856db002f HTTP/1.0" 202 Accepted 2026-04-22 19:12:24,918 - lava_callback - INFO - Starting async job submit for node 69e919778327522856db002f 2026-04-22 19:12:24,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:24,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e919778327522856db002f HTTP/1.1" 200 None 2026-04-22 19:12:24,991 - lava_callback - DEBUG - Processing node 69e919778327522856db002f: baseline-arm 2026-04-22 19:12:25,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:12:25,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:12:25,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e919778327522856db002f/log.txt.gz 2026-04-22 19:12:26,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:12:26,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:12:26,399 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e919778327522856db002f/lava-logs.yaml 2026-04-22 19:12:26,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:12:26,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:12:26,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e919778327522856db002f/lava_callback.json.gz DEBUG: Setup failed for 69e919778327522856db002f. Transitting job node result: incomplete -> fail 2026-04-22 19:12:26,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:26,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e919778327522856db002f HTTP/1.1" 200 None 2026-04-22 19:12:26,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:26,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 19:12:26,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:26,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e919778327522856db002f HTTP/1.1" 200 None 2026-04-22 19:12:26,780 - lava_callback - INFO - Completed processing callback for node 69e919778327522856db002f 2026-04-22 19:12:26,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:12:26,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35166 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:15:58,725 - lava_callback - INFO - Received callback for node 69e91a3b8327522856db0099 INFO: 172.20.0.1:35178 - "POST /node/69e91a3b8327522856db0099 HTTP/1.0" 202 Accepted 2026-04-22 19:15:58,739 - lava_callback - INFO - Starting async job submit for node 69e91a3b8327522856db0099 2026-04-22 19:15:58,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:15:58,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91a3b8327522856db0099 HTTP/1.1" 200 None 2026-04-22 19:15:58,847 - lava_callback - DEBUG - Processing node 69e91a3b8327522856db0099: ltp-smoke INFO: 172.20.0.1:35186 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:15:59,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:15:59,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:15:59,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e91a3b8327522856db0099/log.txt.gz 2026-04-22 19:15:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:16:00,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:16:00,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e91a3b8327522856db0099/lava-logs.yaml 2026-04-22 19:16:00,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:16:00,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:16:00,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e91a3b8327522856db0099/lava_callback.json.gz 2026-04-22 19:16:00,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:16:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91a3b8327522856db0099 HTTP/1.1" 200 None 2026-04-22 19:16:00,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:16:00,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4cc8327522856dac252 HTTP/1.1" 200 None 2026-04-22 19:16:00,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:16:00,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91a3b8327522856db0099 HTTP/1.1" 200 None 2026-04-22 19:16:00,596 - lava_callback - INFO - Completed processing callback for node 69e91a3b8327522856db0099 INFO: 172.20.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:16:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:16:27,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:18:01,397 - lava_callback - INFO - Received callback for node 69e88a69b1b1e6995a88cc01 INFO: 172.20.0.1:50596 - "POST /node/69e88a69b1b1e6995a88cc01 HTTP/1.0" 202 Accepted 2026-04-22 19:18:01,403 - lava_callback - INFO - Starting async job submit for node 69e88a69b1b1e6995a88cc01 2026-04-22 19:18:01,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:01,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88a69b1b1e6995a88cc01 HTTP/1.1" 200 None 2026-04-22 19:18:01,444 - lava_callback - DEBUG - Processing node 69e88a69b1b1e6995a88cc01: baseline-x86 2026-04-22 19:18:01,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:18:01,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:18:01,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e88a69b1b1e6995a88cc01/log.txt.gz 2026-04-22 19:18:02,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:18:02,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:18:02,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e88a69b1b1e6995a88cc01/lava-logs.yaml 2026-04-22 19:18:02,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:18:02,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:18:02,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e88a69b1b1e6995a88cc01/lava_callback.json.gz 2026-04-22 19:18:02,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88a69b1b1e6995a88cc01 HTTP/1.1" 200 None 2026-04-22 19:18:02,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:02,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88449b1b1e6995a88c3d4 HTTP/1.1" 200 None 2026-04-22 19:18:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:02,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e88a69b1b1e6995a88cc01 HTTP/1.1" 200 None 2026-04-22 19:18:02,458 - lava_callback - INFO - Completed processing callback for node 69e88a69b1b1e6995a88cc01 2026-04-22 19:18:03,892 - lava_callback - INFO - Received callback for node 69e67bdadc041e577b77b5f7 INFO: 172.20.0.1:50606 - "POST /node/69e67bdadc041e577b77b5f7 HTTP/1.0" 202 Accepted 2026-04-22 19:18:03,900 - lava_callback - INFO - Starting async job submit for node 69e67bdadc041e577b77b5f7 2026-04-22 19:18:03,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:03,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67bdadc041e577b77b5f7 HTTP/1.1" 200 None 2026-04-22 19:18:03,915 - lava_callback - DEBUG - Processing node 69e67bdadc041e577b77b5f7: baseline-arm64-baylibre 2026-04-22 19:18:03,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67bdadc041e577b77b5f7 2026-04-22 19:18:03,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:03,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67bdadc041e577b77b5f7 HTTP/1.1" 200 None 2026-04-22 19:18:03,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:03,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:18:03,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:03,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67bdadc041e577b77b5f7 HTTP/1.1" 200 None 2026-04-22 19:18:03,981 - lava_callback - ERROR - Error processing callback for node 69e67bdadc041e577b77b5f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49992 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:18:27,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:18:27,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:22:34,275 - lava_callback - INFO - Received callback for node 69e8e29cb1b1e6995a88e8ac INFO: 172.20.0.1:49716 - "POST /node/69e8e29cb1b1e6995a88e8ac HTTP/1.0" 202 Accepted 2026-04-22 19:22:34,285 - lava_callback - INFO - Starting async job submit for node 69e8e29cb1b1e6995a88e8ac 2026-04-22 19:22:34,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:22:34,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8e29cb1b1e6995a88e8ac HTTP/1.1" 200 None 2026-04-22 19:22:34,318 - lava_callback - DEBUG - Processing node 69e8e29cb1b1e6995a88e8ac: baseline-x86 2026-04-22 19:22:34,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:22:34,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:22:34,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e8e29cb1b1e6995a88e8ac/log.txt.gz 2026-04-22 19:22:34,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:22:35,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:22:35,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8e29cb1b1e6995a88e8ac/lava-logs.yaml 2026-04-22 19:22:35,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:22:35,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:22:35,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8e29cb1b1e6995a88e8ac/lava_callback.json.gz 2026-04-22 19:22:35,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:22:35,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8e29cb1b1e6995a88e8ac HTTP/1.1" 200 None 2026-04-22 19:22:35,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:22:35,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88449b1b1e6995a88c3d4 HTTP/1.1" 200 None 2026-04-22 19:22:35,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:22:35,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8e29cb1b1e6995a88e8ac HTTP/1.1" 200 None 2026-04-22 19:22:35,328 - lava_callback - INFO - Completed processing callback for node 69e8e29cb1b1e6995a88e8ac INFO: 172.20.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:22:57,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:22:57,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:23:02,523 - lava_callback - INFO - Received callback for node 69e8fed78327522856daedec INFO: 172.20.0.1:54446 - "POST /node/69e8fed78327522856daedec HTTP/1.0" 202 Accepted 2026-04-22 19:23:02,529 - lava_callback - INFO - Starting async job submit for node 69e8fed78327522856daedec 2026-04-22 19:23:02,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:02,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed78327522856daedec HTTP/1.1" 200 None 2026-04-22 19:23:02,560 - lava_callback - DEBUG - Processing node 69e8fed78327522856daedec: baseline-x86 2026-04-22 19:23:02,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:02,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:02,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed78327522856daedec/log.txt.gz 2026-04-22 19:23:03,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:03,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:03,278 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed78327522856daedec/lava-logs.yaml 2026-04-22 19:23:03,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:03,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:03,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e8fed78327522856daedec/lava_callback.json.gz 2026-04-22 19:23:03,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:03,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8fed78327522856daedec HTTP/1.1" 200 None 2026-04-22 19:23:03,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:03,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4ea8327522856dac276 HTTP/1.1" 200 None 2026-04-22 19:23:03,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:03,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8fed78327522856daedec HTTP/1.1" 200 None 2026-04-22 19:23:03,494 - lava_callback - INFO - Completed processing callback for node 69e8fed78327522856daedec INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:23:19,205 - lava_callback - INFO - Received callback for node 69e904c48327522856daf249 INFO: 172.20.0.1:41712 - "POST /node/69e904c48327522856daf249 HTTP/1.0" 202 Accepted 2026-04-22 19:23:19,211 - lava_callback - INFO - Starting async job submit for node 69e904c48327522856daf249 2026-04-22 19:23:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:19,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c48327522856daf249 HTTP/1.1" 200 None 2026-04-22 19:23:19,247 - lava_callback - DEBUG - Processing node 69e904c48327522856daf249: baseline-arm64-broonie 2026-04-22 19:23:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:19,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:19,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c48327522856daf249/log.txt.gz 2026-04-22 19:23:19,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:19,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:19,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c48327522856daf249/lava-logs.yaml 2026-04-22 19:23:19,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:20,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:20,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c48327522856daf249/lava_callback.json.gz 2026-04-22 19:23:20,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:20,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c48327522856daf249 HTTP/1.1" 200 None 2026-04-22 19:23:20,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:20,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 19:23:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:20,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c48327522856daf249 HTTP/1.1" 200 None 2026-04-22 19:23:20,201 - lava_callback - INFO - Completed processing callback for node 69e904c48327522856daf249 INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:23:27,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:27,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51704 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:23:44,085 - lava_callback - INFO - Received callback for node 69e67d36dc041e577b77b689 INFO: 172.20.0.1:43542 - "POST /node/69e67d36dc041e577b77b689 HTTP/1.0" 202 Accepted 2026-04-22 19:23:44,091 - lava_callback - INFO - Starting async job submit for node 69e67d36dc041e577b77b689 2026-04-22 19:23:44,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:44,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67d36dc041e577b77b689 HTTP/1.1" 200 None 2026-04-22 19:23:44,107 - lava_callback - DEBUG - Processing node 69e67d36dc041e577b77b689: baseline-arm64-baylibre 2026-04-22 19:23:44,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67d36dc041e577b77b689 2026-04-22 19:23:44,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:44,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67d36dc041e577b77b689 HTTP/1.1" 200 None 2026-04-22 19:23:44,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:44,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:23:44,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:44,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67d36dc041e577b77b689 HTTP/1.1" 200 None 2026-04-22 19:23:44,159 - lava_callback - ERROR - Error processing callback for node 69e67d36dc041e577b77b689: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55940 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:23:57,154 - lava_callback - INFO - Received callback for node 69e91dce8327522856db0263 INFO: 172.20.0.1:55954 - "POST /node/69e91dce8327522856db0263 HTTP/1.0" 202 Accepted 2026-04-22 19:23:57,161 - lava_callback - INFO - Starting async job submit for node 69e91dce8327522856db0263 2026-04-22 19:23:57,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:57,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91dce8327522856db0263 HTTP/1.1" 200 None 2026-04-22 19:23:57,202 - lava_callback - DEBUG - Processing node 69e91dce8327522856db0263: baseline-arm64 2026-04-22 19:23:57,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:57,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:57,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91dce8327522856db0263/log.txt.gz 2026-04-22 19:23:58,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:58,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:58,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91dce8327522856db0263/lava-logs.yaml 2026-04-22 19:23:58,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:23:58,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:23:58,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e91dce8327522856db0263/lava_callback.json.gz 2026-04-22 19:23:58,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:58,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91dce8327522856db0263 HTTP/1.1" 200 None 2026-04-22 19:23:58,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:58,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 19:23:58,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:23:58,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91dce8327522856db0263 HTTP/1.1" 200 None 2026-04-22 19:23:58,731 - lava_callback - INFO - Completed processing callback for node 69e91dce8327522856db0263 INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58140 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:24:08,386 - lava_callback - INFO - Received callback for node 69e91b998327522856db0142 INFO: 172.20.0.1:58148 - "POST /node/69e91b998327522856db0142 HTTP/1.0" 202 Accepted 2026-04-22 19:24:08,395 - lava_callback - INFO - Starting async job submit for node 69e91b998327522856db0142 2026-04-22 19:24:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:24:08,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91b998327522856db0142 HTTP/1.1" 200 None 2026-04-22 19:24:08,462 - lava_callback - DEBUG - Processing node 69e91b998327522856db0142: baseline-nfs-arm64 2026-04-22 19:24:09,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:24:09,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:24:09,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91b998327522856db0142/log.txt.gz 2026-04-22 19:24:10,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:24:10,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:24:10,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91b998327522856db0142/lava-logs.yaml 2026-04-22 19:24:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:24:11,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:24:11,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91b998327522856db0142/lava_callback.json.gz DEBUG: Setup failed for 69e91b998327522856db0142. Transitting job node result: incomplete -> fail 2026-04-22 19:24:11,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:24:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91b998327522856db0142 HTTP/1.1" 200 None 2026-04-22 19:24:11,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:24:11,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 19:24:11,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:24:11,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91b998327522856db0142 HTTP/1.1" 200 None 2026-04-22 19:24:11,310 - lava_callback - INFO - Completed processing callback for node 69e91b998327522856db0142 INFO: 172.20.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59414 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:24:27,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:24:27,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:25:04,150 - lava_callback - INFO - Received callback for node 69e67d8edc041e577b77b6bb INFO: 172.20.0.1:48798 - "POST /node/69e67d8edc041e577b77b6bb HTTP/1.0" 202 Accepted 2026-04-22 19:25:04,155 - lava_callback - INFO - Starting async job submit for node 69e67d8edc041e577b77b6bb 2026-04-22 19:25:04,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:25:04,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67d8edc041e577b77b6bb HTTP/1.1" 200 None 2026-04-22 19:25:04,170 - lava_callback - DEBUG - Processing node 69e67d8edc041e577b77b6bb: baseline-arm64-baylibre 2026-04-22 19:25:04,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67d8edc041e577b77b6bb 2026-04-22 19:25:04,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:25:04,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67d8edc041e577b77b6bb HTTP/1.1" 200 None 2026-04-22 19:25:04,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:25:04,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:25:04,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:25:04,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67d8edc041e577b77b6bb HTTP/1.1" 200 None 2026-04-22 19:25:04,229 - lava_callback - ERROR - Error processing callback for node 69e67d8edc041e577b77b6bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38856 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:25:59,631 - lava_callback - INFO - Received callback for node 69e91c3a8327522856db01a8 INFO: 172.20.0.1:38864 - "POST /node/69e91c3a8327522856db01a8 HTTP/1.0" 202 Accepted 2026-04-22 19:25:59,678 - lava_callback - INFO - Starting async job submit for node 69e91c3a8327522856db01a8 2026-04-22 19:25:59,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:25:59,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91c3a8327522856db01a8 HTTP/1.1" 200 None 2026-04-22 19:25:59,732 - lava_callback - DEBUG - Processing node 69e91c3a8327522856db01a8: baseline-arm-pengutronix 2026-04-22 19:25:59,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:25:59,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:25:59,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e91c3a8327522856db01a8/log.txt.gz 2026-04-22 19:26:00,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:26:00,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:26:00,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e91c3a8327522856db01a8/lava-logs.yaml 2026-04-22 19:26:00,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:26:00,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:26:00,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e91c3a8327522856db01a8/lava_callback.json.gz DEBUG: Setup failed for 69e91c3a8327522856db01a8. Transitting job node result: incomplete -> fail 2026-04-22 19:26:00,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:26:00,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91c3a8327522856db01a8 HTTP/1.1" 200 None 2026-04-22 19:26:00,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:26:00,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4c68327522856dac248 HTTP/1.1" 200 None 2026-04-22 19:26:00,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:26:00,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91c3a8327522856db01a8 HTTP/1.1" 200 None 2026-04-22 19:26:00,487 - lava_callback - INFO - Completed processing callback for node 69e91c3a8327522856db01a8 INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:26:27,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:26:27,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33748 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 19:28:15,919 - lava_callback - INFO - Received callback for node 69e91ebb8327522856db02d9 INFO: 172.20.0.1:33754 - "POST /node/69e91ebb8327522856db02d9 HTTP/1.0" 202 Accepted 2026-04-22 19:28:15,926 - lava_callback - INFO - Starting async job submit for node 69e91ebb8327522856db02d9 2026-04-22 19:28:15,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:15,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91ebb8327522856db02d9 HTTP/1.1" 200 None 2026-04-22 19:28:15,966 - lava_callback - DEBUG - Processing node 69e91ebb8327522856db02d9: baseline-nfs-arm64 INFO: 172.20.0.1:33768 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:28:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:28:16,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:28:16,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91ebb8327522856db02d9/log.txt.gz 2026-04-22 19:28:17,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:28:17,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:28:17,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91ebb8327522856db02d9/lava-logs.yaml 2026-04-22 19:28:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:28:17,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:28:17,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e91ebb8327522856db02d9/lava_callback.json.gz 2026-04-22 19:28:17,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:17,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e91ebb8327522856db02d9 HTTP/1.1" 200 None 2026-04-22 19:28:17,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:17,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 19:28:17,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:17,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e91ebb8327522856db02d9 HTTP/1.1" 200 None 2026-04-22 19:28:17,579 - lava_callback - INFO - Completed processing callback for node 69e91ebb8327522856db02d9 2026-04-22 19:28:24,321 - lava_callback - INFO - Received callback for node 69e67e46dc041e577b77b708 INFO: 172.20.0.1:49080 - "POST /node/69e67e46dc041e577b77b708 HTTP/1.0" 202 Accepted 2026-04-22 19:28:24,326 - lava_callback - INFO - Starting async job submit for node 69e67e46dc041e577b77b708 2026-04-22 19:28:24,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:24,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67e46dc041e577b77b708 HTTP/1.1" 200 None 2026-04-22 19:28:24,341 - lava_callback - DEBUG - Processing node 69e67e46dc041e577b77b708: baseline-arm64-baylibre 2026-04-22 19:28:24,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67e46dc041e577b77b708 2026-04-22 19:28:24,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67e46dc041e577b77b708 HTTP/1.1" 200 None 2026-04-22 19:28:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:24,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:28:24,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:24,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67e46dc041e577b77b708 HTTP/1.1" 200 None 2026-04-22 19:28:24,387 - lava_callback - ERROR - Error processing callback for node 69e67e46dc041e577b77b708: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:28:27,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:28:27,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42422 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:32:42,414 - lava_callback - INFO - Received callback for node 69e67f4bdc041e577b77b796 INFO: 172.20.0.1:34002 - "POST /node/69e67f4bdc041e577b77b796 HTTP/1.0" 202 Accepted 2026-04-22 19:32:42,420 - lava_callback - INFO - Starting async job submit for node 69e67f4bdc041e577b77b796 2026-04-22 19:32:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:32:42,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67f4bdc041e577b77b796 HTTP/1.1" 200 None 2026-04-22 19:32:42,447 - lava_callback - DEBUG - Processing node 69e67f4bdc041e577b77b796: baseline-arm64-clabbe 2026-04-22 19:32:42,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67f4bdc041e577b77b796 2026-04-22 19:32:42,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:32:42,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67f4bdc041e577b77b796 HTTP/1.1" 200 None 2026-04-22 19:32:42,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:32:42,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:32:42,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:32:42,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67f4bdc041e577b77b796 HTTP/1.1" 200 None 2026-04-22 19:32:42,511 - lava_callback - ERROR - Error processing callback for node 69e67f4bdc041e577b77b796: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43622 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:34:02,609 - lava_callback - INFO - Received callback for node 69e67fa4dc041e577b77b7cc INFO: 172.20.0.1:40822 - "POST /node/69e67fa4dc041e577b77b7cc HTTP/1.0" 202 Accepted 2026-04-22 19:34:02,617 - lava_callback - INFO - Starting async job submit for node 69e67fa4dc041e577b77b7cc 2026-04-22 19:34:02,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:34:02,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67fa4dc041e577b77b7cc HTTP/1.1" 200 None 2026-04-22 19:34:02,632 - lava_callback - DEBUG - Processing node 69e67fa4dc041e577b77b7cc: baseline-arm64-clabbe 2026-04-22 19:34:02,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e67fa4dc041e577b77b7cc 2026-04-22 19:34:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:34:02,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e67fa4dc041e577b77b7cc HTTP/1.1" 200 None 2026-04-22 19:34:02,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:34:02,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:34:02,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:34:02,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e67fa4dc041e577b77b7cc HTTP/1.1" 200 None 2026-04-22 19:34:02,691 - lava_callback - ERROR - Error processing callback for node 69e67fa4dc041e577b77b7cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:38:22,681 - lava_callback - INFO - Received callback for node 69e680a8dc041e577b77b840 INFO: 172.20.0.1:51268 - "POST /node/69e680a8dc041e577b77b840 HTTP/1.0" 202 Accepted 2026-04-22 19:38:22,686 - lava_callback - INFO - Starting async job submit for node 69e680a8dc041e577b77b840 2026-04-22 19:38:22,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:38:22,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680a8dc041e577b77b840 HTTP/1.1" 200 None 2026-04-22 19:38:22,708 - lava_callback - DEBUG - Processing node 69e680a8dc041e577b77b840: baseline-arm64-clabbe 2026-04-22 19:38:22,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680a8dc041e577b77b840 2026-04-22 19:38:22,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:38:22,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680a8dc041e577b77b840 HTTP/1.1" 200 None 2026-04-22 19:38:22,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:38:22,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:38:22,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:38:22,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680a8dc041e577b77b840 HTTP/1.1" 200 None 2026-04-22 19:38:22,759 - lava_callback - ERROR - Error processing callback for node 69e680a8dc041e577b77b840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47006 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:39:42,709 - lava_callback - INFO - Received callback for node 69e680f9dc041e577b77b894 INFO: 172.20.0.1:37332 - "POST /node/69e680f9dc041e577b77b894 HTTP/1.0" 202 Accepted 2026-04-22 19:39:42,714 - lava_callback - INFO - Starting async job submit for node 69e680f9dc041e577b77b894 2026-04-22 19:39:42,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:42,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680f9dc041e577b77b894 HTTP/1.1" 200 None 2026-04-22 19:39:42,730 - lava_callback - DEBUG - Processing node 69e680f9dc041e577b77b894: baseline-arm-clabbe 2026-04-22 19:39:42,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680f9dc041e577b77b894 2026-04-22 19:39:42,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:42,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680f9dc041e577b77b894 HTTP/1.1" 200 None 2026-04-22 19:39:42,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:42,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:42,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680f9dc041e577b77b894 HTTP/1.1" 200 None 2026-04-22 19:39:42,777 - lava_callback - ERROR - Error processing callback for node 69e680f9dc041e577b77b894: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:43,387 - lava_callback - INFO - Received callback for node 69e680fbdc041e577b77b89a INFO: 172.20.0.1:37338 - "POST /node/69e680fbdc041e577b77b89a HTTP/1.0" 202 Accepted 2026-04-22 19:39:43,393 - lava_callback - INFO - Starting async job submit for node 69e680fbdc041e577b77b89a 2026-04-22 19:39:43,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:43,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fbdc041e577b77b89a HTTP/1.1" 200 None 2026-04-22 19:39:43,411 - lava_callback - DEBUG - Processing node 69e680fbdc041e577b77b89a: baseline-arm-clabbe 2026-04-22 19:39:43,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680fbdc041e577b77b89a 2026-04-22 19:39:43,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:43,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fbdc041e577b77b89a HTTP/1.1" 200 None 2026-04-22 19:39:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:43,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:43,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680fbdc041e577b77b89a HTTP/1.1" 200 None 2026-04-22 19:39:43,460 - lava_callback - ERROR - Error processing callback for node 69e680fbdc041e577b77b89a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:44,096 - lava_callback - INFO - Received callback for node 69e680fcdc041e577b77b89e INFO: 172.20.0.1:37352 - "POST /node/69e680fcdc041e577b77b89e HTTP/1.0" 202 Accepted 2026-04-22 19:39:44,102 - lava_callback - INFO - Starting async job submit for node 69e680fcdc041e577b77b89e 2026-04-22 19:39:44,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fcdc041e577b77b89e HTTP/1.1" 200 None 2026-04-22 19:39:44,118 - lava_callback - DEBUG - Processing node 69e680fcdc041e577b77b89e: baseline-arm-clabbe 2026-04-22 19:39:44,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680fcdc041e577b77b89e 2026-04-22 19:39:44,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fcdc041e577b77b89e HTTP/1.1" 200 None 2026-04-22 19:39:44,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:44,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680fcdc041e577b77b89e HTTP/1.1" 200 None 2026-04-22 19:39:44,181 - lava_callback - ERROR - Error processing callback for node 69e680fcdc041e577b77b89e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:44,756 - lava_callback - INFO - Received callback for node 69e680fcdc041e577b77b8a1 INFO: 172.20.0.1:37360 - "POST /node/69e680fcdc041e577b77b8a1 HTTP/1.0" 202 Accepted 2026-04-22 19:39:44,762 - lava_callback - INFO - Starting async job submit for node 69e680fcdc041e577b77b8a1 2026-04-22 19:39:44,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fcdc041e577b77b8a1 HTTP/1.1" 200 None 2026-04-22 19:39:44,780 - lava_callback - DEBUG - Processing node 69e680fcdc041e577b77b8a1: baseline-arm-clabbe 2026-04-22 19:39:44,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680fcdc041e577b77b8a1 2026-04-22 19:39:44,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fcdc041e577b77b8a1 HTTP/1.1" 200 None 2026-04-22 19:39:44,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:44,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:44,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680fcdc041e577b77b8a1 HTTP/1.1" 200 None 2026-04-22 19:39:44,825 - lava_callback - ERROR - Error processing callback for node 69e680fcdc041e577b77b8a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:45,044 - lava_callback - INFO - Received callback for node 69e680eddc041e577b77b872 INFO: 172.20.0.1:37362 - "POST /node/69e680eddc041e577b77b872 HTTP/1.0" 202 Accepted 2026-04-22 19:39:45,050 - lava_callback - INFO - Starting async job submit for node 69e680eddc041e577b77b872 2026-04-22 19:39:45,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680eddc041e577b77b872 HTTP/1.1" 200 None 2026-04-22 19:39:45,064 - lava_callback - DEBUG - Processing node 69e680eddc041e577b77b872: baseline-arm-baylibre 2026-04-22 19:39:45,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680eddc041e577b77b872 2026-04-22 19:39:45,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680eddc041e577b77b872 HTTP/1.1" 200 None 2026-04-22 19:39:45,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680eddc041e577b77b872 HTTP/1.1" 200 None 2026-04-22 19:39:45,112 - lava_callback - ERROR - Error processing callback for node 69e680eddc041e577b77b872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:45,712 - lava_callback - INFO - Received callback for node 69e680f1dc041e577b77b87d INFO: 172.20.0.1:37374 - "POST /node/69e680f1dc041e577b77b87d HTTP/1.0" 202 Accepted 2026-04-22 19:39:45,718 - lava_callback - INFO - Starting async job submit for node 69e680f1dc041e577b77b87d 2026-04-22 19:39:45,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680f1dc041e577b77b87d HTTP/1.1" 200 None 2026-04-22 19:39:45,733 - lava_callback - DEBUG - Processing node 69e680f1dc041e577b77b87d: baseline-arm-baylibre 2026-04-22 19:39:45,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680f1dc041e577b77b87d 2026-04-22 19:39:45,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680f1dc041e577b77b87d HTTP/1.1" 200 None 2026-04-22 19:39:45,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:45,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:45,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680f1dc041e577b77b87d HTTP/1.1" 200 None 2026-04-22 19:39:45,779 - lava_callback - ERROR - Error processing callback for node 69e680f1dc041e577b77b87d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:39:46,414 - lava_callback - INFO - Received callback for node 69e680ebdc041e577b77b86f INFO: 172.20.0.1:37378 - "POST /node/69e680ebdc041e577b77b86f HTTP/1.0" 202 Accepted 2026-04-22 19:39:46,419 - lava_callback - INFO - Starting async job submit for node 69e680ebdc041e577b77b86f 2026-04-22 19:39:46,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:46,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ebdc041e577b77b86f HTTP/1.1" 200 None 2026-04-22 19:39:46,436 - lava_callback - DEBUG - Processing node 69e680ebdc041e577b77b86f: baseline-arm-baylibre 2026-04-22 19:39:46,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680ebdc041e577b77b86f 2026-04-22 19:39:46,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:46,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ebdc041e577b77b86f HTTP/1.1" 200 None 2026-04-22 19:39:46,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:46,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:39:46,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:39:46,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680ebdc041e577b77b86f HTTP/1.1" 200 None 2026-04-22 19:39:46,498 - lava_callback - ERROR - Error processing callback for node 69e680ebdc041e577b77b86f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46622 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:40:02,651 - lava_callback - INFO - Received callback for node 69e680fddc041e577b77b8a4 INFO: 172.20.0.1:60516 - "POST /node/69e680fddc041e577b77b8a4 HTTP/1.0" 202 Accepted 2026-04-22 19:40:02,657 - lava_callback - INFO - Starting async job submit for node 69e680fddc041e577b77b8a4 2026-04-22 19:40:02,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:02,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fddc041e577b77b8a4 HTTP/1.1" 200 None 2026-04-22 19:40:02,672 - lava_callback - DEBUG - Processing node 69e680fddc041e577b77b8a4: baseline-arm-clabbe 2026-04-22 19:40:02,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680fddc041e577b77b8a4 2026-04-22 19:40:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:02,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fddc041e577b77b8a4 HTTP/1.1" 200 None 2026-04-22 19:40:02,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:02,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:40:02,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:02,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680fddc041e577b77b8a4 HTTP/1.1" 200 None 2026-04-22 19:40:02,723 - lava_callback - ERROR - Error processing callback for node 69e680fddc041e577b77b8a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:40:03,362 - lava_callback - INFO - Received callback for node 69e680fedc041e577b77b8a7 INFO: 172.20.0.1:60530 - "POST /node/69e680fedc041e577b77b8a7 HTTP/1.0" 202 Accepted 2026-04-22 19:40:03,371 - lava_callback - INFO - Starting async job submit for node 69e680fedc041e577b77b8a7 2026-04-22 19:40:03,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:03,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fedc041e577b77b8a7 HTTP/1.1" 200 None 2026-04-22 19:40:03,387 - lava_callback - DEBUG - Processing node 69e680fedc041e577b77b8a7: baseline-arm-clabbe 2026-04-22 19:40:03,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680fedc041e577b77b8a7 2026-04-22 19:40:03,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:03,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680fedc041e577b77b8a7 HTTP/1.1" 200 None 2026-04-22 19:40:03,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:03,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:40:03,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:03,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680fedc041e577b77b8a7 HTTP/1.1" 200 None 2026-04-22 19:40:03,461 - lava_callback - ERROR - Error processing callback for node 69e680fedc041e577b77b8a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:40:04,109 - lava_callback - INFO - Received callback for node 69e680ffdc041e577b77b8aa INFO: 172.20.0.1:60534 - "POST /node/69e680ffdc041e577b77b8aa HTTP/1.0" 202 Accepted 2026-04-22 19:40:04,116 - lava_callback - INFO - Starting async job submit for node 69e680ffdc041e577b77b8aa 2026-04-22 19:40:04,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ffdc041e577b77b8aa HTTP/1.1" 200 None 2026-04-22 19:40:04,132 - lava_callback - DEBUG - Processing node 69e680ffdc041e577b77b8aa: baseline-arm-clabbe 2026-04-22 19:40:04,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680ffdc041e577b77b8aa 2026-04-22 19:40:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ffdc041e577b77b8aa HTTP/1.1" 200 None 2026-04-22 19:40:04,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:40:04,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680ffdc041e577b77b8aa HTTP/1.1" 200 None 2026-04-22 19:40:04,190 - lava_callback - ERROR - Error processing callback for node 69e680ffdc041e577b77b8aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:40:04,805 - lava_callback - INFO - Received callback for node 69e680ffdc041e577b77b8ad INFO: 172.20.0.1:60542 - "POST /node/69e680ffdc041e577b77b8ad HTTP/1.0" 202 Accepted 2026-04-22 19:40:04,810 - lava_callback - INFO - Starting async job submit for node 69e680ffdc041e577b77b8ad 2026-04-22 19:40:04,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ffdc041e577b77b8ad HTTP/1.1" 200 None 2026-04-22 19:40:04,829 - lava_callback - DEBUG - Processing node 69e680ffdc041e577b77b8ad: baseline-arm-clabbe 2026-04-22 19:40:04,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e680ffdc041e577b77b8ad 2026-04-22 19:40:04,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e680ffdc041e577b77b8ad HTTP/1.1" 200 None 2026-04-22 19:40:04,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:40:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:04,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e680ffdc041e577b77b8ad HTTP/1.1" 200 None 2026-04-22 19:40:04,874 - lava_callback - ERROR - Error processing callback for node 69e680ffdc041e577b77b8ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 19:40:05,521 - lava_callback - INFO - Received callback for node 69e68100dc041e577b77b8b0 INFO: 172.20.0.1:60554 - "POST /node/69e68100dc041e577b77b8b0 HTTP/1.0" 202 Accepted 2026-04-22 19:40:05,526 - lava_callback - INFO - Starting async job submit for node 69e68100dc041e577b77b8b0 2026-04-22 19:40:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:05,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68100dc041e577b77b8b0 HTTP/1.1" 200 None 2026-04-22 19:40:05,541 - lava_callback - DEBUG - Processing node 69e68100dc041e577b77b8b0: baseline-arm-clabbe 2026-04-22 19:40:05,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68100dc041e577b77b8b0 2026-04-22 19:40:05,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:05,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68100dc041e577b77b8b0 HTTP/1.1" 200 None 2026-04-22 19:40:05,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:05,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6520a47863bb428fe4ae6 HTTP/1.1" 200 None 2026-04-22 19:40:05,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:40:05,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68100dc041e577b77b8b0 HTTP/1.1" 200 None 2026-04-22 19:40:05,590 - lava_callback - ERROR - Error processing callback for node 69e68100dc041e577b77b8b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35468 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:41:22,745 - lava_callback - INFO - Received callback for node 69e68158dc041e577b77b917 INFO: 172.20.0.1:40408 - "POST /node/69e68158dc041e577b77b917 HTTP/1.0" 202 Accepted 2026-04-22 19:41:22,751 - lava_callback - INFO - Starting async job submit for node 69e68158dc041e577b77b917 2026-04-22 19:41:22,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:41:22,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68158dc041e577b77b917 HTTP/1.1" 200 None 2026-04-22 19:41:22,773 - lava_callback - DEBUG - Processing node 69e68158dc041e577b77b917: baseline-arm64-clabbe 2026-04-22 19:41:22,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68158dc041e577b77b917 2026-04-22 19:41:22,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:41:22,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68158dc041e577b77b917 HTTP/1.1" 200 None 2026-04-22 19:41:22,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:41:22,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:41:22,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:41:22,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68158dc041e577b77b917 HTTP/1.1" 200 None 2026-04-22 19:41:22,832 - lava_callback - ERROR - Error processing callback for node 69e68158dc041e577b77b917: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38758 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:42:36,834 - lava_callback - INFO - Received callback for node 69e7ac355a896156966950a9 INFO: 172.20.0.1:38768 - "POST /node/69e7ac355a896156966950a9 HTTP/1.0" 202 Accepted 2026-04-22 19:42:36,844 - lava_callback - INFO - Starting async job submit for node 69e7ac355a896156966950a9 2026-04-22 19:42:36,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:42:36,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7ac355a896156966950a9 HTTP/1.1" 200 None 2026-04-22 19:42:36,892 - lava_callback - DEBUG - Processing node 69e7ac355a896156966950a9: baseline-arm64-broonie 2026-04-22 19:42:37,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:42:37,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:42:37,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac355a896156966950a9/log.txt.gz 2026-04-22 19:42:37,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:42:37,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:42:37,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac355a896156966950a9/lava-logs.yaml 2026-04-22 19:42:37,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:42:37,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:42:37,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac355a896156966950a9/lava_callback.json.gz 2026-04-22 19:42:37,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:42:38,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7ac355a896156966950a9 HTTP/1.1" 200 None 2026-04-22 19:42:38,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:42:38,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 19:42:38,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:42:38,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7ac355a896156966950a9 HTTP/1.1" 200 None 2026-04-22 19:42:38,039 - lava_callback - INFO - Completed processing callback for node 69e7ac355a896156966950a9 INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54858 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:42:57,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:42:57,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38058 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:44:22,885 - lava_callback - INFO - Received callback for node 69e68207dc041e577b77b9c1 INFO: 172.20.0.1:43430 - "POST /node/69e68207dc041e577b77b9c1 HTTP/1.0" 202 Accepted 2026-04-22 19:44:22,894 - lava_callback - INFO - Starting async job submit for node 69e68207dc041e577b77b9c1 2026-04-22 19:44:22,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:22,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68207dc041e577b77b9c1 HTTP/1.1" 200 None 2026-04-22 19:44:22,914 - lava_callback - DEBUG - Processing node 69e68207dc041e577b77b9c1: baseline-arm64-clabbe 2026-04-22 19:44:22,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68207dc041e577b77b9c1 2026-04-22 19:44:22,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:22,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68207dc041e577b77b9c1 HTTP/1.1" 200 None 2026-04-22 19:44:22,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:22,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:44:22,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:22,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68207dc041e577b77b9c1 HTTP/1.1" 200 None 2026-04-22 19:44:22,968 - lava_callback - ERROR - Error processing callback for node 69e68207dc041e577b77b9c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36538 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:44:36,755 - lava_callback - INFO - Received callback for node 69e809365a896156966970b1 INFO: 172.20.0.1:36544 - "POST /node/69e809365a896156966970b1 HTTP/1.0" 202 Accepted 2026-04-22 19:44:36,761 - lava_callback - INFO - Starting async job submit for node 69e809365a896156966970b1 2026-04-22 19:44:36,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:36,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e809365a896156966970b1 HTTP/1.1" 200 None 2026-04-22 19:44:36,809 - lava_callback - DEBUG - Processing node 69e809365a896156966970b1: baseline-arm64-broonie 2026-04-22 19:44:37,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:44:37,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:44:37,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e809365a896156966970b1/log.txt.gz 2026-04-22 19:44:37,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:44:37,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:44:37,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e809365a896156966970b1/lava-logs.yaml 2026-04-22 19:44:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:44:37,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:44:37,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e809365a896156966970b1/lava_callback.json.gz 2026-04-22 19:44:37,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:37,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e809365a896156966970b1 HTTP/1.1" 200 None 2026-04-22 19:44:37,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:37,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 19:44:37,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:37,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e809365a896156966970b1 HTTP/1.1" 200 None 2026-04-22 19:44:37,879 - lava_callback - INFO - Completed processing callback for node 69e809365a896156966970b1 INFO: 172.20.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40520 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:44:57,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:44:57,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:46:37,086 - lava_callback - INFO - Received callback for node 69e81dafafb86e738cad034b INFO: 172.20.0.1:60814 - "POST /node/69e81dafafb86e738cad034b HTTP/1.0" 202 Accepted 2026-04-22 19:46:37,092 - lava_callback - INFO - Starting async job submit for node 69e81dafafb86e738cad034b 2026-04-22 19:46:37,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:46:37,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dafafb86e738cad034b HTTP/1.1" 200 None 2026-04-22 19:46:37,130 - lava_callback - DEBUG - Processing node 69e81dafafb86e738cad034b: baseline-arm64-broonie 2026-04-22 19:46:37,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:46:37,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:46:37,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81dafafb86e738cad034b/log.txt.gz 2026-04-22 19:46:37,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:46:37,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:46:37,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81dafafb86e738cad034b/lava-logs.yaml 2026-04-22 19:46:37,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:46:38,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:46:38,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81dafafb86e738cad034b/lava_callback.json.gz 2026-04-22 19:46:38,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:46:38,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dafafb86e738cad034b HTTP/1.1" 200 None 2026-04-22 19:46:38,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:46:38,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 19:46:38,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:46:38,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dafafb86e738cad034b HTTP/1.1" 200 None 2026-04-22 19:46:38,143 - lava_callback - INFO - Completed processing callback for node 69e81dafafb86e738cad034b INFO: 172.20.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:46:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:46:57,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47028 - "GET /node/698374f266dc8a56088a4cb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:48:36,922 - lava_callback - INFO - Received callback for node 69e86051afb86e738cad1baa INFO: 172.20.0.1:42642 - "POST /node/69e86051afb86e738cad1baa HTTP/1.0" 202 Accepted 2026-04-22 19:48:36,928 - lava_callback - INFO - Starting async job submit for node 69e86051afb86e738cad1baa 2026-04-22 19:48:36,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:48:36,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e86051afb86e738cad1baa HTTP/1.1" 200 None 2026-04-22 19:48:36,979 - lava_callback - DEBUG - Processing node 69e86051afb86e738cad1baa: baseline-arm64-broonie 2026-04-22 19:48:37,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:48:37,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:48:37,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e86051afb86e738cad1baa/log.txt.gz 2026-04-22 19:48:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:48:37,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:48:37,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e86051afb86e738cad1baa/lava-logs.yaml 2026-04-22 19:48:37,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:48:38,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:48:38,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e86051afb86e738cad1baa/lava_callback.json.gz 2026-04-22 19:48:38,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:48:38,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e86051afb86e738cad1baa HTTP/1.1" 200 None 2026-04-22 19:48:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:48:38,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 19:48:38,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:48:38,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e86051afb86e738cad1baa HTTP/1.1" 200 None 2026-04-22 19:48:38,097 - lava_callback - INFO - Completed processing callback for node 69e86051afb86e738cad1baa INFO: 172.20.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:48:57,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:48:57,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET /node/69919ef310b45da7d7d124e7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55482 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:50:03,123 - lava_callback - INFO - Received callback for node 69e6835edc041e577b77ba32 INFO: 172.20.0.1:58684 - "POST /node/69e6835edc041e577b77ba32 HTTP/1.0" 202 Accepted 2026-04-22 19:50:03,132 - lava_callback - INFO - Starting async job submit for node 69e6835edc041e577b77ba32 2026-04-22 19:50:03,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:03,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6835edc041e577b77ba32 HTTP/1.1" 200 None 2026-04-22 19:50:03,152 - lava_callback - DEBUG - Processing node 69e6835edc041e577b77ba32: baseline-arm64-clabbe 2026-04-22 19:50:03,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6835edc041e577b77ba32 2026-04-22 19:50:03,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:03,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6835edc041e577b77ba32 HTTP/1.1" 200 None 2026-04-22 19:50:03,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:03,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:50:03,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:03,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6835edc041e577b77ba32 HTTP/1.1" 200 None 2026-04-22 19:50:03,202 - lava_callback - ERROR - Error processing callback for node 69e6835edc041e577b77ba32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:50:36,959 - lava_callback - INFO - Received callback for node 69e87500afb86e738cad2269 INFO: 172.20.0.1:35654 - "POST /node/69e87500afb86e738cad2269 HTTP/1.0" 202 Accepted 2026-04-22 19:50:36,969 - lava_callback - INFO - Starting async job submit for node 69e87500afb86e738cad2269 2026-04-22 19:50:36,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:37,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e87500afb86e738cad2269 HTTP/1.1" 200 None 2026-04-22 19:50:37,009 - lava_callback - DEBUG - Processing node 69e87500afb86e738cad2269: baseline-arm64-broonie 2026-04-22 19:50:37,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:50:37,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:50:37,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87500afb86e738cad2269/log.txt.gz 2026-04-22 19:50:37,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:50:38,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:50:38,454 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87500afb86e738cad2269/lava-logs.yaml 2026-04-22 19:50:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:50:38,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:50:38,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87500afb86e738cad2269/lava_callback.json.gz 2026-04-22 19:50:38,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:38,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e87500afb86e738cad2269 HTTP/1.1" 200 None 2026-04-22 19:50:38,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:38,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 19:50:38,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:38,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e87500afb86e738cad2269 HTTP/1.1" 200 None 2026-04-22 19:50:38,706 - lava_callback - INFO - Completed processing callback for node 69e87500afb86e738cad2269 INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37752 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:50:57,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:50:57,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:52:37,075 - lava_callback - INFO - Received callback for node 69e8a764b1b1e6995a88d597 INFO: 172.20.0.1:58626 - "POST /node/69e8a764b1b1e6995a88d597 HTTP/1.0" 202 Accepted 2026-04-22 19:52:37,082 - lava_callback - INFO - Starting async job submit for node 69e8a764b1b1e6995a88d597 2026-04-22 19:52:37,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:52:37,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8a764b1b1e6995a88d597 HTTP/1.1" 200 None 2026-04-22 19:52:37,129 - lava_callback - DEBUG - Processing node 69e8a764b1b1e6995a88d597: baseline-arm64-broonie 2026-04-22 19:52:37,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:52:37,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:52:37,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8a764b1b1e6995a88d597/log.txt.gz 2026-04-22 19:52:37,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:52:38,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:52:38,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8a764b1b1e6995a88d597/lava-logs.yaml 2026-04-22 19:52:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 19:52:38,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 19:52:38,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8a764b1b1e6995a88d597/lava_callback.json.gz 2026-04-22 19:52:38,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:52:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8a764b1b1e6995a88d597 HTTP/1.1" 200 None 2026-04-22 19:52:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:52:38,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88436b1b1e6995a88c3b9 HTTP/1.1" 200 None 2026-04-22 19:52:38,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:52:38,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8a764b1b1e6995a88d597 HTTP/1.1" 200 None 2026-04-22 19:52:38,242 - lava_callback - INFO - Completed processing callback for node 69e8a764b1b1e6995a88d597 INFO: 172.20.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:52:57,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:52:57,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK 2026-04-22 19:53:03,218 - lava_callback - INFO - Received callback for node 69e68409dc041e577b77ba52 INFO: 172.20.0.1:36874 - "POST /node/69e68409dc041e577b77ba52 HTTP/1.0" 202 Accepted 2026-04-22 19:53:03,223 - lava_callback - INFO - Starting async job submit for node 69e68409dc041e577b77ba52 2026-04-22 19:53:03,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:53:03,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68409dc041e577b77ba52 HTTP/1.1" 200 None 2026-04-22 19:53:03,242 - lava_callback - DEBUG - Processing node 69e68409dc041e577b77ba52: baseline-arm64-clabbe 2026-04-22 19:53:03,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68409dc041e577b77ba52 2026-04-22 19:53:03,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:53:03,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68409dc041e577b77ba52 HTTP/1.1" 200 None 2026-04-22 19:53:03,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:53:03,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-22 19:53:03,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 19:53:03,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68409dc041e577b77ba52 HTTP/1.1" 200 None 2026-04-22 19:53:03,306 - lava_callback - ERROR - Error processing callback for node 69e68409dc041e577b77ba52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47698 - "GET /node/6986ffe06e077e4126a7e130%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54494 - "GET /node/694c1dd32f7ca341fdeb26d3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43972 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:17:38,912 - lava_callback - INFO - Received callback for node 69e8b6ebb1b1e6995a88df88 INFO: 172.20.0.1:43976 - "POST /node/69e8b6ebb1b1e6995a88df88 HTTP/1.0" 202 Accepted 2026-04-22 20:17:38,919 - lava_callback - INFO - Starting async job submit for node 69e8b6ebb1b1e6995a88df88 2026-04-22 20:17:38,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:17:38,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8b6ebb1b1e6995a88df88 HTTP/1.1" 200 None 2026-04-22 20:17:38,958 - lava_callback - DEBUG - Processing node 69e8b6ebb1b1e6995a88df88: baseline-arm64-broonie 2026-04-22 20:17:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:17:39,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:17:39,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8b6ebb1b1e6995a88df88/log.txt.gz 2026-04-22 20:17:39,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:17:39,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:17:39,696 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8b6ebb1b1e6995a88df88/lava-logs.yaml 2026-04-22 20:17:39,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:17:39,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:17:39,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8b6ebb1b1e6995a88df88/lava_callback.json.gz 2026-04-22 20:17:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:17:39,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8b6ebb1b1e6995a88df88 HTTP/1.1" 200 None 2026-04-22 20:17:39,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:17:39,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 20:17:39,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:17:39,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8b6ebb1b1e6995a88df88 HTTP/1.1" 200 None 2026-04-22 20:17:39,882 - lava_callback - INFO - Completed processing callback for node 69e8b6ebb1b1e6995a88df88 INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:17:57,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:17:57,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:18:31,501 - lava_callback - INFO - Received callback for node 69e928568327522856db08ef INFO: 172.20.0.1:45274 - "POST /node/69e928568327522856db08ef HTTP/1.0" 202 Accepted 2026-04-22 20:18:31,510 - lava_callback - INFO - Starting async job submit for node 69e928568327522856db08ef 2026-04-22 20:18:31,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:18:31,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e928568327522856db08ef HTTP/1.1" 200 None 2026-04-22 20:18:31,588 - lava_callback - DEBUG - Processing node 69e928568327522856db08ef: baseline-nfs-arm64 2026-04-22 20:18:32,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:18:33,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:18:33,022 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e928568327522856db08ef/log.txt.gz 2026-04-22 20:18:33,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:18:33,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:18:33,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e928568327522856db08ef/lava-logs.yaml 2026-04-22 20:18:33,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:18:34,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:18:34,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e928568327522856db08ef/lava_callback.json.gz DEBUG: Setup failed for 69e928568327522856db08ef. Transitting job node result: incomplete -> fail 2026-04-22 20:18:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:18:34,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e928568327522856db08ef HTTP/1.1" 200 None 2026-04-22 20:18:34,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:18:34,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 20:18:34,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:18:34,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e928568327522856db08ef HTTP/1.1" 200 None 2026-04-22 20:18:34,332 - lava_callback - INFO - Completed processing callback for node 69e928568327522856db08ef INFO: 172.20.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:18:57,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:18:57,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:31:27,836 - lava_callback - INFO - Received callback for node 69e68d0fdc041e577b77bdef INFO: 172.20.0.1:56964 - "POST /node/69e68d0fdc041e577b77bdef HTTP/1.0" 202 Accepted 2026-04-22 20:31:27,841 - lava_callback - INFO - Starting async job submit for node 69e68d0fdc041e577b77bdef 2026-04-22 20:31:27,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:31:27,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68d0fdc041e577b77bdef HTTP/1.1" 200 None 2026-04-22 20:31:27,856 - lava_callback - DEBUG - Processing node 69e68d0fdc041e577b77bdef: baseline-arm64-baylibre 2026-04-22 20:31:27,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68d0fdc041e577b77bdef 2026-04-22 20:31:27,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:31:27,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68d0fdc041e577b77bdef HTTP/1.1" 200 None 2026-04-22 20:31:27,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:31:27,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:31:27,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:31:27,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68d0fdc041e577b77bdef HTTP/1.1" 200 None 2026-04-22 20:31:27,908 - lava_callback - ERROR - Error processing callback for node 69e68d0fdc041e577b77bdef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:33:27,884 - lava_callback - INFO - Received callback for node 69e68d8bdc041e577b77be29 INFO: 172.20.0.1:51844 - "POST /node/69e68d8bdc041e577b77be29 HTTP/1.0" 202 Accepted 2026-04-22 20:33:27,890 - lava_callback - INFO - Starting async job submit for node 69e68d8bdc041e577b77be29 2026-04-22 20:33:27,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:33:27,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68d8bdc041e577b77be29 HTTP/1.1" 200 None 2026-04-22 20:33:27,905 - lava_callback - DEBUG - Processing node 69e68d8bdc041e577b77be29: baseline-arm64-baylibre 2026-04-22 20:33:27,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68d8bdc041e577b77be29 2026-04-22 20:33:27,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:33:27,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68d8bdc041e577b77be29 HTTP/1.1" 200 None 2026-04-22 20:33:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:33:27,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:33:27,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:33:27,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68d8bdc041e577b77be29 HTTP/1.1" 200 None 2026-04-22 20:33:27,955 - lava_callback - ERROR - Error processing callback for node 69e68d8bdc041e577b77be29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:34:18,878 - lava_callback - INFO - Received callback for node 69e8c9a1b1b1e6995a88e51c INFO: 172.20.0.1:41344 - "POST /node/69e8c9a1b1b1e6995a88e51c HTTP/1.0" 202 Accepted 2026-04-22 20:34:18,885 - lava_callback - INFO - Starting async job submit for node 69e8c9a1b1b1e6995a88e51c 2026-04-22 20:34:18,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:34:18,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8c9a1b1b1e6995a88e51c HTTP/1.1" 200 None 2026-04-22 20:34:18,951 - lava_callback - DEBUG - Processing node 69e8c9a1b1b1e6995a88e51c: baseline-arm64-broonie 2026-04-22 20:34:19,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:34:19,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:34:19,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8c9a1b1b1e6995a88e51c/log.txt.gz 2026-04-22 20:34:19,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:34:20,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:34:20,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8c9a1b1b1e6995a88e51c/lava-logs.yaml 2026-04-22 20:34:20,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:34:20,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:34:20,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8c9a1b1b1e6995a88e51c/lava_callback.json.gz DEBUG: 69e8c9a1b1b1e6995a88e51c Transitting job node result: pass -> incomplete 2026-04-22 20:34:20,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:34:20,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8c9a1b1b1e6995a88e51c HTTP/1.1" 200 None 2026-04-22 20:34:20,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:34:20,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 20:34:20,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:34:20,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8c9a1b1b1e6995a88e51c HTTP/1.1" 200 None 2026-04-22 20:34:20,425 - lava_callback - INFO - Completed processing callback for node 69e8c9a1b1b1e6995a88e51c INFO: 172.20.0.1:34536 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:34:27,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:34:27,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40598 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:36:18,911 - lava_callback - INFO - Received callback for node 69e900db8327522856daef39 INFO: 172.20.0.1:40614 - "POST /node/69e900db8327522856daef39 HTTP/1.0" 202 Accepted 2026-04-22 20:36:18,917 - lava_callback - INFO - Starting async job submit for node 69e900db8327522856daef39 2026-04-22 20:36:18,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:36:18,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e900db8327522856daef39 HTTP/1.1" 200 None 2026-04-22 20:36:18,954 - lava_callback - DEBUG - Processing node 69e900db8327522856daef39: baseline-arm64-broonie 2026-04-22 20:36:19,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:36:19,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:36:19,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e900db8327522856daef39/log.txt.gz 2026-04-22 20:36:19,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:36:19,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:36:19,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e900db8327522856daef39/lava-logs.yaml 2026-04-22 20:36:19,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:36:19,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:36:19,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e900db8327522856daef39/lava_callback.json.gz 2026-04-22 20:36:19,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:36:19,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e900db8327522856daef39 HTTP/1.1" 200 None 2026-04-22 20:36:19,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:36:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e88436b1b1e6995a88c3b9 HTTP/1.1" 200 None 2026-04-22 20:36:19,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:36:19,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e900db8327522856daef39 HTTP/1.1" 200 None 2026-04-22 20:36:19,945 - lava_callback - INFO - Completed processing callback for node 69e900db8327522856daef39 INFO: 172.20.0.1:35788 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:36:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:36:27,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33912 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:37:28,074 - lava_callback - INFO - Received callback for node 69e68e85dc041e577b77be93 INFO: 172.20.0.1:33920 - "POST /node/69e68e85dc041e577b77be93 HTTP/1.0" 202 Accepted 2026-04-22 20:37:28,080 - lava_callback - INFO - Starting async job submit for node 69e68e85dc041e577b77be93 2026-04-22 20:37:28,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:37:28,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68e85dc041e577b77be93 HTTP/1.1" 200 None 2026-04-22 20:37:28,095 - lava_callback - DEBUG - Processing node 69e68e85dc041e577b77be93: baseline-arm64-baylibre 2026-04-22 20:37:28,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68e85dc041e577b77be93 2026-04-22 20:37:28,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:37:28,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68e85dc041e577b77be93 HTTP/1.1" 200 None 2026-04-22 20:37:28,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:37:28,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:37:28,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:37:28,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68e85dc041e577b77be93 HTTP/1.1" 200 None 2026-04-22 20:37:28,141 - lava_callback - ERROR - Error processing callback for node 69e68e85dc041e577b77be93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:38:19,683 - lava_callback - INFO - Received callback for node 69e904c08327522856daf23f INFO: 172.20.0.1:54812 - "POST /node/69e904c08327522856daf23f HTTP/1.0" 202 Accepted 2026-04-22 20:38:19,689 - lava_callback - INFO - Starting async job submit for node 69e904c08327522856daf23f 2026-04-22 20:38:19,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:38:19,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c08327522856daf23f HTTP/1.1" 200 None 2026-04-22 20:38:19,733 - lava_callback - DEBUG - Processing node 69e904c08327522856daf23f: baseline-arm64-broonie 2026-04-22 20:38:20,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:38:20,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:38:20,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c08327522856daf23f/log.txt.gz 2026-04-22 20:38:20,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:38:20,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:38:20,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c08327522856daf23f/lava-logs.yaml 2026-04-22 20:38:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:38:20,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:38:20,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e904c08327522856daf23f/lava_callback.json.gz 2026-04-22 20:38:20,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:38:20,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e904c08327522856daf23f HTTP/1.1" 200 None 2026-04-22 20:38:20,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:38:20,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8f4d58327522856dac25b HTTP/1.1" 200 None 2026-04-22 20:38:20,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:38:20,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e904c08327522856daf23f HTTP/1.1" 200 None 2026-04-22 20:38:20,947 - lava_callback - INFO - Completed processing callback for node 69e904c08327522856daf23f INFO: 172.20.0.1:45026 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:38:27,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:38:27,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:40:19,501 - lava_callback - INFO - Received callback for node 69e926158327522856db0767 INFO: 172.20.0.1:52040 - "POST /node/69e926158327522856db0767 HTTP/1.0" 202 Accepted 2026-04-22 20:40:19,510 - lava_callback - INFO - Starting async job submit for node 69e926158327522856db0767 2026-04-22 20:40:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:19,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e926158327522856db0767 HTTP/1.1" 200 None 2026-04-22 20:40:19,556 - lava_callback - DEBUG - Processing node 69e926158327522856db0767: baseline-arm64-broonie 2026-04-22 20:40:19,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:40:19,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:40:19,992 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e926158327522856db0767/log.txt.gz 2026-04-22 20:40:20,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:40:20,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:40:20,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e926158327522856db0767/lava-logs.yaml 2026-04-22 20:40:20,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:40:20,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:40:20,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e926158327522856db0767/lava_callback.json.gz 2026-04-22 20:40:20,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:20,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e926158327522856db0767 HTTP/1.1" 200 None 2026-04-22 20:40:20,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:20,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 20:40:20,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:20,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e926158327522856db0767 HTTP/1.1" 200 None 2026-04-22 20:40:20,531 - lava_callback - INFO - Completed processing callback for node 69e926158327522856db0767 INFO: 172.20.0.1:40426 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:40:27,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:27,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 20:40:28,240 - lava_callback - INFO - Received callback for node 69e68f30dc041e577b77bed6 INFO: 172.20.0.1:40428 - "POST /node/69e68f30dc041e577b77bed6 HTTP/1.0" 202 Accepted 2026-04-22 20:40:28,249 - lava_callback - INFO - Starting async job submit for node 69e68f30dc041e577b77bed6 2026-04-22 20:40:28,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:28,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68f30dc041e577b77bed6 HTTP/1.1" 200 None 2026-04-22 20:40:28,264 - lava_callback - DEBUG - Processing node 69e68f30dc041e577b77bed6: baseline-arm64-baylibre 2026-04-22 20:40:28,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68f30dc041e577b77bed6 2026-04-22 20:40:28,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:28,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68f30dc041e577b77bed6 HTTP/1.1" 200 None 2026-04-22 20:40:28,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:40:28,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:40:28,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68f30dc041e577b77bed6 HTTP/1.1" 200 None 2026-04-22 20:40:28,325 - lava_callback - ERROR - Error processing callback for node 69e68f30dc041e577b77bed6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45800 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:41:48,330 - lava_callback - INFO - Received callback for node 69e68f85dc041e577b77beff INFO: 172.20.0.1:45816 - "POST /node/69e68f85dc041e577b77beff HTTP/1.0" 202 Accepted 2026-04-22 20:41:48,336 - lava_callback - INFO - Starting async job submit for node 69e68f85dc041e577b77beff 2026-04-22 20:41:48,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:41:48,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68f85dc041e577b77beff HTTP/1.1" 200 None 2026-04-22 20:41:48,356 - lava_callback - DEBUG - Processing node 69e68f85dc041e577b77beff: baseline-arm64-baylibre 2026-04-22 20:41:48,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68f85dc041e577b77beff 2026-04-22 20:41:48,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:41:48,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68f85dc041e577b77beff HTTP/1.1" 200 None 2026-04-22 20:41:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:41:48,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:41:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:41:48,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68f85dc041e577b77beff HTTP/1.1" 200 None 2026-04-22 20:41:48,430 - lava_callback - ERROR - Error processing callback for node 69e68f85dc041e577b77beff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34328 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:42:19,617 - lava_callback - INFO - Received callback for node 69e930e08327522856db0a0d INFO: 172.20.0.1:34342 - "POST /node/69e930e08327522856db0a0d HTTP/1.0" 202 Accepted 2026-04-22 20:42:19,623 - lava_callback - INFO - Starting async job submit for node 69e930e08327522856db0a0d 2026-04-22 20:42:19,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:42:19,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e930e08327522856db0a0d HTTP/1.1" 200 None 2026-04-22 20:42:19,670 - lava_callback - DEBUG - Processing node 69e930e08327522856db0a0d: baseline-arm64-broonie 2026-04-22 20:42:19,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:42:20,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:42:20,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e930e08327522856db0a0d/log.txt.gz 2026-04-22 20:42:20,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:42:20,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:42:20,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e930e08327522856db0a0d/lava-logs.yaml 2026-04-22 20:42:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 20:42:20,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 20:42:20,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e930e08327522856db0a0d/lava_callback.json.gz 2026-04-22 20:42:20,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:42:20,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e930e08327522856db0a0d HTTP/1.1" 200 None 2026-04-22 20:42:20,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:42:20,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 20:42:20,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:42:20,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e930e08327522856db0a0d HTTP/1.1" 200 None 2026-04-22 20:42:20,755 - lava_callback - INFO - Completed processing callback for node 69e930e08327522856db0a0d INFO: 172.20.0.1:46876 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:42:27,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:42:27,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:43:08,641 - lava_callback - INFO - Received callback for node 69e68fd8dc041e577b77bf33 INFO: 172.20.0.1:51494 - "POST /node/69e68fd8dc041e577b77bf33 HTTP/1.0" 202 Accepted 2026-04-22 20:43:08,650 - lava_callback - INFO - Starting async job submit for node 69e68fd8dc041e577b77bf33 2026-04-22 20:43:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:43:08,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68fd8dc041e577b77bf33 HTTP/1.1" 200 None 2026-04-22 20:43:08,672 - lava_callback - DEBUG - Processing node 69e68fd8dc041e577b77bf33: baseline-arm64-baylibre 2026-04-22 20:43:08,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e68fd8dc041e577b77bf33 2026-04-22 20:43:08,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:43:08,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e68fd8dc041e577b77bf33 HTTP/1.1" 200 None 2026-04-22 20:43:08,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:43:08,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:43:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:43:08,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e68fd8dc041e577b77bf33 HTTP/1.1" 200 None 2026-04-22 20:43:08,725 - lava_callback - ERROR - Error processing callback for node 69e68fd8dc041e577b77bf33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:46:05,518 - lava_callback - INFO - Received callback for node 69e69088dc041e577b77bf8f INFO: 172.20.0.1:56202 - "POST /node/69e69088dc041e577b77bf8f HTTP/1.0" 202 Accepted 2026-04-22 20:46:05,523 - lava_callback - INFO - Starting async job submit for node 69e69088dc041e577b77bf8f 2026-04-22 20:46:05,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:46:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69088dc041e577b77bf8f HTTP/1.1" 200 None 2026-04-22 20:46:05,537 - lava_callback - DEBUG - Processing node 69e69088dc041e577b77bf8f: baseline-arm64-clabbe 2026-04-22 20:46:05,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69088dc041e577b77bf8f 2026-04-22 20:46:05,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:46:05,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69088dc041e577b77bf8f HTTP/1.1" 200 None 2026-04-22 20:46:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:46:05,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:46:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:46:05,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69088dc041e577b77bf8f HTTP/1.1" 200 None 2026-04-22 20:46:05,582 - lava_callback - ERROR - Error processing callback for node 69e69088dc041e577b77bf8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40662 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:49:45,652 - lava_callback - INFO - Received callback for node 69e6915bdc041e577b77bff3 INFO: 172.20.0.1:43334 - "POST /node/69e6915bdc041e577b77bff3 HTTP/1.0" 202 Accepted 2026-04-22 20:49:45,658 - lava_callback - INFO - Starting async job submit for node 69e6915bdc041e577b77bff3 2026-04-22 20:49:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:49:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6915bdc041e577b77bff3 HTTP/1.1" 200 None 2026-04-22 20:49:45,673 - lava_callback - DEBUG - Processing node 69e6915bdc041e577b77bff3: baseline-arm64-clabbe 2026-04-22 20:49:45,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6915bdc041e577b77bff3 2026-04-22 20:49:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:49:45,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6915bdc041e577b77bff3 HTTP/1.1" 200 None 2026-04-22 20:49:45,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:49:45,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:49:45,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:49:45,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6915bdc041e577b77bff3 HTTP/1.1" 200 None 2026-04-22 20:49:45,720 - lava_callback - ERROR - Error processing callback for node 69e6915bdc041e577b77bff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET /node/69861720177ca0f097bd09ab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54688 - "GET /node/69401e1e575bc060ce152d59%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-22 20:52:25,816 - lava_callback - INFO - Received callback for node 69e69202dc041e577b77c03e INFO: 172.20.0.1:54696 - "POST /node/69e69202dc041e577b77c03e HTTP/1.0" 202 Accepted 2026-04-22 20:52:25,822 - lava_callback - INFO - Starting async job submit for node 69e69202dc041e577b77c03e 2026-04-22 20:52:25,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:52:25,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69202dc041e577b77c03e HTTP/1.1" 200 None 2026-04-22 20:52:25,838 - lava_callback - DEBUG - Processing node 69e69202dc041e577b77c03e: baseline-arm64-clabbe 2026-04-22 20:52:25,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69202dc041e577b77c03e 2026-04-22 20:52:25,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:52:25,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69202dc041e577b77c03e HTTP/1.1" 200 None 2026-04-22 20:52:25,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:52:25,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:52:25,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:52:25,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69202dc041e577b77c03e HTTP/1.1" 200 None 2026-04-22 20:52:25,893 - lava_callback - ERROR - Error processing callback for node 69e69202dc041e577b77c03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:53:28,937 - lava_callback - INFO - Received callback for node 69e69234dc041e577b77c0d9 INFO: 172.20.0.1:59614 - "POST /node/69e69234dc041e577b77c0d9 HTTP/1.0" 202 Accepted 2026-04-22 20:53:28,942 - lava_callback - INFO - Starting async job submit for node 69e69234dc041e577b77c0d9 2026-04-22 20:53:28,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:28,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69234dc041e577b77c0d9 HTTP/1.1" 200 None 2026-04-22 20:53:28,957 - lava_callback - DEBUG - Processing node 69e69234dc041e577b77c0d9: baseline-arm64-baylibre 2026-04-22 20:53:28,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69234dc041e577b77c0d9 2026-04-22 20:53:28,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:28,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69234dc041e577b77c0d9 HTTP/1.1" 200 None 2026-04-22 20:53:28,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:28,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:28,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:29,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69234dc041e577b77c0d9 HTTP/1.1" 200 None 2026-04-22 20:53:29,025 - lava_callback - ERROR - Error processing callback for node 69e69234dc041e577b77c0d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:29,580 - lava_callback - INFO - Received callback for node 69e69235dc041e577b77c0dc INFO: 172.20.0.1:59622 - "POST /node/69e69235dc041e577b77c0dc HTTP/1.0" 202 Accepted 2026-04-22 20:53:29,586 - lava_callback - INFO - Starting async job submit for node 69e69235dc041e577b77c0dc 2026-04-22 20:53:29,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:29,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69235dc041e577b77c0dc HTTP/1.1" 200 None 2026-04-22 20:53:29,601 - lava_callback - DEBUG - Processing node 69e69235dc041e577b77c0dc: baseline-arm64-baylibre 2026-04-22 20:53:29,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69235dc041e577b77c0dc 2026-04-22 20:53:29,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:29,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69235dc041e577b77c0dc HTTP/1.1" 200 None 2026-04-22 20:53:29,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:29,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:29,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69235dc041e577b77c0dc HTTP/1.1" 200 None 2026-04-22 20:53:29,655 - lava_callback - ERROR - Error processing callback for node 69e69235dc041e577b77c0dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:30,291 - lava_callback - INFO - Received callback for node 69e69237dc041e577b77c0df INFO: 172.20.0.1:51546 - "POST /node/69e69237dc041e577b77c0df HTTP/1.0" 202 Accepted 2026-04-22 20:53:30,297 - lava_callback - INFO - Starting async job submit for node 69e69237dc041e577b77c0df 2026-04-22 20:53:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:30,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69237dc041e577b77c0df HTTP/1.1" 200 None 2026-04-22 20:53:30,313 - lava_callback - DEBUG - Processing node 69e69237dc041e577b77c0df: baseline-arm64-baylibre 2026-04-22 20:53:30,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69237dc041e577b77c0df 2026-04-22 20:53:30,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:30,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69237dc041e577b77c0df HTTP/1.1" 200 None 2026-04-22 20:53:30,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:30,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:30,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:30,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69237dc041e577b77c0df HTTP/1.1" 200 None 2026-04-22 20:53:30,358 - lava_callback - ERROR - Error processing callback for node 69e69237dc041e577b77c0df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:30,990 - lava_callback - INFO - Received callback for node 69e69239dc041e577b77c0e8 INFO: 172.20.0.1:51554 - "POST /node/69e69239dc041e577b77c0e8 HTTP/1.0" 202 Accepted 2026-04-22 20:53:30,996 - lava_callback - INFO - Starting async job submit for node 69e69239dc041e577b77c0e8 2026-04-22 20:53:30,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69239dc041e577b77c0e8 HTTP/1.1" 200 None 2026-04-22 20:53:31,011 - lava_callback - DEBUG - Processing node 69e69239dc041e577b77c0e8: baseline-arm64-baylibre 2026-04-22 20:53:31,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69239dc041e577b77c0e8 2026-04-22 20:53:31,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69239dc041e577b77c0e8 HTTP/1.1" 200 None 2026-04-22 20:53:31,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:31,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69239dc041e577b77c0e8 HTTP/1.1" 200 None 2026-04-22 20:53:31,067 - lava_callback - ERROR - Error processing callback for node 69e69239dc041e577b77c0e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:31,662 - lava_callback - INFO - Received callback for node 69e6923adc041e577b77c0eb INFO: 172.20.0.1:51570 - "POST /node/69e6923adc041e577b77c0eb HTTP/1.0" 202 Accepted 2026-04-22 20:53:31,668 - lava_callback - INFO - Starting async job submit for node 69e6923adc041e577b77c0eb 2026-04-22 20:53:31,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6923adc041e577b77c0eb HTTP/1.1" 200 None 2026-04-22 20:53:31,683 - lava_callback - DEBUG - Processing node 69e6923adc041e577b77c0eb: baseline-arm64-baylibre 2026-04-22 20:53:31,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6923adc041e577b77c0eb 2026-04-22 20:53:31,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6923adc041e577b77c0eb HTTP/1.1" 200 None 2026-04-22 20:53:31,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:31,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:31,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6923adc041e577b77c0eb HTTP/1.1" 200 None 2026-04-22 20:53:31,729 - lava_callback - ERROR - Error processing callback for node 69e6923adc041e577b77c0eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:32,307 - lava_callback - INFO - Received callback for node 69e6923cdc041e577b77c0ee INFO: 172.20.0.1:51578 - "POST /node/69e6923cdc041e577b77c0ee HTTP/1.0" 202 Accepted 2026-04-22 20:53:32,312 - lava_callback - INFO - Starting async job submit for node 69e6923cdc041e577b77c0ee 2026-04-22 20:53:32,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:32,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6923cdc041e577b77c0ee HTTP/1.1" 200 None 2026-04-22 20:53:32,333 - lava_callback - DEBUG - Processing node 69e6923cdc041e577b77c0ee: baseline-arm64-baylibre 2026-04-22 20:53:32,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6923cdc041e577b77c0ee 2026-04-22 20:53:32,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:32,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6923cdc041e577b77c0ee HTTP/1.1" 200 None 2026-04-22 20:53:32,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:32,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:32,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:32,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6923cdc041e577b77c0ee HTTP/1.1" 200 None 2026-04-22 20:53:32,376 - lava_callback - ERROR - Error processing callback for node 69e6923cdc041e577b77c0ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:53:45,848 - lava_callback - INFO - Received callback for node 69e6924edc041e577b77c132 INFO: 172.20.0.1:57884 - "POST /node/69e6924edc041e577b77c132 HTTP/1.0" 202 Accepted 2026-04-22 20:53:45,854 - lava_callback - INFO - Starting async job submit for node 69e6924edc041e577b77c132 2026-04-22 20:53:45,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:45,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6924edc041e577b77c132 HTTP/1.1" 200 None 2026-04-22 20:53:45,870 - lava_callback - DEBUG - Processing node 69e6924edc041e577b77c132: baseline-arm64-clabbe 2026-04-22 20:53:45,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6924edc041e577b77c132 2026-04-22 20:53:45,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:45,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6924edc041e577b77c132 HTTP/1.1" 200 None 2026-04-22 20:53:45,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:45,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:45,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6924edc041e577b77c132 HTTP/1.1" 200 None 2026-04-22 20:53:45,928 - lava_callback - ERROR - Error processing callback for node 69e6924edc041e577b77c132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:53:46,513 - lava_callback - INFO - Received callback for node 69e69251dc041e577b77c137 INFO: 172.20.0.1:57900 - "POST /node/69e69251dc041e577b77c137 HTTP/1.0" 202 Accepted 2026-04-22 20:53:46,527 - lava_callback - INFO - Starting async job submit for node 69e69251dc041e577b77c137 2026-04-22 20:53:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:46,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69251dc041e577b77c137 HTTP/1.1" 200 None 2026-04-22 20:53:46,573 - lava_callback - DEBUG - Processing node 69e69251dc041e577b77c137: baseline-arm64-clabbe 2026-04-22 20:53:46,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69251dc041e577b77c137 2026-04-22 20:53:46,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:46,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69251dc041e577b77c137 HTTP/1.1" 200 None 2026-04-22 20:53:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:46,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:46,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:46,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69251dc041e577b77c137 HTTP/1.1" 200 None 2026-04-22 20:53:46,646 - lava_callback - ERROR - Error processing callback for node 69e69251dc041e577b77c137: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:47,186 - lava_callback - INFO - Received callback for node 69e69251dc041e577b77c13a INFO: 172.20.0.1:57914 - "POST /node/69e69251dc041e577b77c13a HTTP/1.0" 202 Accepted 2026-04-22 20:53:47,192 - lava_callback - INFO - Starting async job submit for node 69e69251dc041e577b77c13a 2026-04-22 20:53:47,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69251dc041e577b77c13a HTTP/1.1" 200 None 2026-04-22 20:53:47,211 - lava_callback - DEBUG - Processing node 69e69251dc041e577b77c13a: baseline-arm64-clabbe 2026-04-22 20:53:47,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69251dc041e577b77c13a 2026-04-22 20:53:47,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69251dc041e577b77c13a HTTP/1.1" 200 None 2026-04-22 20:53:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:47,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69251dc041e577b77c13a HTTP/1.1" 200 None 2026-04-22 20:53:47,267 - lava_callback - ERROR - Error processing callback for node 69e69251dc041e577b77c13a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:47,852 - lava_callback - INFO - Received callback for node 69e69252dc041e577b77c142 INFO: 172.20.0.1:57930 - "POST /node/69e69252dc041e577b77c142 HTTP/1.0" 202 Accepted 2026-04-22 20:53:47,858 - lava_callback - INFO - Starting async job submit for node 69e69252dc041e577b77c142 2026-04-22 20:53:47,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69252dc041e577b77c142 HTTP/1.1" 200 None 2026-04-22 20:53:47,872 - lava_callback - DEBUG - Processing node 69e69252dc041e577b77c142: baseline-arm64-clabbe 2026-04-22 20:53:47,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69252dc041e577b77c142 2026-04-22 20:53:47,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69252dc041e577b77c142 HTTP/1.1" 200 None 2026-04-22 20:53:47,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:47,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:47,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69252dc041e577b77c142 HTTP/1.1" 200 None 2026-04-22 20:53:47,917 - lava_callback - ERROR - Error processing callback for node 69e69252dc041e577b77c142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:48,537 - lava_callback - INFO - Received callback for node 69e69253dc041e577b77c145 INFO: 172.20.0.1:57940 - "POST /node/69e69253dc041e577b77c145 HTTP/1.0" 202 Accepted 2026-04-22 20:53:48,542 - lava_callback - INFO - Starting async job submit for node 69e69253dc041e577b77c145 2026-04-22 20:53:48,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:48,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69253dc041e577b77c145 HTTP/1.1" 200 None 2026-04-22 20:53:48,556 - lava_callback - DEBUG - Processing node 69e69253dc041e577b77c145: baseline-arm64-clabbe 2026-04-22 20:53:48,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69253dc041e577b77c145 2026-04-22 20:53:48,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:48,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69253dc041e577b77c145 HTTP/1.1" 200 None 2026-04-22 20:53:48,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:48,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:48,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:48,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69253dc041e577b77c145 HTTP/1.1" 200 None 2026-04-22 20:53:48,601 - lava_callback - ERROR - Error processing callback for node 69e69253dc041e577b77c145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:49,225 - lava_callback - INFO - Received callback for node 69e69255dc041e577b77c14f INFO: 172.20.0.1:57956 - "POST /node/69e69255dc041e577b77c14f HTTP/1.0" 202 Accepted 2026-04-22 20:53:49,230 - lava_callback - INFO - Starting async job submit for node 69e69255dc041e577b77c14f 2026-04-22 20:53:49,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69255dc041e577b77c14f HTTP/1.1" 200 None 2026-04-22 20:53:49,245 - lava_callback - DEBUG - Processing node 69e69255dc041e577b77c14f: baseline-arm64-clabbe 2026-04-22 20:53:49,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69255dc041e577b77c14f 2026-04-22 20:53:49,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69255dc041e577b77c14f HTTP/1.1" 200 None 2026-04-22 20:53:49,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:49,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69255dc041e577b77c14f HTTP/1.1" 200 None 2026-04-22 20:53:49,296 - lava_callback - ERROR - Error processing callback for node 69e69255dc041e577b77c14f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 20:53:49,910 - lava_callback - INFO - Received callback for node 69e69254dc041e577b77c14c INFO: 172.20.0.1:47536 - "POST /node/69e69254dc041e577b77c14c HTTP/1.0" 202 Accepted 2026-04-22 20:53:49,917 - lava_callback - INFO - Starting async job submit for node 69e69254dc041e577b77c14c 2026-04-22 20:53:49,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69254dc041e577b77c14c HTTP/1.1" 200 None 2026-04-22 20:53:49,941 - lava_callback - DEBUG - Processing node 69e69254dc041e577b77c14c: baseline-arm64-clabbe 2026-04-22 20:53:49,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69254dc041e577b77c14c 2026-04-22 20:53:49,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69254dc041e577b77c14c HTTP/1.1" 200 None 2026-04-22 20:53:49,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:49,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6522047863bb428fe4af5 HTTP/1.1" 200 None 2026-04-22 20:53:49,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:53:50,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69254dc041e577b77c14c HTTP/1.1" 200 None 2026-04-22 20:53:50,005 - lava_callback - ERROR - Error processing callback for node 69e69254dc041e577b77c14c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:54:45,873 - lava_callback - INFO - Received callback for node 69e69280dc041e577b77c1c9 INFO: 172.20.0.1:33516 - "POST /node/69e69280dc041e577b77c1c9 HTTP/1.0" 202 Accepted 2026-04-22 20:54:45,878 - lava_callback - INFO - Starting async job submit for node 69e69280dc041e577b77c1c9 2026-04-22 20:54:45,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:54:45,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69280dc041e577b77c1c9 HTTP/1.1" 200 None 2026-04-22 20:54:45,898 - lava_callback - DEBUG - Processing node 69e69280dc041e577b77c1c9: baseline-arm64-clabbe 2026-04-22 20:54:45,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69280dc041e577b77c1c9 2026-04-22 20:54:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:54:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69280dc041e577b77c1c9 HTTP/1.1" 200 None 2026-04-22 20:54:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:54:45,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:54:45,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:54:45,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69280dc041e577b77c1c9 HTTP/1.1" 200 None 2026-04-22 20:54:45,948 - lava_callback - ERROR - Error processing callback for node 69e69280dc041e577b77c1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40222 - "GET / HTTP/1.0" 200 OK 2026-04-22 20:56:05,963 - lava_callback - INFO - Received callback for node 69e692d7dc041e577b77c27e INFO: 172.20.0.1:40232 - "POST /node/69e692d7dc041e577b77c27e HTTP/1.0" 202 Accepted 2026-04-22 20:56:05,968 - lava_callback - INFO - Starting async job submit for node 69e692d7dc041e577b77c27e 2026-04-22 20:56:05,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:56:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e692d7dc041e577b77c27e HTTP/1.1" 200 None 2026-04-22 20:56:05,988 - lava_callback - DEBUG - Processing node 69e692d7dc041e577b77c27e: baseline-arm64-clabbe 2026-04-22 20:56:05,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e692d7dc041e577b77c27e 2026-04-22 20:56:05,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:56:06,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e692d7dc041e577b77c27e HTTP/1.1" 200 None 2026-04-22 20:56:06,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:56:06,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:56:06,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:56:06,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e692d7dc041e577b77c27e HTTP/1.1" 200 None 2026-04-22 20:56:06,032 - lava_callback - ERROR - Error processing callback for node 69e692d7dc041e577b77c27e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET /node/695303289912bd6bbcea6bd3%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-22 20:59:26,125 - lava_callback - INFO - Received callback for node 69e693a9dc041e577b77c304 INFO: 172.20.0.1:51534 - "POST /node/69e693a9dc041e577b77c304 HTTP/1.0" 202 Accepted 2026-04-22 20:59:26,134 - lava_callback - INFO - Starting async job submit for node 69e693a9dc041e577b77c304 2026-04-22 20:59:26,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:59:26,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e693a9dc041e577b77c304 HTTP/1.1" 200 None 2026-04-22 20:59:26,156 - lava_callback - DEBUG - Processing node 69e693a9dc041e577b77c304: baseline-arm64-clabbe 2026-04-22 20:59:26,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e693a9dc041e577b77c304 2026-04-22 20:59:26,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:59:26,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e693a9dc041e577b77c304 HTTP/1.1" 200 None 2026-04-22 20:59:26,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:59:26,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 20:59:26,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 20:59:26,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e693a9dc041e577b77c304 HTTP/1.1" 200 None 2026-04-22 20:59:26,230 - lava_callback - ERROR - Error processing callback for node 69e693a9dc041e577b77c304: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET /node/698858f5e408e9ea60faecee%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:01:06,203 - lava_callback - INFO - Received callback for node 69e69401dc041e577b77c324 INFO: 172.20.0.1:36736 - "POST /node/69e69401dc041e577b77c324 HTTP/1.0" 202 Accepted 2026-04-22 21:01:06,208 - lava_callback - INFO - Starting async job submit for node 69e69401dc041e577b77c324 2026-04-22 21:01:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:01:06,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69401dc041e577b77c324 HTTP/1.1" 200 None 2026-04-22 21:01:06,224 - lava_callback - DEBUG - Processing node 69e69401dc041e577b77c324: baseline-arm64-clabbe 2026-04-22 21:01:06,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69401dc041e577b77c324 2026-04-22 21:01:06,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:01:06,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69401dc041e577b77c324 HTTP/1.1" 200 None 2026-04-22 21:01:06,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:01:06,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-22 21:01:06,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:01:06,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69401dc041e577b77c324 HTTP/1.1" 200 None 2026-04-22 21:01:06,270 - lava_callback - ERROR - Error processing callback for node 69e69401dc041e577b77c324: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:03:26,264 - lava_callback - INFO - Received callback for node 69e6949adc041e577b77c378 INFO: 172.20.0.1:45824 - "POST /node/69e6949adc041e577b77c378 HTTP/1.0" 202 Accepted 2026-04-22 21:03:26,270 - lava_callback - INFO - Starting async job submit for node 69e6949adc041e577b77c378 2026-04-22 21:03:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:03:26,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6949adc041e577b77c378 HTTP/1.1" 200 None 2026-04-22 21:03:26,285 - lava_callback - DEBUG - Processing node 69e6949adc041e577b77c378: baseline-arm-clabbe 2026-04-22 21:03:26,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6949adc041e577b77c378 2026-04-22 21:03:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:03:26,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6949adc041e577b77c378 HTTP/1.1" 200 None 2026-04-22 21:03:26,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:03:26,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:03:26,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:03:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6949adc041e577b77c378 HTTP/1.1" 200 None 2026-04-22 21:03:26,330 - lava_callback - ERROR - Error processing callback for node 69e6949adc041e577b77c378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51186 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:04:06,264 - lava_callback - INFO - Received callback for node 69e694c2dc041e577b77c385 INFO: 172.20.0.1:51200 - "POST /node/69e694c2dc041e577b77c385 HTTP/1.0" 202 Accepted 2026-04-22 21:04:06,270 - lava_callback - INFO - Starting async job submit for node 69e694c2dc041e577b77c385 2026-04-22 21:04:06,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:06,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e694c2dc041e577b77c385 HTTP/1.1" 200 None 2026-04-22 21:04:06,291 - lava_callback - DEBUG - Processing node 69e694c2dc041e577b77c385: baseline-arm-clabbe 2026-04-22 21:04:06,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e694c2dc041e577b77c385 2026-04-22 21:04:06,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:06,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e694c2dc041e577b77c385 HTTP/1.1" 200 None 2026-04-22 21:04:06,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:06,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:04:06,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:06,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e694c2dc041e577b77c385 HTTP/1.1" 200 None 2026-04-22 21:04:06,336 - lava_callback - ERROR - Error processing callback for node 69e694c2dc041e577b77c385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43814 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:04:49,536 - lava_callback - INFO - Received callback for node 69e694e6dc041e577b77c398 INFO: 172.20.0.1:43828 - "POST /node/69e694e6dc041e577b77c398 HTTP/1.0" 202 Accepted 2026-04-22 21:04:49,541 - lava_callback - INFO - Starting async job submit for node 69e694e6dc041e577b77c398 2026-04-22 21:04:49,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:49,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e694e6dc041e577b77c398 HTTP/1.1" 200 None 2026-04-22 21:04:49,556 - lava_callback - DEBUG - Processing node 69e694e6dc041e577b77c398: baseline-arm-baylibre 2026-04-22 21:04:49,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e694e6dc041e577b77c398 2026-04-22 21:04:49,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:49,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e694e6dc041e577b77c398 HTTP/1.1" 200 None 2026-04-22 21:04:49,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:49,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:04:49,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:04:49,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e694e6dc041e577b77c398 HTTP/1.1" 200 None 2026-04-22 21:04:49,619 - lava_callback - ERROR - Error processing callback for node 69e694e6dc041e577b77c398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:05:29,569 - lava_callback - INFO - Received callback for node 69e6950edc041e577b77c3b2 INFO: 172.20.0.1:55052 - "POST /node/69e6950edc041e577b77c3b2 HTTP/1.0" 202 Accepted 2026-04-22 21:05:29,575 - lava_callback - INFO - Starting async job submit for node 69e6950edc041e577b77c3b2 2026-04-22 21:05:29,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:05:29,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6950edc041e577b77c3b2 HTTP/1.1" 200 None 2026-04-22 21:05:29,590 - lava_callback - DEBUG - Processing node 69e6950edc041e577b77c3b2: baseline-arm-baylibre 2026-04-22 21:05:29,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6950edc041e577b77c3b2 2026-04-22 21:05:29,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:05:29,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6950edc041e577b77c3b2 HTTP/1.1" 200 None 2026-04-22 21:05:29,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:05:29,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:05:29,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:05:29,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6950edc041e577b77c3b2 HTTP/1.1" 200 None 2026-04-22 21:05:29,672 - lava_callback - ERROR - Error processing callback for node 69e6950edc041e577b77c3b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:06:09,613 - lava_callback - INFO - Received callback for node 69e69536dc041e577b77c3c0 INFO: 172.20.0.1:48522 - "POST /node/69e69536dc041e577b77c3c0 HTTP/1.0" 202 Accepted 2026-04-22 21:06:09,618 - lava_callback - INFO - Starting async job submit for node 69e69536dc041e577b77c3c0 2026-04-22 21:06:09,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:09,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69536dc041e577b77c3c0 HTTP/1.1" 200 None 2026-04-22 21:06:09,633 - lava_callback - DEBUG - Processing node 69e69536dc041e577b77c3c0: baseline-arm-baylibre 2026-04-22 21:06:09,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69536dc041e577b77c3c0 2026-04-22 21:06:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:09,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69536dc041e577b77c3c0 HTTP/1.1" 200 None 2026-04-22 21:06:09,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:09,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:06:09,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:09,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69536dc041e577b77c3c0 HTTP/1.1" 200 None 2026-04-22 21:06:09,678 - lava_callback - ERROR - Error processing callback for node 69e69536dc041e577b77c3c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59578 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:06:46,422 - lava_callback - INFO - Received callback for node 69e69563dc041e577b77c3ce INFO: 172.20.0.1:44836 - "POST /node/69e69563dc041e577b77c3ce HTTP/1.0" 202 Accepted 2026-04-22 21:06:46,428 - lava_callback - INFO - Starting async job submit for node 69e69563dc041e577b77c3ce 2026-04-22 21:06:46,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:46,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69563dc041e577b77c3ce HTTP/1.1" 200 None 2026-04-22 21:06:46,454 - lava_callback - DEBUG - Processing node 69e69563dc041e577b77c3ce: baseline-arm-clabbe 2026-04-22 21:06:46,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69563dc041e577b77c3ce 2026-04-22 21:06:46,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:46,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69563dc041e577b77c3ce HTTP/1.1" 200 None 2026-04-22 21:06:46,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:06:46,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:06:46,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:06:46,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69563dc041e577b77c3ce HTTP/1.1" 200 None 2026-04-22 21:06:46,511 - lava_callback - ERROR - Error processing callback for node 69e69563dc041e577b77c3ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:07:29,692 - lava_callback - INFO - Received callback for node 69e69588dc041e577b77c3e4 INFO: 172.20.0.1:58590 - "POST /node/69e69588dc041e577b77c3e4 HTTP/1.0" 202 Accepted 2026-04-22 21:07:29,698 - lava_callback - INFO - Starting async job submit for node 69e69588dc041e577b77c3e4 2026-04-22 21:07:29,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:07:29,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69588dc041e577b77c3e4 HTTP/1.1" 200 None 2026-04-22 21:07:29,714 - lava_callback - DEBUG - Processing node 69e69588dc041e577b77c3e4: baseline-arm-baylibre 2026-04-22 21:07:29,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69588dc041e577b77c3e4 2026-04-22 21:07:29,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:07:29,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69588dc041e577b77c3e4 HTTP/1.1" 200 None 2026-04-22 21:07:29,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:07:29,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:07:29,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:07:29,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69588dc041e577b77c3e4 HTTP/1.1" 200 None 2026-04-22 21:07:29,797 - lava_callback - ERROR - Error processing callback for node 69e69588dc041e577b77c3e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:08:49,826 - lava_callback - INFO - Received callback for node 69e695d7dc041e577b77c3fb INFO: 172.20.0.1:46568 - "POST /node/69e695d7dc041e577b77c3fb HTTP/1.0" 202 Accepted 2026-04-22 21:08:49,833 - lava_callback - INFO - Starting async job submit for node 69e695d7dc041e577b77c3fb 2026-04-22 21:08:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:08:49,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e695d7dc041e577b77c3fb HTTP/1.1" 200 None 2026-04-22 21:08:49,859 - lava_callback - DEBUG - Processing node 69e695d7dc041e577b77c3fb: baseline-arm-baylibre 2026-04-22 21:08:49,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e695d7dc041e577b77c3fb 2026-04-22 21:08:49,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:08:49,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e695d7dc041e577b77c3fb HTTP/1.1" 200 None 2026-04-22 21:08:49,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:08:49,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:08:49,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:08:49,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e695d7dc041e577b77c3fb HTTP/1.1" 200 None 2026-04-22 21:08:49,916 - lava_callback - ERROR - Error processing callback for node 69e695d7dc041e577b77c3fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:10:46,649 - lava_callback - INFO - Received callback for node 69e69653dc041e577b77c431 INFO: 172.20.0.1:38704 - "POST /node/69e69653dc041e577b77c431 HTTP/1.0" 202 Accepted 2026-04-22 21:10:46,655 - lava_callback - INFO - Starting async job submit for node 69e69653dc041e577b77c431 2026-04-22 21:10:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:10:46,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69653dc041e577b77c431 HTTP/1.1" 200 None 2026-04-22 21:10:46,677 - lava_callback - DEBUG - Processing node 69e69653dc041e577b77c431: baseline-arm-clabbe 2026-04-22 21:10:46,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69653dc041e577b77c431 2026-04-22 21:10:46,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:10:46,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69653dc041e577b77c431 HTTP/1.1" 200 None 2026-04-22 21:10:46,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:10:46,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:10:46,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:10:46,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69653dc041e577b77c431 HTTP/1.1" 200 None 2026-04-22 21:10:46,731 - lava_callback - ERROR - Error processing callback for node 69e69653dc041e577b77c431: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:11:26,589 - lava_callback - INFO - Received callback for node 69e6967bdc041e577b77c446 INFO: 172.20.0.1:36082 - "POST /node/69e6967bdc041e577b77c446 HTTP/1.0" 202 Accepted 2026-04-22 21:11:26,595 - lava_callback - INFO - Starting async job submit for node 69e6967bdc041e577b77c446 2026-04-22 21:11:26,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:11:26,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6967bdc041e577b77c446 HTTP/1.1" 200 None 2026-04-22 21:11:26,610 - lava_callback - DEBUG - Processing node 69e6967bdc041e577b77c446: baseline-arm-clabbe 2026-04-22 21:11:26,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6967bdc041e577b77c446 2026-04-22 21:11:26,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:11:26,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6967bdc041e577b77c446 HTTP/1.1" 200 None 2026-04-22 21:11:26,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:11:26,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:11:26,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:11:26,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6967bdc041e577b77c446 HTTP/1.1" 200 None 2026-04-22 21:11:26,687 - lava_callback - ERROR - Error processing callback for node 69e6967bdc041e577b77c446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:12:06,644 - lava_callback - INFO - Received callback for node 69e696a3dc041e577b77c453 INFO: 172.20.0.1:34298 - "POST /node/69e696a3dc041e577b77c453 HTTP/1.0" 202 Accepted 2026-04-22 21:12:06,650 - lava_callback - INFO - Starting async job submit for node 69e696a3dc041e577b77c453 2026-04-22 21:12:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:12:06,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696a3dc041e577b77c453 HTTP/1.1" 200 None 2026-04-22 21:12:06,665 - lava_callback - DEBUG - Processing node 69e696a3dc041e577b77c453: baseline-arm-clabbe 2026-04-22 21:12:06,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e696a3dc041e577b77c453 2026-04-22 21:12:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:12:06,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696a3dc041e577b77c453 HTTP/1.1" 200 None 2026-04-22 21:12:06,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:12:06,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:12:06,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:12:06,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e696a3dc041e577b77c453 HTTP/1.1" 200 None 2026-04-22 21:12:06,718 - lava_callback - ERROR - Error processing callback for node 69e696a3dc041e577b77c453: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:13:06,702 - lava_callback - INFO - Received callback for node 69e696ccdc041e577b77c464 INFO: 172.20.0.1:49928 - "POST /node/69e696ccdc041e577b77c464 HTTP/1.0" 202 Accepted 2026-04-22 21:13:06,707 - lava_callback - INFO - Starting async job submit for node 69e696ccdc041e577b77c464 2026-04-22 21:13:06,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:06,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696ccdc041e577b77c464 HTTP/1.1" 200 None 2026-04-22 21:13:06,726 - lava_callback - DEBUG - Processing node 69e696ccdc041e577b77c464: baseline-arm-clabbe 2026-04-22 21:13:06,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e696ccdc041e577b77c464 2026-04-22 21:13:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:06,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696ccdc041e577b77c464 HTTP/1.1" 200 None 2026-04-22 21:13:06,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:06,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:13:06,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:06,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e696ccdc041e577b77c464 HTTP/1.1" 200 None 2026-04-22 21:13:06,770 - lava_callback - ERROR - Error processing callback for node 69e696ccdc041e577b77c464: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:13:46,650 - lava_callback - INFO - Received callback for node 69e696f6dc041e577b77c47b INFO: 172.20.0.1:53630 - "POST /node/69e696f6dc041e577b77c47b HTTP/1.0" 202 Accepted 2026-04-22 21:13:46,655 - lava_callback - INFO - Starting async job submit for node 69e696f6dc041e577b77c47b 2026-04-22 21:13:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:46,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696f6dc041e577b77c47b HTTP/1.1" 200 None 2026-04-22 21:13:46,670 - lava_callback - DEBUG - Processing node 69e696f6dc041e577b77c47b: baseline-arm-clabbe 2026-04-22 21:13:46,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e696f6dc041e577b77c47b 2026-04-22 21:13:46,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:46,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e696f6dc041e577b77c47b HTTP/1.1" 200 None 2026-04-22 21:13:46,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:46,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:13:46,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:13:46,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e696f6dc041e577b77c47b HTTP/1.1" 200 None 2026-04-22 21:13:46,714 - lava_callback - ERROR - Error processing callback for node 69e696f6dc041e577b77c47b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:14:10,062 - lava_callback - INFO - Received callback for node 69e69719dc041e577b77c499 INFO: 172.20.0.1:57838 - "POST /node/69e69719dc041e577b77c499 HTTP/1.0" 202 Accepted 2026-04-22 21:14:10,067 - lava_callback - INFO - Starting async job submit for node 69e69719dc041e577b77c499 2026-04-22 21:14:10,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:14:10,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69719dc041e577b77c499 HTTP/1.1" 200 None 2026-04-22 21:14:10,082 - lava_callback - DEBUG - Processing node 69e69719dc041e577b77c499: baseline-arm-baylibre 2026-04-22 21:14:10,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69719dc041e577b77c499 2026-04-22 21:14:10,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:14:10,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69719dc041e577b77c499 HTTP/1.1" 200 None 2026-04-22 21:14:10,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:14:10,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:14:10,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:14:10,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69719dc041e577b77c499 HTTP/1.1" 200 None 2026-04-22 21:14:10,129 - lava_callback - ERROR - Error processing callback for node 69e69719dc041e577b77c499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56128 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45356 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:15:06,805 - lava_callback - INFO - Received callback for node 69e69746dc041e577b77c4b5 INFO: 172.20.0.1:45362 - "POST /node/69e69746dc041e577b77c4b5 HTTP/1.0" 202 Accepted 2026-04-22 21:15:06,811 - lava_callback - INFO - Starting async job submit for node 69e69746dc041e577b77c4b5 2026-04-22 21:15:06,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:06,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69746dc041e577b77c4b5 HTTP/1.1" 200 None 2026-04-22 21:15:06,831 - lava_callback - DEBUG - Processing node 69e69746dc041e577b77c4b5: baseline-arm-clabbe 2026-04-22 21:15:06,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69746dc041e577b77c4b5 2026-04-22 21:15:06,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:06,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69746dc041e577b77c4b5 HTTP/1.1" 200 None 2026-04-22 21:15:06,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:06,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:15:06,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:06,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69746dc041e577b77c4b5 HTTP/1.1" 200 None 2026-04-22 21:15:06,875 - lava_callback - ERROR - Error processing callback for node 69e69746dc041e577b77c4b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46930 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:15:46,730 - lava_callback - INFO - Received callback for node 69e6976fdc041e577b77c4d1 INFO: 172.20.0.1:46946 - "POST /node/69e6976fdc041e577b77c4d1 HTTP/1.0" 202 Accepted 2026-04-22 21:15:46,736 - lava_callback - INFO - Starting async job submit for node 69e6976fdc041e577b77c4d1 2026-04-22 21:15:46,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:46,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6976fdc041e577b77c4d1 HTTP/1.1" 200 None 2026-04-22 21:15:46,751 - lava_callback - DEBUG - Processing node 69e6976fdc041e577b77c4d1: baseline-arm-clabbe 2026-04-22 21:15:46,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6976fdc041e577b77c4d1 2026-04-22 21:15:46,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:46,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6976fdc041e577b77c4d1 HTTP/1.1" 200 None 2026-04-22 21:15:46,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:46,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:15:46,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:15:46,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6976fdc041e577b77c4d1 HTTP/1.1" 200 None 2026-04-22 21:15:46,803 - lava_callback - ERROR - Error processing callback for node 69e6976fdc041e577b77c4d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:16:26,812 - lava_callback - INFO - Received callback for node 69e69798dc041e577b77c4e1 INFO: 172.20.0.1:38172 - "POST /node/69e69798dc041e577b77c4e1 HTTP/1.0" 202 Accepted 2026-04-22 21:16:26,821 - lava_callback - INFO - Starting async job submit for node 69e69798dc041e577b77c4e1 2026-04-22 21:16:26,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:16:26,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69798dc041e577b77c4e1 HTTP/1.1" 200 None 2026-04-22 21:16:26,852 - lava_callback - DEBUG - Processing node 69e69798dc041e577b77c4e1: baseline-arm-clabbe 2026-04-22 21:16:26,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69798dc041e577b77c4e1 2026-04-22 21:16:26,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:16:26,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69798dc041e577b77c4e1 HTTP/1.1" 200 None 2026-04-22 21:16:26,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:16:26,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:16:26,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:16:26,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69798dc041e577b77c4e1 HTTP/1.1" 200 None 2026-04-22 21:16:26,897 - lava_callback - ERROR - Error processing callback for node 69e69798dc041e577b77c4e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:17:47,042 - lava_callback - INFO - Received callback for node 69e697e9dc041e577b77c504 INFO: 172.20.0.1:35888 - "POST /node/69e697e9dc041e577b77c504 HTTP/1.0" 202 Accepted 2026-04-22 21:17:47,048 - lava_callback - INFO - Starting async job submit for node 69e697e9dc041e577b77c504 2026-04-22 21:17:47,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:17:47,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e697e9dc041e577b77c504 HTTP/1.1" 200 None 2026-04-22 21:17:47,063 - lava_callback - DEBUG - Processing node 69e697e9dc041e577b77c504: baseline-arm-clabbe 2026-04-22 21:17:47,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e697e9dc041e577b77c504 2026-04-22 21:17:47,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:17:47,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e697e9dc041e577b77c504 HTTP/1.1" 200 None 2026-04-22 21:17:47,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:17:47,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:17:47,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:17:47,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e697e9dc041e577b77c504 HTTP/1.1" 200 None 2026-04-22 21:17:47,124 - lava_callback - ERROR - Error processing callback for node 69e697e9dc041e577b77c504: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:18:26,819 - lava_callback - INFO - Received callback for node 69e69813dc041e577b77c52c INFO: 172.20.0.1:51880 - "POST /node/69e69813dc041e577b77c52c HTTP/1.0" 202 Accepted 2026-04-22 21:18:26,828 - lava_callback - INFO - Starting async job submit for node 69e69813dc041e577b77c52c 2026-04-22 21:18:26,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:18:26,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69813dc041e577b77c52c HTTP/1.1" 200 None 2026-04-22 21:18:26,851 - lava_callback - DEBUG - Processing node 69e69813dc041e577b77c52c: baseline-arm-clabbe 2026-04-22 21:18:26,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69813dc041e577b77c52c 2026-04-22 21:18:26,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:18:26,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69813dc041e577b77c52c HTTP/1.1" 200 None 2026-04-22 21:18:26,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:18:26,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:18:26,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:18:26,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69813dc041e577b77c52c HTTP/1.1" 200 None 2026-04-22 21:18:26,902 - lava_callback - ERROR - Error processing callback for node 69e69813dc041e577b77c52c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:19:06,891 - lava_callback - INFO - Received callback for node 69e6983adc041e577b77c540 INFO: 172.20.0.1:46072 - "POST /node/69e6983adc041e577b77c540 HTTP/1.0" 202 Accepted 2026-04-22 21:19:06,897 - lava_callback - INFO - Starting async job submit for node 69e6983adc041e577b77c540 2026-04-22 21:19:06,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:06,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6983adc041e577b77c540 HTTP/1.1" 200 None 2026-04-22 21:19:06,919 - lava_callback - DEBUG - Processing node 69e6983adc041e577b77c540: baseline-arm-clabbe 2026-04-22 21:19:06,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6983adc041e577b77c540 2026-04-22 21:19:06,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:06,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6983adc041e577b77c540 HTTP/1.1" 200 None 2026-04-22 21:19:06,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:06,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:19:06,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:06,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6983adc041e577b77c540 HTTP/1.1" 200 None 2026-04-22 21:19:06,980 - lava_callback - ERROR - Error processing callback for node 69e6983adc041e577b77c540: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:19:46,859 - lava_callback - INFO - Received callback for node 69e69862dc041e577b77c550 INFO: 172.20.0.1:48464 - "POST /node/69e69862dc041e577b77c550 HTTP/1.0" 202 Accepted 2026-04-22 21:19:46,864 - lava_callback - INFO - Starting async job submit for node 69e69862dc041e577b77c550 2026-04-22 21:19:46,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:46,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69862dc041e577b77c550 HTTP/1.1" 200 None 2026-04-22 21:19:46,879 - lava_callback - DEBUG - Processing node 69e69862dc041e577b77c550: baseline-arm-clabbe 2026-04-22 21:19:46,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69862dc041e577b77c550 2026-04-22 21:19:46,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:46,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69862dc041e577b77c550 HTTP/1.1" 200 None 2026-04-22 21:19:46,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:46,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:19:46,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:19:46,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69862dc041e577b77c550 HTTP/1.1" 200 None 2026-04-22 21:19:46,935 - lava_callback - ERROR - Error processing callback for node 69e69862dc041e577b77c550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49280 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:20:26,901 - lava_callback - INFO - Received callback for node 69e6988bdc041e577b77c572 INFO: 172.20.0.1:49282 - "POST /node/69e6988bdc041e577b77c572 HTTP/1.0" 202 Accepted 2026-04-22 21:20:26,907 - lava_callback - INFO - Starting async job submit for node 69e6988bdc041e577b77c572 2026-04-22 21:20:26,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:20:26,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6988bdc041e577b77c572 HTTP/1.1" 200 None 2026-04-22 21:20:26,969 - lava_callback - DEBUG - Processing node 69e6988bdc041e577b77c572: baseline-arm-clabbe 2026-04-22 21:20:26,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6988bdc041e577b77c572 2026-04-22 21:20:26,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:20:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6988bdc041e577b77c572 HTTP/1.1" 200 None 2026-04-22 21:20:27,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:20:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:20:27,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:20:27,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6988bdc041e577b77c572 HTTP/1.1" 200 None 2026-04-22 21:20:27,057 - lava_callback - ERROR - Error processing callback for node 69e6988bdc041e577b77c572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44648 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:21:06,899 - lava_callback - INFO - Received callback for node 69e698b4dc041e577b77c586 INFO: 172.20.0.1:44654 - "POST /node/69e698b4dc041e577b77c586 HTTP/1.0" 202 Accepted 2026-04-22 21:21:06,904 - lava_callback - INFO - Starting async job submit for node 69e698b4dc041e577b77c586 2026-04-22 21:21:06,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:06,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e698b4dc041e577b77c586 HTTP/1.1" 200 None 2026-04-22 21:21:06,919 - lava_callback - DEBUG - Processing node 69e698b4dc041e577b77c586: baseline-arm-clabbe 2026-04-22 21:21:06,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e698b4dc041e577b77c586 2026-04-22 21:21:06,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:06,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e698b4dc041e577b77c586 HTTP/1.1" 200 None 2026-04-22 21:21:06,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:06,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:21:06,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:06,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e698b4dc041e577b77c586 HTTP/1.1" 200 None 2026-04-22 21:21:06,964 - lava_callback - ERROR - Error processing callback for node 69e698b4dc041e577b77c586: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:21:46,941 - lava_callback - INFO - Received callback for node 69e698dcdc041e577b77c592 INFO: 172.20.0.1:44484 - "POST /node/69e698dcdc041e577b77c592 HTTP/1.0" 202 Accepted 2026-04-22 21:21:46,946 - lava_callback - INFO - Starting async job submit for node 69e698dcdc041e577b77c592 2026-04-22 21:21:46,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:46,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e698dcdc041e577b77c592 HTTP/1.1" 200 None 2026-04-22 21:21:46,961 - lava_callback - DEBUG - Processing node 69e698dcdc041e577b77c592: baseline-arm-clabbe 2026-04-22 21:21:46,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e698dcdc041e577b77c592 2026-04-22 21:21:46,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:46,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e698dcdc041e577b77c592 HTTP/1.1" 200 None 2026-04-22 21:21:46,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:46,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:21:46,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:21:47,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e698dcdc041e577b77c592 HTTP/1.1" 200 None 2026-04-22 21:21:47,010 - lava_callback - ERROR - Error processing callback for node 69e698dcdc041e577b77c592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40994 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:22:26,947 - lava_callback - INFO - Received callback for node 69e69905dc041e577b77c5b7 INFO: 172.20.0.1:41002 - "POST /node/69e69905dc041e577b77c5b7 HTTP/1.0" 202 Accepted 2026-04-22 21:22:26,953 - lava_callback - INFO - Starting async job submit for node 69e69905dc041e577b77c5b7 2026-04-22 21:22:26,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:22:26,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69905dc041e577b77c5b7 HTTP/1.1" 200 None 2026-04-22 21:22:26,971 - lava_callback - DEBUG - Processing node 69e69905dc041e577b77c5b7: baseline-arm-clabbe 2026-04-22 21:22:26,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69905dc041e577b77c5b7 2026-04-22 21:22:26,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:22:26,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69905dc041e577b77c5b7 HTTP/1.1" 200 None 2026-04-22 21:22:26,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:22:26,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:22:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:22:27,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69905dc041e577b77c5b7 HTTP/1.1" 200 None 2026-04-22 21:22:27,016 - lava_callback - ERROR - Error processing callback for node 69e69905dc041e577b77c5b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:23:07,097 - lava_callback - INFO - Received callback for node 69e6992ddc041e577b77c5c8 INFO: 172.20.0.1:47844 - "POST /node/69e6992ddc041e577b77c5c8 HTTP/1.0" 202 Accepted 2026-04-22 21:23:07,106 - lava_callback - INFO - Starting async job submit for node 69e6992ddc041e577b77c5c8 2026-04-22 21:23:07,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:07,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6992ddc041e577b77c5c8 HTTP/1.1" 200 None 2026-04-22 21:23:07,137 - lava_callback - DEBUG - Processing node 69e6992ddc041e577b77c5c8: baseline-arm-clabbe 2026-04-22 21:23:07,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6992ddc041e577b77c5c8 2026-04-22 21:23:07,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:07,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6992ddc041e577b77c5c8 HTTP/1.1" 200 None 2026-04-22 21:23:07,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:07,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:23:07,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:07,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6992ddc041e577b77c5c8 HTTP/1.1" 200 None 2026-04-22 21:23:07,216 - lava_callback - ERROR - Error processing callback for node 69e6992ddc041e577b77c5c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35626 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:23:46,993 - lava_callback - INFO - Received callback for node 69e69956dc041e577b77c5d9 INFO: 172.20.0.1:35628 - "POST /node/69e69956dc041e577b77c5d9 HTTP/1.0" 202 Accepted 2026-04-22 21:23:46,999 - lava_callback - INFO - Starting async job submit for node 69e69956dc041e577b77c5d9 2026-04-22 21:23:47,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:47,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69956dc041e577b77c5d9 HTTP/1.1" 200 None 2026-04-22 21:23:47,013 - lava_callback - DEBUG - Processing node 69e69956dc041e577b77c5d9: baseline-arm-clabbe 2026-04-22 21:23:47,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69956dc041e577b77c5d9 2026-04-22 21:23:47,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:47,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69956dc041e577b77c5d9 HTTP/1.1" 200 None 2026-04-22 21:23:47,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:47,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:23:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:23:47,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69956dc041e577b77c5d9 HTTP/1.1" 200 None 2026-04-22 21:23:47,073 - lava_callback - ERROR - Error processing callback for node 69e69956dc041e577b77c5d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:24:27,044 - lava_callback - INFO - Received callback for node 69e6997fdc041e577b77c5ed INFO: 172.20.0.1:39692 - "POST /node/69e6997fdc041e577b77c5ed HTTP/1.0" 202 Accepted 2026-04-22 21:24:27,051 - lava_callback - INFO - Starting async job submit for node 69e6997fdc041e577b77c5ed 2026-04-22 21:24:27,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:24:27,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6997fdc041e577b77c5ed HTTP/1.1" 200 None 2026-04-22 21:24:27,073 - lava_callback - DEBUG - Processing node 69e6997fdc041e577b77c5ed: baseline-arm-clabbe 2026-04-22 21:24:27,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6997fdc041e577b77c5ed 2026-04-22 21:24:27,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:24:27,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6997fdc041e577b77c5ed HTTP/1.1" 200 None 2026-04-22 21:24:27,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:24:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:24:27,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:24:27,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6997fdc041e577b77c5ed HTTP/1.1" 200 None 2026-04-22 21:24:27,130 - lava_callback - ERROR - Error processing callback for node 69e6997fdc041e577b77c5ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37822 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:25:06,970 - lava_callback - INFO - Received callback for node 69e699a8dc041e577b77c5ff INFO: 172.20.0.1:37826 - "POST /node/69e699a8dc041e577b77c5ff HTTP/1.0" 202 Accepted 2026-04-22 21:25:06,976 - lava_callback - INFO - Starting async job submit for node 69e699a8dc041e577b77c5ff 2026-04-22 21:25:06,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:06,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699a8dc041e577b77c5ff HTTP/1.1" 200 None 2026-04-22 21:25:06,991 - lava_callback - DEBUG - Processing node 69e699a8dc041e577b77c5ff: baseline-arm-clabbe 2026-04-22 21:25:06,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e699a8dc041e577b77c5ff 2026-04-22 21:25:06,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:07,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699a8dc041e577b77c5ff HTTP/1.1" 200 None 2026-04-22 21:25:07,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:07,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:25:07,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:07,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e699a8dc041e577b77c5ff HTTP/1.1" 200 None 2026-04-22 21:25:07,038 - lava_callback - ERROR - Error processing callback for node 69e699a8dc041e577b77c5ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60794 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:25:47,127 - lava_callback - INFO - Received callback for node 69e699d0dc041e577b77c60e INFO: 172.20.0.1:60808 - "POST /node/69e699d0dc041e577b77c60e HTTP/1.0" 202 Accepted 2026-04-22 21:25:47,133 - lava_callback - INFO - Starting async job submit for node 69e699d0dc041e577b77c60e 2026-04-22 21:25:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:47,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699d0dc041e577b77c60e HTTP/1.1" 200 None 2026-04-22 21:25:47,149 - lava_callback - DEBUG - Processing node 69e699d0dc041e577b77c60e: baseline-arm-clabbe 2026-04-22 21:25:47,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e699d0dc041e577b77c60e 2026-04-22 21:25:47,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:47,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699d0dc041e577b77c60e HTTP/1.1" 200 None 2026-04-22 21:25:47,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:47,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:25:47,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:25:47,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e699d0dc041e577b77c60e HTTP/1.1" 200 None 2026-04-22 21:25:47,200 - lava_callback - ERROR - Error processing callback for node 69e699d0dc041e577b77c60e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:26:27,075 - lava_callback - INFO - Received callback for node 69e699f8dc041e577b77c63b INFO: 172.20.0.1:34210 - "POST /node/69e699f8dc041e577b77c63b HTTP/1.0" 202 Accepted 2026-04-22 21:26:27,081 - lava_callback - INFO - Starting async job submit for node 69e699f8dc041e577b77c63b 2026-04-22 21:26:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:26:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699f8dc041e577b77c63b HTTP/1.1" 200 None 2026-04-22 21:26:27,099 - lava_callback - DEBUG - Processing node 69e699f8dc041e577b77c63b: baseline-arm-clabbe 2026-04-22 21:26:27,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e699f8dc041e577b77c63b 2026-04-22 21:26:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:26:27,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e699f8dc041e577b77c63b HTTP/1.1" 200 None 2026-04-22 21:26:27,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:26:27,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:26:27,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:26:27,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e699f8dc041e577b77c63b HTTP/1.1" 200 None 2026-04-22 21:26:27,154 - lava_callback - ERROR - Error processing callback for node 69e699f8dc041e577b77c63b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:34:07,440 - lava_callback - INFO - Received callback for node 69e69bbfdc041e577b77c72e INFO: 172.20.0.1:49126 - "POST /node/69e69bbfdc041e577b77c72e HTTP/1.0" 202 Accepted 2026-04-22 21:34:07,445 - lava_callback - INFO - Starting async job submit for node 69e69bbfdc041e577b77c72e 2026-04-22 21:34:07,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:34:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69bbfdc041e577b77c72e HTTP/1.1" 200 None 2026-04-22 21:34:07,461 - lava_callback - DEBUG - Processing node 69e69bbfdc041e577b77c72e: baseline-arm-clabbe 2026-04-22 21:34:07,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69bbfdc041e577b77c72e 2026-04-22 21:34:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:34:07,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69bbfdc041e577b77c72e HTTP/1.1" 200 None 2026-04-22 21:34:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:34:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:34:07,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:34:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69bbfdc041e577b77c72e HTTP/1.1" 200 None 2026-04-22 21:34:07,510 - lava_callback - ERROR - Error processing callback for node 69e69bbfdc041e577b77c72e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:37:27,540 - lava_callback - INFO - Received callback for node 69e69c90dc041e577b77c79a INFO: 172.20.0.1:37362 - "POST /node/69e69c90dc041e577b77c79a HTTP/1.0" 202 Accepted 2026-04-22 21:37:27,547 - lava_callback - INFO - Starting async job submit for node 69e69c90dc041e577b77c79a 2026-04-22 21:37:27,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:37:27,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69c90dc041e577b77c79a HTTP/1.1" 200 None 2026-04-22 21:37:27,565 - lava_callback - DEBUG - Processing node 69e69c90dc041e577b77c79a: baseline-arm-clabbe 2026-04-22 21:37:27,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69c90dc041e577b77c79a 2026-04-22 21:37:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:37:27,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69c90dc041e577b77c79a HTTP/1.1" 200 None 2026-04-22 21:37:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:37:27,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e283745d1193f22738a HTTP/1.1" 200 None 2026-04-22 21:37:27,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:37:27,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69c90dc041e577b77c79a HTTP/1.1" 200 None 2026-04-22 21:37:27,613 - lava_callback - ERROR - Error processing callback for node 69e69c90dc041e577b77c79a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48264 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:38:11,434 - lava_callback - INFO - Received callback for node 69e69cb4dc041e577b77c7ae INFO: 172.20.0.1:57682 - "POST /node/69e69cb4dc041e577b77c7ae HTTP/1.0" 202 Accepted 2026-04-22 21:38:11,443 - lava_callback - INFO - Starting async job submit for node 69e69cb4dc041e577b77c7ae 2026-04-22 21:38:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:38:11,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69cb4dc041e577b77c7ae HTTP/1.1" 200 None 2026-04-22 21:38:11,465 - lava_callback - DEBUG - Processing node 69e69cb4dc041e577b77c7ae: baseline-arm-baylibre 2026-04-22 21:38:11,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69cb4dc041e577b77c7ae 2026-04-22 21:38:11,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:38:11,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69cb4dc041e577b77c7ae HTTP/1.1" 200 None 2026-04-22 21:38:11,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:38:11,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:38:11,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:38:11,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69cb4dc041e577b77c7ae HTTP/1.1" 200 None 2026-04-22 21:38:11,534 - lava_callback - ERROR - Error processing callback for node 69e69cb4dc041e577b77c7ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52962 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:40:11,528 - lava_callback - INFO - Received callback for node 69e69d33dc041e577b77c7e4 INFO: 172.20.0.1:47138 - "POST /node/69e69d33dc041e577b77c7e4 HTTP/1.0" 202 Accepted 2026-04-22 21:40:11,533 - lava_callback - INFO - Starting async job submit for node 69e69d33dc041e577b77c7e4 2026-04-22 21:40:11,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:11,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69d33dc041e577b77c7e4 HTTP/1.1" 200 None 2026-04-22 21:40:11,549 - lava_callback - DEBUG - Processing node 69e69d33dc041e577b77c7e4: baseline-arm-baylibre 2026-04-22 21:40:11,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69d33dc041e577b77c7e4 2026-04-22 21:40:11,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:11,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69d33dc041e577b77c7e4 HTTP/1.1" 200 None 2026-04-22 21:40:11,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:11,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:40:11,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:11,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69d33dc041e577b77c7e4 HTTP/1.1" 200 None 2026-04-22 21:40:11,593 - lava_callback - ERROR - Error processing callback for node 69e69d33dc041e577b77c7e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:40:51,523 - lava_callback - INFO - Received callback for node 69e69d5ddc041e577b77c7f6 INFO: 172.20.0.1:51504 - "POST /node/69e69d5ddc041e577b77c7f6 HTTP/1.0" 202 Accepted 2026-04-22 21:40:51,529 - lava_callback - INFO - Starting async job submit for node 69e69d5ddc041e577b77c7f6 2026-04-22 21:40:51,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:51,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69d5ddc041e577b77c7f6 HTTP/1.1" 200 None 2026-04-22 21:40:51,542 - lava_callback - DEBUG - Processing node 69e69d5ddc041e577b77c7f6: baseline-arm-baylibre 2026-04-22 21:40:51,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69d5ddc041e577b77c7f6 2026-04-22 21:40:51,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:51,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69d5ddc041e577b77c7f6 HTTP/1.1" 200 None 2026-04-22 21:40:51,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:51,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:40:51,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:40:51,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69d5ddc041e577b77c7f6 HTTP/1.1" 200 None 2026-04-22 21:40:51,607 - lava_callback - ERROR - Error processing callback for node 69e69d5ddc041e577b77c7f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:42:51,704 - lava_callback - INFO - Received callback for node 69e69dd9dc041e577b77c822 INFO: 172.20.0.1:47062 - "POST /node/69e69dd9dc041e577b77c822 HTTP/1.0" 202 Accepted 2026-04-22 21:42:51,710 - lava_callback - INFO - Starting async job submit for node 69e69dd9dc041e577b77c822 2026-04-22 21:42:51,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:42:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69dd9dc041e577b77c822 HTTP/1.1" 200 None 2026-04-22 21:42:51,724 - lava_callback - DEBUG - Processing node 69e69dd9dc041e577b77c822: baseline-arm-baylibre 2026-04-22 21:42:51,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69dd9dc041e577b77c822 2026-04-22 21:42:51,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:42:51,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69dd9dc041e577b77c822 HTTP/1.1" 200 None 2026-04-22 21:42:51,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:42:51,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:42:51,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:42:51,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69dd9dc041e577b77c822 HTTP/1.1" 200 None 2026-04-22 21:42:51,769 - lava_callback - ERROR - Error processing callback for node 69e69dd9dc041e577b77c822: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55396 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:46:31,903 - lava_callback - INFO - Received callback for node 69e69eaddc041e577b77ef61 INFO: 172.20.0.1:56576 - "POST /node/69e69eaddc041e577b77ef61 HTTP/1.0" 202 Accepted 2026-04-22 21:46:31,909 - lava_callback - INFO - Starting async job submit for node 69e69eaddc041e577b77ef61 2026-04-22 21:46:31,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:46:31,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69eaddc041e577b77ef61 HTTP/1.1" 200 None 2026-04-22 21:46:31,924 - lava_callback - DEBUG - Processing node 69e69eaddc041e577b77ef61: baseline-arm-baylibre 2026-04-22 21:46:31,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69eaddc041e577b77ef61 2026-04-22 21:46:31,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:46:31,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69eaddc041e577b77ef61 HTTP/1.1" 200 None 2026-04-22 21:46:31,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:46:31,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:46:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:46:31,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69eaddc041e577b77ef61 HTTP/1.1" 200 None 2026-04-22 21:46:31,969 - lava_callback - ERROR - Error processing callback for node 69e69eaddc041e577b77ef61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:47:11,910 - lava_callback - INFO - Received callback for node 69e69ed7dc041e577b77ef77 INFO: 172.20.0.1:39486 - "POST /node/69e69ed7dc041e577b77ef77 HTTP/1.0" 202 Accepted 2026-04-22 21:47:11,915 - lava_callback - INFO - Starting async job submit for node 69e69ed7dc041e577b77ef77 2026-04-22 21:47:11,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:47:11,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69ed7dc041e577b77ef77 HTTP/1.1" 200 None 2026-04-22 21:47:11,932 - lava_callback - DEBUG - Processing node 69e69ed7dc041e577b77ef77: baseline-arm-baylibre 2026-04-22 21:47:11,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69ed7dc041e577b77ef77 2026-04-22 21:47:11,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:47:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69ed7dc041e577b77ef77 HTTP/1.1" 200 None 2026-04-22 21:47:11,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:47:11,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:47:11,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:47:11,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69ed7dc041e577b77ef77 HTTP/1.1" 200 None 2026-04-22 21:47:11,978 - lava_callback - ERROR - Error processing callback for node 69e69ed7dc041e577b77ef77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:52:08,273 - lava_callback - INFO - Received callback for node 69e69ff8dc041e577b77f007 INFO: 172.20.0.1:38886 - "POST /node/69e69ff8dc041e577b77f007 HTTP/1.0" 202 Accepted 2026-04-22 21:52:08,278 - lava_callback - INFO - Starting async job submit for node 69e69ff8dc041e577b77f007 2026-04-22 21:52:08,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:08,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69ff8dc041e577b77f007 HTTP/1.1" 200 None 2026-04-22 21:52:08,298 - lava_callback - DEBUG - Processing node 69e69ff8dc041e577b77f007: baseline-arm-clabbe 2026-04-22 21:52:08,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e69ff8dc041e577b77f007 2026-04-22 21:52:08,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e69ff8dc041e577b77f007 HTTP/1.1" 200 None 2026-04-22 21:52:08,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:08,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:52:08,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:08,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e69ff8dc041e577b77f007 HTTP/1.1" 200 None 2026-04-22 21:52:08,344 - lava_callback - ERROR - Error processing callback for node 69e69ff8dc041e577b77f007: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:52:48,249 - lava_callback - INFO - Received callback for node 69e6a022dc041e577b77f010 INFO: 172.20.0.1:34612 - "POST /node/69e6a022dc041e577b77f010 HTTP/1.0" 202 Accepted 2026-04-22 21:52:48,255 - lava_callback - INFO - Starting async job submit for node 69e6a022dc041e577b77f010 2026-04-22 21:52:48,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:48,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a022dc041e577b77f010 HTTP/1.1" 200 None 2026-04-22 21:52:48,270 - lava_callback - DEBUG - Processing node 69e6a022dc041e577b77f010: baseline-arm-clabbe 2026-04-22 21:52:48,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a022dc041e577b77f010 2026-04-22 21:52:48,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:48,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a022dc041e577b77f010 HTTP/1.1" 200 None 2026-04-22 21:52:48,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:48,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:52:48,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:52:48,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a022dc041e577b77f010 HTTP/1.1" 200 None 2026-04-22 21:52:48,333 - lava_callback - ERROR - Error processing callback for node 69e6a022dc041e577b77f010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51002 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:53:28,309 - lava_callback - INFO - Received callback for node 69e6a04bdc041e577b77f023 INFO: 172.20.0.1:51006 - "POST /node/69e6a04bdc041e577b77f023 HTTP/1.0" 202 Accepted 2026-04-22 21:53:28,316 - lava_callback - INFO - Starting async job submit for node 69e6a04bdc041e577b77f023 2026-04-22 21:53:28,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:53:28,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a04bdc041e577b77f023 HTTP/1.1" 200 None 2026-04-22 21:53:28,335 - lava_callback - DEBUG - Processing node 69e6a04bdc041e577b77f023: baseline-arm-clabbe 2026-04-22 21:53:28,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a04bdc041e577b77f023 2026-04-22 21:53:28,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:53:28,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a04bdc041e577b77f023 HTTP/1.1" 200 None 2026-04-22 21:53:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:53:28,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:53:28,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:53:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a04bdc041e577b77f023 HTTP/1.1" 200 None 2026-04-22 21:53:28,397 - lava_callback - ERROR - Error processing callback for node 69e6a04bdc041e577b77f023: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:54:08,329 - lava_callback - INFO - Received callback for node 69e6a075dc041e577b77f037 INFO: 172.20.0.1:57028 - "POST /node/69e6a075dc041e577b77f037 HTTP/1.0" 202 Accepted 2026-04-22 21:54:08,335 - lava_callback - INFO - Starting async job submit for node 69e6a075dc041e577b77f037 2026-04-22 21:54:08,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:08,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a075dc041e577b77f037 HTTP/1.1" 200 None 2026-04-22 21:54:08,350 - lava_callback - DEBUG - Processing node 69e6a075dc041e577b77f037: baseline-arm-clabbe 2026-04-22 21:54:08,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a075dc041e577b77f037 2026-04-22 21:54:08,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:08,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a075dc041e577b77f037 HTTP/1.1" 200 None 2026-04-22 21:54:08,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:08,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:54:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:08,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a075dc041e577b77f037 HTTP/1.1" 200 None 2026-04-22 21:54:08,400 - lava_callback - ERROR - Error processing callback for node 69e6a075dc041e577b77f037: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:54:48,412 - lava_callback - INFO - Received callback for node 69e6a09edc041e577b77f046 INFO: 172.20.0.1:39228 - "POST /node/69e6a09edc041e577b77f046 HTTP/1.0" 202 Accepted 2026-04-22 21:54:48,417 - lava_callback - INFO - Starting async job submit for node 69e6a09edc041e577b77f046 2026-04-22 21:54:48,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:48,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a09edc041e577b77f046 HTTP/1.1" 200 None 2026-04-22 21:54:48,433 - lava_callback - DEBUG - Processing node 69e6a09edc041e577b77f046: baseline-arm-clabbe 2026-04-22 21:54:48,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a09edc041e577b77f046 2026-04-22 21:54:48,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:48,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a09edc041e577b77f046 HTTP/1.1" 200 None 2026-04-22 21:54:48,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:48,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:54:48,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:54:48,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a09edc041e577b77f046 HTTP/1.1" 200 None 2026-04-22 21:54:48,478 - lava_callback - ERROR - Error processing callback for node 69e6a09edc041e577b77f046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:55:28,372 - lava_callback - INFO - Received callback for node 69e6a0c7dc041e577b77f05d INFO: 172.20.0.1:33606 - "POST /node/69e6a0c7dc041e577b77f05d HTTP/1.0" 202 Accepted 2026-04-22 21:55:28,378 - lava_callback - INFO - Starting async job submit for node 69e6a0c7dc041e577b77f05d 2026-04-22 21:55:28,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:55:28,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a0c7dc041e577b77f05d HTTP/1.1" 200 None 2026-04-22 21:55:28,404 - lava_callback - DEBUG - Processing node 69e6a0c7dc041e577b77f05d: baseline-arm-clabbe 2026-04-22 21:55:28,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a0c7dc041e577b77f05d 2026-04-22 21:55:28,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:55:28,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a0c7dc041e577b77f05d HTTP/1.1" 200 None 2026-04-22 21:55:28,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:55:28,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:55:28,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:55:28,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a0c7dc041e577b77f05d HTTP/1.1" 200 None 2026-04-22 21:55:28,451 - lava_callback - ERROR - Error processing callback for node 69e6a0c7dc041e577b77f05d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60950 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:56:08,399 - lava_callback - INFO - Received callback for node 69e6a0efdc041e577b77f071 INFO: 172.20.0.1:60958 - "POST /node/69e6a0efdc041e577b77f071 HTTP/1.0" 202 Accepted 2026-04-22 21:56:08,406 - lava_callback - INFO - Starting async job submit for node 69e6a0efdc041e577b77f071 2026-04-22 21:56:08,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a0efdc041e577b77f071 HTTP/1.1" 200 None 2026-04-22 21:56:08,426 - lava_callback - DEBUG - Processing node 69e6a0efdc041e577b77f071: baseline-arm-clabbe 2026-04-22 21:56:08,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a0efdc041e577b77f071 2026-04-22 21:56:08,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:08,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a0efdc041e577b77f071 HTTP/1.1" 200 None 2026-04-22 21:56:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:08,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:56:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:08,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a0efdc041e577b77f071 HTTP/1.1" 200 None 2026-04-22 21:56:08,479 - lava_callback - ERROR - Error processing callback for node 69e6a0efdc041e577b77f071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK 2026-04-22 21:56:48,421 - lava_callback - INFO - Received callback for node 69e6a118dc041e577b77f081 INFO: 172.20.0.1:45750 - "POST /node/69e6a118dc041e577b77f081 HTTP/1.0" 202 Accepted 2026-04-22 21:56:48,429 - lava_callback - INFO - Starting async job submit for node 69e6a118dc041e577b77f081 2026-04-22 21:56:48,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:48,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a118dc041e577b77f081 HTTP/1.1" 200 None 2026-04-22 21:56:48,444 - lava_callback - DEBUG - Processing node 69e6a118dc041e577b77f081: baseline-arm-clabbe 2026-04-22 21:56:48,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a118dc041e577b77f081 2026-04-22 21:56:48,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:48,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a118dc041e577b77f081 HTTP/1.1" 200 None 2026-04-22 21:56:48,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:48,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 21:56:48,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 21:56:48,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a118dc041e577b77f081 HTTP/1.1" 200 None 2026-04-22 21:56:48,511 - lava_callback - ERROR - Error processing callback for node 69e6a118dc041e577b77f081: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET /node/694963dbebaed71d438092f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET /node/698e79c6db401c547d570080%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:00:28,596 - lava_callback - INFO - Received callback for node 69e6a1e6dc041e577b77f101 INFO: 172.20.0.1:52492 - "POST /node/69e6a1e6dc041e577b77f101 HTTP/1.0" 202 Accepted 2026-04-22 22:00:28,602 - lava_callback - INFO - Starting async job submit for node 69e6a1e6dc041e577b77f101 2026-04-22 22:00:28,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:00:28,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a1e6dc041e577b77f101 HTTP/1.1" 200 None 2026-04-22 22:00:28,629 - lava_callback - DEBUG - Processing node 69e6a1e6dc041e577b77f101: baseline-arm-clabbe 2026-04-22 22:00:28,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a1e6dc041e577b77f101 2026-04-22 22:00:28,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:00:28,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a1e6dc041e577b77f101 HTTP/1.1" 200 None 2026-04-22 22:00:28,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:00:28,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e122ab69ed7ddbbc37c5 HTTP/1.1" 200 None 2026-04-22 22:00:28,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:00:28,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a1e6dc041e577b77f101 HTTP/1.1" 200 None 2026-04-22 22:00:28,700 - lava_callback - ERROR - Error processing callback for node 69e6a1e6dc041e577b77f101: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60500 - "GET /node/698bd7701e517752bab8b49f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45832 - "GET /node/6910b8518b15debe9dd53a49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54664 - "GET /node/6992ea2331166481c8dd8b8f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:07:13,040 - lava_callback - INFO - Received callback for node 69e6a387dc041e577b77f1bc INFO: 172.20.0.1:37634 - "POST /node/69e6a387dc041e577b77f1bc HTTP/1.0" 202 Accepted 2026-04-22 22:07:13,046 - lava_callback - INFO - Starting async job submit for node 69e6a387dc041e577b77f1bc 2026-04-22 22:07:13,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:07:13,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a387dc041e577b77f1bc HTTP/1.1" 200 None 2026-04-22 22:07:13,061 - lava_callback - DEBUG - Processing node 69e6a387dc041e577b77f1bc: baseline-arm64-baylibre 2026-04-22 22:07:13,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a387dc041e577b77f1bc 2026-04-22 22:07:13,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:07:13,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a387dc041e577b77f1bc HTTP/1.1" 200 None 2026-04-22 22:07:13,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:07:13,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:07:13,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:07:13,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a387dc041e577b77f1bc HTTP/1.1" 200 None 2026-04-22 22:07:13,108 - lava_callback - ERROR - Error processing callback for node 69e6a387dc041e577b77f1bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53178 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:08:33,050 - lava_callback - INFO - Received callback for node 69e6a3dbdc041e577b77f1e5 INFO: 172.20.0.1:58050 - "POST /node/69e6a3dbdc041e577b77f1e5 HTTP/1.0" 202 Accepted 2026-04-22 22:08:33,056 - lava_callback - INFO - Starting async job submit for node 69e6a3dbdc041e577b77f1e5 2026-04-22 22:08:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:08:33,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a3dbdc041e577b77f1e5 HTTP/1.1" 200 None 2026-04-22 22:08:33,072 - lava_callback - DEBUG - Processing node 69e6a3dbdc041e577b77f1e5: baseline-arm64-baylibre 2026-04-22 22:08:33,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a3dbdc041e577b77f1e5 2026-04-22 22:08:33,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:08:33,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a3dbdc041e577b77f1e5 HTTP/1.1" 200 None 2026-04-22 22:08:33,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:08:33,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:08:33,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:08:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a3dbdc041e577b77f1e5 HTTP/1.1" 200 None 2026-04-22 22:08:33,149 - lava_callback - ERROR - Error processing callback for node 69e6a3dbdc041e577b77f1e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET /node/69934ed4523507f3806a63ea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:11:33,343 - lava_callback - INFO - Received callback for node 69e6a488dc041e577b77f221 INFO: 172.20.0.1:50818 - "POST /node/69e6a488dc041e577b77f221 HTTP/1.0" 202 Accepted 2026-04-22 22:11:33,352 - lava_callback - INFO - Starting async job submit for node 69e6a488dc041e577b77f221 2026-04-22 22:11:33,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:11:33,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a488dc041e577b77f221 HTTP/1.1" 200 None 2026-04-22 22:11:33,373 - lava_callback - DEBUG - Processing node 69e6a488dc041e577b77f221: baseline-arm64-baylibre 2026-04-22 22:11:33,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a488dc041e577b77f221 2026-04-22 22:11:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:11:33,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a488dc041e577b77f221 HTTP/1.1" 200 None 2026-04-22 22:11:33,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:11:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:11:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:11:33,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a488dc041e577b77f221 HTTP/1.1" 200 None 2026-04-22 22:11:33,435 - lava_callback - ERROR - Error processing callback for node 69e6a488dc041e577b77f221: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:12:53,381 - lava_callback - INFO - Received callback for node 69e6a4dddc041e577b77f23f INFO: 172.20.0.1:46086 - "POST /node/69e6a4dddc041e577b77f23f HTTP/1.0" 202 Accepted 2026-04-22 22:12:53,390 - lava_callback - INFO - Starting async job submit for node 69e6a4dddc041e577b77f23f 2026-04-22 22:12:53,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:12:53,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a4dddc041e577b77f23f HTTP/1.1" 200 None 2026-04-22 22:12:53,410 - lava_callback - DEBUG - Processing node 69e6a4dddc041e577b77f23f: baseline-arm64-baylibre 2026-04-22 22:12:53,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a4dddc041e577b77f23f 2026-04-22 22:12:53,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:12:53,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a4dddc041e577b77f23f HTTP/1.1" 200 None 2026-04-22 22:12:53,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:12:53,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:12:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:12:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a4dddc041e577b77f23f HTTP/1.1" 200 None 2026-04-22 22:12:53,463 - lava_callback - ERROR - Error processing callback for node 69e6a4dddc041e577b77f23f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43926 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:14:13,425 - lava_callback - INFO - Received callback for node 69e6a528dc041e577b77f262 INFO: 172.20.0.1:38688 - "POST /node/69e6a528dc041e577b77f262 HTTP/1.0" 202 Accepted 2026-04-22 22:14:13,430 - lava_callback - INFO - Starting async job submit for node 69e6a528dc041e577b77f262 2026-04-22 22:14:13,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:14:13,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a528dc041e577b77f262 HTTP/1.1" 200 None 2026-04-22 22:14:13,445 - lava_callback - DEBUG - Processing node 69e6a528dc041e577b77f262: baseline-arm-baylibre 2026-04-22 22:14:13,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a528dc041e577b77f262 2026-04-22 22:14:13,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:14:13,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a528dc041e577b77f262 HTTP/1.1" 200 None 2026-04-22 22:14:13,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:14:13,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:14:13,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:14:13,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a528dc041e577b77f262 HTTP/1.1" 200 None 2026-04-22 22:14:13,490 - lava_callback - ERROR - Error processing callback for node 69e6a528dc041e577b77f262: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:15:33,521 - lava_callback - INFO - Received callback for node 69e6a582dc041e577b77f283 INFO: 172.20.0.1:50570 - "POST /node/69e6a582dc041e577b77f283 HTTP/1.0" 202 Accepted 2026-04-22 22:15:33,526 - lava_callback - INFO - Starting async job submit for node 69e6a582dc041e577b77f283 2026-04-22 22:15:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:15:33,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a582dc041e577b77f283 HTTP/1.1" 200 None 2026-04-22 22:15:33,541 - lava_callback - DEBUG - Processing node 69e6a582dc041e577b77f283: baseline-arm64-baylibre 2026-04-22 22:15:33,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a582dc041e577b77f283 2026-04-22 22:15:33,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:15:33,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a582dc041e577b77f283 HTTP/1.1" 200 None 2026-04-22 22:15:33,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:15:33,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:15:33,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:15:33,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a582dc041e577b77f283 HTTP/1.1" 200 None 2026-04-22 22:15:33,587 - lava_callback - ERROR - Error processing callback for node 69e6a582dc041e577b77f283: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39038 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:17:13,559 - lava_callback - INFO - Received callback for node 69e6a5d4dc041e577b77f29d INFO: 172.20.0.1:49446 - "POST /node/69e6a5d4dc041e577b77f29d HTTP/1.0" 202 Accepted 2026-04-22 22:17:13,565 - lava_callback - INFO - Starting async job submit for node 69e6a5d4dc041e577b77f29d 2026-04-22 22:17:13,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:17:13,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a5d4dc041e577b77f29d HTTP/1.1" 200 None 2026-04-22 22:17:13,586 - lava_callback - DEBUG - Processing node 69e6a5d4dc041e577b77f29d: baseline-arm64-baylibre 2026-04-22 22:17:13,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a5d4dc041e577b77f29d 2026-04-22 22:17:13,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:17:13,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a5d4dc041e577b77f29d HTTP/1.1" 200 None 2026-04-22 22:17:13,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:17:13,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:17:13,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:17:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a5d4dc041e577b77f29d HTTP/1.1" 200 None 2026-04-22 22:17:13,639 - lava_callback - ERROR - Error processing callback for node 69e6a5d4dc041e577b77f29d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36224 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:19:53,787 - lava_callback - INFO - Received callback for node 69e6a677dc041e577b77f2dd INFO: 172.20.0.1:38122 - "POST /node/69e6a677dc041e577b77f2dd HTTP/1.0" 202 Accepted 2026-04-22 22:19:53,792 - lava_callback - INFO - Starting async job submit for node 69e6a677dc041e577b77f2dd 2026-04-22 22:19:53,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:19:53,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a677dc041e577b77f2dd HTTP/1.1" 200 None 2026-04-22 22:19:53,808 - lava_callback - DEBUG - Processing node 69e6a677dc041e577b77f2dd: baseline-arm64-baylibre 2026-04-22 22:19:53,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a677dc041e577b77f2dd 2026-04-22 22:19:53,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:19:53,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a677dc041e577b77f2dd HTTP/1.1" 200 None 2026-04-22 22:19:53,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:19:53,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:19:53,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:19:53,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a677dc041e577b77f2dd HTTP/1.1" 200 None 2026-04-22 22:19:53,853 - lava_callback - ERROR - Error processing callback for node 69e6a677dc041e577b77f2dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:21:09,498 - lava_callback - INFO - Received callback for node 69e6a6c3dc041e577b77f300 INFO: 172.20.0.1:33018 - "POST /node/69e6a6c3dc041e577b77f300 HTTP/1.0" 202 Accepted 2026-04-22 22:21:09,503 - lava_callback - INFO - Starting async job submit for node 69e6a6c3dc041e577b77f300 2026-04-22 22:21:09,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:09,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a6c3dc041e577b77f300 HTTP/1.1" 200 None 2026-04-22 22:21:09,519 - lava_callback - DEBUG - Processing node 69e6a6c3dc041e577b77f300: baseline-arm-clabbe 2026-04-22 22:21:09,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a6c3dc041e577b77f300 2026-04-22 22:21:09,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:09,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a6c3dc041e577b77f300 HTTP/1.1" 200 None 2026-04-22 22:21:09,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:09,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:21:09,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:09,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a6c3dc041e577b77f300 HTTP/1.1" 200 None 2026-04-22 22:21:09,564 - lava_callback - ERROR - Error processing callback for node 69e6a6c3dc041e577b77f300: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47158 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:21:53,915 - lava_callback - INFO - Received callback for node 69e6a6f0dc041e577b77f317 INFO: 172.20.0.1:58660 - "POST /node/69e6a6f0dc041e577b77f317 HTTP/1.0" 202 Accepted 2026-04-22 22:21:53,923 - lava_callback - INFO - Starting async job submit for node 69e6a6f0dc041e577b77f317 2026-04-22 22:21:53,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:53,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a6f0dc041e577b77f317 HTTP/1.1" 200 None 2026-04-22 22:21:53,942 - lava_callback - DEBUG - Processing node 69e6a6f0dc041e577b77f317: baseline-arm64-baylibre 2026-04-22 22:21:53,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a6f0dc041e577b77f317 2026-04-22 22:21:53,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a6f0dc041e577b77f317 HTTP/1.1" 200 None 2026-04-22 22:21:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:21:53,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:21:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a6f0dc041e577b77f317 HTTP/1.1" 200 None 2026-04-22 22:21:53,996 - lava_callback - ERROR - Error processing callback for node 69e6a6f0dc041e577b77f317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:23:09,582 - lava_callback - INFO - Received callback for node 69e6a73edc041e577b77f33d INFO: 172.20.0.1:52496 - "POST /node/69e6a73edc041e577b77f33d HTTP/1.0" 202 Accepted 2026-04-22 22:23:09,588 - lava_callback - INFO - Starting async job submit for node 69e6a73edc041e577b77f33d 2026-04-22 22:23:09,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:09,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a73edc041e577b77f33d HTTP/1.1" 200 None 2026-04-22 22:23:09,605 - lava_callback - DEBUG - Processing node 69e6a73edc041e577b77f33d: baseline-arm-clabbe 2026-04-22 22:23:09,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a73edc041e577b77f33d 2026-04-22 22:23:09,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:09,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a73edc041e577b77f33d HTTP/1.1" 200 None 2026-04-22 22:23:09,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:09,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:23:09,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:09,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a73edc041e577b77f33d HTTP/1.1" 200 None 2026-04-22 22:23:09,670 - lava_callback - ERROR - Error processing callback for node 69e6a73edc041e577b77f33d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:23:49,513 - lava_callback - INFO - Received callback for node 69e6a76adc041e577b77f34b INFO: 172.20.0.1:33640 - "POST /node/69e6a76adc041e577b77f34b HTTP/1.0" 202 Accepted 2026-04-22 22:23:49,522 - lava_callback - INFO - Starting async job submit for node 69e6a76adc041e577b77f34b 2026-04-22 22:23:49,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:49,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a76adc041e577b77f34b HTTP/1.1" 200 None 2026-04-22 22:23:49,540 - lava_callback - DEBUG - Processing node 69e6a76adc041e577b77f34b: baseline-arm-clabbe 2026-04-22 22:23:49,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a76adc041e577b77f34b 2026-04-22 22:23:49,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:49,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a76adc041e577b77f34b HTTP/1.1" 200 None 2026-04-22 22:23:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:49,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:23:49,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:23:49,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a76adc041e577b77f34b HTTP/1.1" 200 None 2026-04-22 22:23:49,588 - lava_callback - ERROR - Error processing callback for node 69e6a76adc041e577b77f34b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:24:34,083 - lava_callback - INFO - Received callback for node 69e6a798dc041e577b77f365 INFO: 172.20.0.1:58356 - "POST /node/69e6a798dc041e577b77f365 HTTP/1.0" 202 Accepted 2026-04-22 22:24:34,089 - lava_callback - INFO - Starting async job submit for node 69e6a798dc041e577b77f365 2026-04-22 22:24:34,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:24:34,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a798dc041e577b77f365 HTTP/1.1" 200 None 2026-04-22 22:24:34,104 - lava_callback - DEBUG - Processing node 69e6a798dc041e577b77f365: baseline-arm64-baylibre 2026-04-22 22:24:34,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a798dc041e577b77f365 2026-04-22 22:24:34,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:24:34,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a798dc041e577b77f365 HTTP/1.1" 200 None 2026-04-22 22:24:34,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:24:34,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:24:34,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:24:34,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a798dc041e577b77f365 HTTP/1.1" 200 None 2026-04-22 22:24:34,149 - lava_callback - ERROR - Error processing callback for node 69e6a798dc041e577b77f365: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36772 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:26:49,753 - lava_callback - INFO - Received callback for node 69e6a81fdc041e577b77f395 INFO: 172.20.0.1:34584 - "POST /node/69e6a81fdc041e577b77f395 HTTP/1.0" 202 Accepted 2026-04-22 22:26:49,758 - lava_callback - INFO - Starting async job submit for node 69e6a81fdc041e577b77f395 2026-04-22 22:26:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:26:49,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a81fdc041e577b77f395 HTTP/1.1" 200 None 2026-04-22 22:26:49,773 - lava_callback - DEBUG - Processing node 69e6a81fdc041e577b77f395: baseline-arm64-clabbe 2026-04-22 22:26:49,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a81fdc041e577b77f395 2026-04-22 22:26:49,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:26:49,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a81fdc041e577b77f395 HTTP/1.1" 200 None 2026-04-22 22:26:49,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:26:49,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:26:49,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:26:49,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a81fdc041e577b77f395 HTTP/1.1" 200 None 2026-04-22 22:26:49,830 - lava_callback - ERROR - Error processing callback for node 69e6a81fdc041e577b77f395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:28:09,751 - lava_callback - INFO - Received callback for node 69e6a865dc041e577b77f3b0 INFO: 172.20.0.1:42984 - "POST /node/69e6a865dc041e577b77f3b0 HTTP/1.0" 202 Accepted 2026-04-22 22:28:09,756 - lava_callback - INFO - Starting async job submit for node 69e6a865dc041e577b77f3b0 2026-04-22 22:28:09,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:09,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a865dc041e577b77f3b0 HTTP/1.1" 200 None 2026-04-22 22:28:09,775 - lava_callback - DEBUG - Processing node 69e6a865dc041e577b77f3b0: baseline-arm-clabbe 2026-04-22 22:28:09,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a865dc041e577b77f3b0 2026-04-22 22:28:09,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:09,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a865dc041e577b77f3b0 HTTP/1.1" 200 None 2026-04-22 22:28:09,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:28:09,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:09,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a865dc041e577b77f3b0 HTTP/1.1" 200 None 2026-04-22 22:28:09,820 - lava_callback - ERROR - Error processing callback for node 69e6a865dc041e577b77f3b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:28:49,774 - lava_callback - INFO - Received callback for node 69e6a89ddc041e577b77f3c4 INFO: 172.20.0.1:60302 - "POST /node/69e6a89ddc041e577b77f3c4 HTTP/1.0" 202 Accepted 2026-04-22 22:28:49,779 - lava_callback - INFO - Starting async job submit for node 69e6a89ddc041e577b77f3c4 2026-04-22 22:28:49,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:49,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a89ddc041e577b77f3c4 HTTP/1.1" 200 None 2026-04-22 22:28:49,795 - lava_callback - DEBUG - Processing node 69e6a89ddc041e577b77f3c4: baseline-arm64-clabbe 2026-04-22 22:28:49,795 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a89ddc041e577b77f3c4 2026-04-22 22:28:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:49,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a89ddc041e577b77f3c4 HTTP/1.1" 200 None 2026-04-22 22:28:49,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:49,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:28:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:28:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a89ddc041e577b77f3c4 HTTP/1.1" 200 None 2026-04-22 22:28:49,839 - lava_callback - ERROR - Error processing callback for node 69e6a89ddc041e577b77f3c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:30:09,822 - lava_callback - INFO - Received callback for node 69e6a8e6dc041e577b77f3e6 INFO: 172.20.0.1:36808 - "POST /node/69e6a8e6dc041e577b77f3e6 HTTP/1.0" 202 Accepted 2026-04-22 22:30:09,828 - lava_callback - INFO - Starting async job submit for node 69e6a8e6dc041e577b77f3e6 2026-04-22 22:30:09,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:09,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a8e6dc041e577b77f3e6 HTTP/1.1" 200 None 2026-04-22 22:30:09,844 - lava_callback - DEBUG - Processing node 69e6a8e6dc041e577b77f3e6: baseline-arm-clabbe 2026-04-22 22:30:09,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a8e6dc041e577b77f3e6 2026-04-22 22:30:09,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:09,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a8e6dc041e577b77f3e6 HTTP/1.1" 200 None 2026-04-22 22:30:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:09,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:30:09,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:09,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a8e6dc041e577b77f3e6 HTTP/1.1" 200 None 2026-04-22 22:30:09,896 - lava_callback - ERROR - Error processing callback for node 69e6a8e6dc041e577b77f3e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56098 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:30:49,837 - lava_callback - INFO - Received callback for node 69e6a910dc041e577b77f3f3 INFO: 172.20.0.1:33138 - "POST /node/69e6a910dc041e577b77f3f3 HTTP/1.0" 202 Accepted 2026-04-22 22:30:49,843 - lava_callback - INFO - Starting async job submit for node 69e6a910dc041e577b77f3f3 2026-04-22 22:30:49,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:49,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a910dc041e577b77f3f3 HTTP/1.1" 200 None 2026-04-22 22:30:49,861 - lava_callback - DEBUG - Processing node 69e6a910dc041e577b77f3f3: baseline-arm-clabbe 2026-04-22 22:30:49,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a910dc041e577b77f3f3 2026-04-22 22:30:49,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a910dc041e577b77f3f3 HTTP/1.1" 200 None 2026-04-22 22:30:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:49,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:30:49,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:30:49,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a910dc041e577b77f3f3 HTTP/1.1" 200 None 2026-04-22 22:30:49,906 - lava_callback - ERROR - Error processing callback for node 69e6a910dc041e577b77f3f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:31:49,946 - lava_callback - INFO - Received callback for node 69e6a948dc041e577b77f407 INFO: 172.20.0.1:55106 - "POST /node/69e6a948dc041e577b77f407 HTTP/1.0" 202 Accepted 2026-04-22 22:31:49,952 - lava_callback - INFO - Starting async job submit for node 69e6a948dc041e577b77f407 2026-04-22 22:31:49,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:31:49,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a948dc041e577b77f407 HTTP/1.1" 200 None 2026-04-22 22:31:49,968 - lava_callback - DEBUG - Processing node 69e6a948dc041e577b77f407: baseline-arm64-clabbe 2026-04-22 22:31:49,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6a948dc041e577b77f407 2026-04-22 22:31:49,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:31:49,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6a948dc041e577b77f407 HTTP/1.1" 200 None 2026-04-22 22:31:49,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:31:49,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:31:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:31:50,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6a948dc041e577b77f407 HTTP/1.1" 200 None 2026-04-22 22:31:50,013 - lava_callback - ERROR - Error processing callback for node 69e6a948dc041e577b77f407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59350 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:35:50,164 - lava_callback - INFO - Received callback for node 69e6aa3edc041e577b77f466 INFO: 172.20.0.1:50322 - "POST /node/69e6aa3edc041e577b77f466 HTTP/1.0" 202 Accepted 2026-04-22 22:35:50,169 - lava_callback - INFO - Starting async job submit for node 69e6aa3edc041e577b77f466 2026-04-22 22:35:50,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:35:50,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6aa3edc041e577b77f466 HTTP/1.1" 200 None 2026-04-22 22:35:50,185 - lava_callback - DEBUG - Processing node 69e6aa3edc041e577b77f466: baseline-arm-clabbe 2026-04-22 22:35:50,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6aa3edc041e577b77f466 2026-04-22 22:35:50,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:35:50,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6aa3edc041e577b77f466 HTTP/1.1" 200 None 2026-04-22 22:35:50,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:35:50,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:35:50,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:35:50,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6aa3edc041e577b77f466 HTTP/1.1" 200 None 2026-04-22 22:35:50,245 - lava_callback - ERROR - Error processing callback for node 69e6aa3edc041e577b77f466: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59450 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:38:14,739 - lava_callback - INFO - Received callback for node 69e6aac3dc041e577b77f49f INFO: 172.20.0.1:45686 - "POST /node/69e6aac3dc041e577b77f49f HTTP/1.0" 202 Accepted 2026-04-22 22:38:14,745 - lava_callback - INFO - Starting async job submit for node 69e6aac3dc041e577b77f49f 2026-04-22 22:38:14,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:38:14,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6aac3dc041e577b77f49f HTTP/1.1" 200 None 2026-04-22 22:38:14,759 - lava_callback - DEBUG - Processing node 69e6aac3dc041e577b77f49f: baseline-arm64-baylibre 2026-04-22 22:38:14,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6aac3dc041e577b77f49f 2026-04-22 22:38:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:38:14,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6aac3dc041e577b77f49f HTTP/1.1" 200 None 2026-04-22 22:38:14,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:38:14,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:38:14,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:38:14,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6aac3dc041e577b77f49f HTTP/1.1" 200 None 2026-04-22 22:38:14,810 - lava_callback - ERROR - Error processing callback for node 69e6aac3dc041e577b77f49f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42646 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:39:30,398 - lava_callback - INFO - Received callback for node 69e6ab0fdc041e577b77f4b8 INFO: 172.20.0.1:53806 - "POST /node/69e6ab0fdc041e577b77f4b8 HTTP/1.0" 202 Accepted 2026-04-22 22:39:30,403 - lava_callback - INFO - Starting async job submit for node 69e6ab0fdc041e577b77f4b8 2026-04-22 22:39:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:39:30,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab0fdc041e577b77f4b8 HTTP/1.1" 200 None 2026-04-22 22:39:30,418 - lava_callback - DEBUG - Processing node 69e6ab0fdc041e577b77f4b8: baseline-arm-clabbe 2026-04-22 22:39:30,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ab0fdc041e577b77f4b8 2026-04-22 22:39:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:39:30,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab0fdc041e577b77f4b8 HTTP/1.1" 200 None 2026-04-22 22:39:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:39:30,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:39:30,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:39:30,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ab0fdc041e577b77f4b8 HTTP/1.1" 200 None 2026-04-22 22:39:30,477 - lava_callback - ERROR - Error processing callback for node 69e6ab0fdc041e577b77f4b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:40:10,160 - lava_callback - INFO - Received callback for node 69e6ab46dc041e577b77f4cc INFO: 172.20.0.1:49630 - "POST /node/69e6ab46dc041e577b77f4cc HTTP/1.0" 202 Accepted 2026-04-22 22:40:10,165 - lava_callback - INFO - Starting async job submit for node 69e6ab46dc041e577b77f4cc 2026-04-22 22:40:10,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:40:10,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab46dc041e577b77f4cc HTTP/1.1" 200 None 2026-04-22 22:40:10,181 - lava_callback - DEBUG - Processing node 69e6ab46dc041e577b77f4cc: baseline-arm64-clabbe 2026-04-22 22:40:10,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ab46dc041e577b77f4cc 2026-04-22 22:40:10,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:40:10,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab46dc041e577b77f4cc HTTP/1.1" 200 None 2026-04-22 22:40:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:40:10,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:40:10,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:40:10,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ab46dc041e577b77f4cc HTTP/1.1" 200 None 2026-04-22 22:40:10,232 - lava_callback - ERROR - Error processing callback for node 69e6ab46dc041e577b77f4cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:41:30,314 - lava_callback - INFO - Received callback for node 69e6ab8ddc041e577b77f4e7 INFO: 172.20.0.1:56816 - "POST /node/69e6ab8ddc041e577b77f4e7 HTTP/1.0" 202 Accepted 2026-04-22 22:41:30,319 - lava_callback - INFO - Starting async job submit for node 69e6ab8ddc041e577b77f4e7 2026-04-22 22:41:30,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:41:30,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab8ddc041e577b77f4e7 HTTP/1.1" 200 None 2026-04-22 22:41:30,334 - lava_callback - DEBUG - Processing node 69e6ab8ddc041e577b77f4e7: baseline-arm-clabbe 2026-04-22 22:41:30,334 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ab8ddc041e577b77f4e7 2026-04-22 22:41:30,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:41:30,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ab8ddc041e577b77f4e7 HTTP/1.1" 200 None 2026-04-22 22:41:30,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:41:30,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95f8d105963562bb39ff HTTP/1.1" 200 None 2026-04-22 22:41:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:41:30,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ab8ddc041e577b77f4e7 HTTP/1.1" 200 None 2026-04-22 22:41:30,398 - lava_callback - ERROR - Error processing callback for node 69e6ab8ddc041e577b77f4e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56200 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:42:14,931 - lava_callback - INFO - Received callback for node 69e6abbcdc041e577b77f4fb INFO: 172.20.0.1:33444 - "POST /node/69e6abbcdc041e577b77f4fb HTTP/1.0" 202 Accepted 2026-04-22 22:42:14,937 - lava_callback - INFO - Starting async job submit for node 69e6abbcdc041e577b77f4fb 2026-04-22 22:42:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:42:14,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6abbcdc041e577b77f4fb HTTP/1.1" 200 None 2026-04-22 22:42:14,952 - lava_callback - DEBUG - Processing node 69e6abbcdc041e577b77f4fb: baseline-arm64-baylibre 2026-04-22 22:42:14,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6abbcdc041e577b77f4fb 2026-04-22 22:42:14,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:42:14,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6abbcdc041e577b77f4fb HTTP/1.1" 200 None 2026-04-22 22:42:14,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:42:14,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:42:14,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:42:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6abbcdc041e577b77f4fb HTTP/1.1" 200 None 2026-04-22 22:42:15,009 - lava_callback - ERROR - Error processing callback for node 69e6abbcdc041e577b77f4fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:45:10,479 - lava_callback - INFO - Received callback for node 69e6ac6bdc041e577b77f54e INFO: 172.20.0.1:43184 - "POST /node/69e6ac6bdc041e577b77f54e HTTP/1.0" 202 Accepted 2026-04-22 22:45:10,485 - lava_callback - INFO - Starting async job submit for node 69e6ac6bdc041e577b77f54e 2026-04-22 22:45:10,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:45:10,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ac6bdc041e577b77f54e HTTP/1.1" 200 None 2026-04-22 22:45:10,507 - lava_callback - DEBUG - Processing node 69e6ac6bdc041e577b77f54e: baseline-arm64-clabbe 2026-04-22 22:45:10,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ac6bdc041e577b77f54e 2026-04-22 22:45:10,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:45:10,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ac6bdc041e577b77f54e HTTP/1.1" 200 None 2026-04-22 22:45:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:45:10,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:45:10,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:45:10,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ac6bdc041e577b77f54e HTTP/1.1" 200 None 2026-04-22 22:45:10,582 - lava_callback - ERROR - Error processing callback for node 69e6ac6bdc041e577b77f54e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:46:30,509 - lava_callback - INFO - Received callback for node 69e6acc0dc041e577b77f56c INFO: 172.20.0.1:45664 - "POST /node/69e6acc0dc041e577b77f56c HTTP/1.0" 202 Accepted 2026-04-22 22:46:30,514 - lava_callback - INFO - Starting async job submit for node 69e6acc0dc041e577b77f56c 2026-04-22 22:46:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:46:30,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6acc0dc041e577b77f56c HTTP/1.1" 200 None 2026-04-22 22:46:30,530 - lava_callback - DEBUG - Processing node 69e6acc0dc041e577b77f56c: baseline-arm64-clabbe 2026-04-22 22:46:30,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6acc0dc041e577b77f56c 2026-04-22 22:46:30,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:46:30,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6acc0dc041e577b77f56c HTTP/1.1" 200 None 2026-04-22 22:46:30,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:46:30,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:46:30,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:46:30,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6acc0dc041e577b77f56c HTTP/1.1" 200 None 2026-04-22 22:46:30,577 - lava_callback - ERROR - Error processing callback for node 69e6acc0dc041e577b77f56c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50420 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:49:30,632 - lava_callback - INFO - Received callback for node 69e6ad64dc041e577b77f5ba INFO: 172.20.0.1:51048 - "POST /node/69e6ad64dc041e577b77f5ba HTTP/1.0" 202 Accepted 2026-04-22 22:49:30,637 - lava_callback - INFO - Starting async job submit for node 69e6ad64dc041e577b77f5ba 2026-04-22 22:49:30,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:49:30,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ad64dc041e577b77f5ba HTTP/1.1" 200 None 2026-04-22 22:49:30,652 - lava_callback - DEBUG - Processing node 69e6ad64dc041e577b77f5ba: baseline-arm64-clabbe 2026-04-22 22:49:30,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ad64dc041e577b77f5ba 2026-04-22 22:49:30,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:49:30,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ad64dc041e577b77f5ba HTTP/1.1" 200 None 2026-04-22 22:49:30,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:49:30,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:49:30,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:49:30,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ad64dc041e577b77f5ba HTTP/1.1" 200 None 2026-04-22 22:49:30,703 - lava_callback - ERROR - Error processing callback for node 69e6ad64dc041e577b77f5ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58624 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:50:50,716 - lava_callback - INFO - Received callback for node 69e6adb9dc041e577b77f5e0 INFO: 172.20.0.1:34048 - "POST /node/69e6adb9dc041e577b77f5e0 HTTP/1.0" 202 Accepted 2026-04-22 22:50:50,721 - lava_callback - INFO - Starting async job submit for node 69e6adb9dc041e577b77f5e0 2026-04-22 22:50:50,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:50:50,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6adb9dc041e577b77f5e0 HTTP/1.1" 200 None 2026-04-22 22:50:50,736 - lava_callback - DEBUG - Processing node 69e6adb9dc041e577b77f5e0: baseline-arm64-clabbe 2026-04-22 22:50:50,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6adb9dc041e577b77f5e0 2026-04-22 22:50:50,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:50:50,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6adb9dc041e577b77f5e0 HTTP/1.1" 200 None 2026-04-22 22:50:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:50:50,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:50:50,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:50:50,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6adb9dc041e577b77f5e0 HTTP/1.1" 200 None 2026-04-22 22:50:50,786 - lava_callback - ERROR - Error processing callback for node 69e6adb9dc041e577b77f5e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:52:10,818 - lava_callback - INFO - Received callback for node 69e6ae0cdc041e577b77f606 INFO: 172.20.0.1:52346 - "POST /node/69e6ae0cdc041e577b77f606 HTTP/1.0" 202 Accepted 2026-04-22 22:52:10,826 - lava_callback - INFO - Starting async job submit for node 69e6ae0cdc041e577b77f606 2026-04-22 22:52:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:52:10,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ae0cdc041e577b77f606 HTTP/1.1" 200 None 2026-04-22 22:52:10,841 - lava_callback - DEBUG - Processing node 69e6ae0cdc041e577b77f606: baseline-arm64-clabbe 2026-04-22 22:52:10,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ae0cdc041e577b77f606 2026-04-22 22:52:10,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:52:10,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ae0cdc041e577b77f606 HTTP/1.1" 200 None 2026-04-22 22:52:10,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:52:10,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:52:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:52:10,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ae0cdc041e577b77f606 HTTP/1.1" 200 None 2026-04-22 22:52:10,892 - lava_callback - ERROR - Error processing callback for node 69e6ae0cdc041e577b77f606: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46848 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:53:30,810 - lava_callback - INFO - Received callback for node 69e6ae61dc041e577b77f627 INFO: 172.20.0.1:42694 - "POST /node/69e6ae61dc041e577b77f627 HTTP/1.0" 202 Accepted 2026-04-22 22:53:30,815 - lava_callback - INFO - Starting async job submit for node 69e6ae61dc041e577b77f627 2026-04-22 22:53:30,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:53:30,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ae61dc041e577b77f627 HTTP/1.1" 200 None 2026-04-22 22:53:30,836 - lava_callback - DEBUG - Processing node 69e6ae61dc041e577b77f627: baseline-arm64-clabbe 2026-04-22 22:53:30,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6ae61dc041e577b77f627 2026-04-22 22:53:30,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:53:30,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6ae61dc041e577b77f627 HTTP/1.1" 200 None 2026-04-22 22:53:30,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:53:30,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:53:30,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:53:30,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6ae61dc041e577b77f627 HTTP/1.1" 200 None 2026-04-22 22:53:30,895 - lava_callback - ERROR - Error processing callback for node 69e6ae61dc041e577b77f627: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:56:10,895 - lava_callback - INFO - Received callback for node 69e6af07dc041e577b77f67b INFO: 172.20.0.1:39488 - "POST /node/69e6af07dc041e577b77f67b HTTP/1.0" 202 Accepted 2026-04-22 22:56:10,902 - lava_callback - INFO - Starting async job submit for node 69e6af07dc041e577b77f67b 2026-04-22 22:56:10,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:56:10,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6af07dc041e577b77f67b HTTP/1.1" 200 None 2026-04-22 22:56:10,918 - lava_callback - DEBUG - Processing node 69e6af07dc041e577b77f67b: baseline-arm64-clabbe 2026-04-22 22:56:10,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6af07dc041e577b77f67b 2026-04-22 22:56:10,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:56:10,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6af07dc041e577b77f67b HTTP/1.1" 200 None 2026-04-22 22:56:10,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:56:10,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:56:10,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:56:10,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6af07dc041e577b77f67b HTTP/1.1" 200 None 2026-04-22 22:56:10,972 - lava_callback - ERROR - Error processing callback for node 69e6af07dc041e577b77f67b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35754 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:57:51,000 - lava_callback - INFO - Received callback for node 69e6af5adc041e577b77f6a4 INFO: 172.20.0.1:44274 - "POST /node/69e6af5adc041e577b77f6a4 HTTP/1.0" 202 Accepted 2026-04-22 22:57:51,007 - lava_callback - INFO - Starting async job submit for node 69e6af5adc041e577b77f6a4 2026-04-22 22:57:51,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:57:51,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6af5adc041e577b77f6a4 HTTP/1.1" 200 None 2026-04-22 22:57:51,026 - lava_callback - DEBUG - Processing node 69e6af5adc041e577b77f6a4: baseline-arm64-clabbe 2026-04-22 22:57:51,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6af5adc041e577b77f6a4 2026-04-22 22:57:51,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:57:51,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6af5adc041e577b77f6a4 HTTP/1.1" 200 None 2026-04-22 22:57:51,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:57:51,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:57:51,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:57:51,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6af5adc041e577b77f6a4 HTTP/1.1" 200 None 2026-04-22 22:57:51,091 - lava_callback - ERROR - Error processing callback for node 69e6af5adc041e577b77f6a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK 2026-04-22 22:59:11,033 - lava_callback - INFO - Received callback for node 69e6afaddc041e577b77f6be INFO: 172.20.0.1:40142 - "POST /node/69e6afaddc041e577b77f6be HTTP/1.0" 202 Accepted 2026-04-22 22:59:11,038 - lava_callback - INFO - Starting async job submit for node 69e6afaddc041e577b77f6be 2026-04-22 22:59:11,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:59:11,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6afaddc041e577b77f6be HTTP/1.1" 200 None 2026-04-22 22:59:11,057 - lava_callback - DEBUG - Processing node 69e6afaddc041e577b77f6be: baseline-arm64-clabbe 2026-04-22 22:59:11,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6afaddc041e577b77f6be 2026-04-22 22:59:11,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:59:11,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6afaddc041e577b77f6be HTTP/1.1" 200 None 2026-04-22 22:59:11,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:59:11,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 22:59:11,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 22:59:11,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6afaddc041e577b77f6be HTTP/1.1" 200 None 2026-04-22 22:59:11,103 - lava_callback - ERROR - Error processing callback for node 69e6afaddc041e577b77f6be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43380 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:00:31,131 - lava_callback - INFO - Received callback for node 69e6b002dc041e577b77f6e2 INFO: 172.20.0.1:51024 - "POST /node/69e6b002dc041e577b77f6e2 HTTP/1.0" 202 Accepted 2026-04-22 23:00:31,136 - lava_callback - INFO - Starting async job submit for node 69e6b002dc041e577b77f6e2 2026-04-22 23:00:31,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:00:31,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b002dc041e577b77f6e2 HTTP/1.1" 200 None 2026-04-22 23:00:31,152 - lava_callback - DEBUG - Processing node 69e6b002dc041e577b77f6e2: baseline-arm64-clabbe 2026-04-22 23:00:31,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b002dc041e577b77f6e2 2026-04-22 23:00:31,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:00:31,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b002dc041e577b77f6e2 HTTP/1.1" 200 None 2026-04-22 23:00:31,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:00:31,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:00:31,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:00:31,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b002dc041e577b77f6e2 HTTP/1.1" 200 None 2026-04-22 23:00:31,203 - lava_callback - ERROR - Error processing callback for node 69e6b002dc041e577b77f6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:01:51,129 - lava_callback - INFO - Received callback for node 69e6b056dc041e577b77f709 INFO: 172.20.0.1:44152 - "POST /node/69e6b056dc041e577b77f709 HTTP/1.0" 202 Accepted 2026-04-22 23:01:51,139 - lava_callback - INFO - Starting async job submit for node 69e6b056dc041e577b77f709 2026-04-22 23:01:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:01:51,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b056dc041e577b77f709 HTTP/1.1" 200 None 2026-04-22 23:01:51,155 - lava_callback - DEBUG - Processing node 69e6b056dc041e577b77f709: baseline-arm64-clabbe 2026-04-22 23:01:51,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b056dc041e577b77f709 2026-04-22 23:01:51,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:01:51,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b056dc041e577b77f709 HTTP/1.1" 200 None 2026-04-22 23:01:51,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:01:51,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:01:51,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:01:51,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b056dc041e577b77f709 HTTP/1.1" 200 None 2026-04-22 23:01:51,224 - lava_callback - ERROR - Error processing callback for node 69e6b056dc041e577b77f709: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:03:11,173 - lava_callback - INFO - Received callback for node 69e6b0abdc041e577b77f72d INFO: 172.20.0.1:50350 - "POST /node/69e6b0abdc041e577b77f72d HTTP/1.0" 202 Accepted 2026-04-22 23:03:11,178 - lava_callback - INFO - Starting async job submit for node 69e6b0abdc041e577b77f72d 2026-04-22 23:03:11,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:03:11,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b0abdc041e577b77f72d HTTP/1.1" 200 None 2026-04-22 23:03:11,193 - lava_callback - DEBUG - Processing node 69e6b0abdc041e577b77f72d: baseline-arm64-clabbe 2026-04-22 23:03:11,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b0abdc041e577b77f72d 2026-04-22 23:03:11,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:03:11,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b0abdc041e577b77f72d HTTP/1.1" 200 None 2026-04-22 23:03:11,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:03:11,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:03:11,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:03:11,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b0abdc041e577b77f72d HTTP/1.1" 200 None 2026-04-22 23:03:11,241 - lava_callback - ERROR - Error processing callback for node 69e6b0abdc041e577b77f72d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36552 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:04:51,430 - lava_callback - INFO - Received callback for node 69e6b102dc041e577b77f74f INFO: 172.20.0.1:33328 - "POST /node/69e6b102dc041e577b77f74f HTTP/1.0" 202 Accepted 2026-04-22 23:04:51,435 - lava_callback - INFO - Starting async job submit for node 69e6b102dc041e577b77f74f 2026-04-22 23:04:51,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:04:51,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b102dc041e577b77f74f HTTP/1.1" 200 None 2026-04-22 23:04:51,450 - lava_callback - DEBUG - Processing node 69e6b102dc041e577b77f74f: baseline-arm64-clabbe 2026-04-22 23:04:51,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b102dc041e577b77f74f 2026-04-22 23:04:51,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:04:51,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b102dc041e577b77f74f HTTP/1.1" 200 None 2026-04-22 23:04:51,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:04:51,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:04:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:04:51,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b102dc041e577b77f74f HTTP/1.1" 200 None 2026-04-22 23:04:51,494 - lava_callback - ERROR - Error processing callback for node 69e6b102dc041e577b77f74f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57886 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:06:11,328 - lava_callback - INFO - Received callback for node 69e6b156dc041e577b77f775 INFO: 172.20.0.1:43636 - "POST /node/69e6b156dc041e577b77f775 HTTP/1.0" 202 Accepted 2026-04-22 23:06:11,334 - lava_callback - INFO - Starting async job submit for node 69e6b156dc041e577b77f775 2026-04-22 23:06:11,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:06:11,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b156dc041e577b77f775 HTTP/1.1" 200 None 2026-04-22 23:06:11,356 - lava_callback - DEBUG - Processing node 69e6b156dc041e577b77f775: baseline-arm64-clabbe 2026-04-22 23:06:11,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b156dc041e577b77f775 2026-04-22 23:06:11,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:06:11,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b156dc041e577b77f775 HTTP/1.1" 200 None 2026-04-22 23:06:11,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:06:11,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:06:11,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:06:11,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b156dc041e577b77f775 HTTP/1.1" 200 None 2026-04-22 23:06:11,416 - lava_callback - ERROR - Error processing callback for node 69e6b156dc041e577b77f775: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37036 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:07:31,343 - lava_callback - INFO - Received callback for node 69e6b1abdc041e577b77f791 INFO: 172.20.0.1:37718 - "POST /node/69e6b1abdc041e577b77f791 HTTP/1.0" 202 Accepted 2026-04-22 23:07:31,348 - lava_callback - INFO - Starting async job submit for node 69e6b1abdc041e577b77f791 2026-04-22 23:07:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:07:31,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b1abdc041e577b77f791 HTTP/1.1" 200 None 2026-04-22 23:07:31,375 - lava_callback - DEBUG - Processing node 69e6b1abdc041e577b77f791: baseline-arm64-clabbe 2026-04-22 23:07:31,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b1abdc041e577b77f791 2026-04-22 23:07:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:07:31,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b1abdc041e577b77f791 HTTP/1.1" 200 None 2026-04-22 23:07:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:07:31,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:07:31,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:07:31,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b1abdc041e577b77f791 HTTP/1.1" 200 None 2026-04-22 23:07:31,422 - lava_callback - ERROR - Error processing callback for node 69e6b1abdc041e577b77f791: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46234 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:08:51,461 - lava_callback - INFO - Received callback for node 69e6b1ffdc041e577b77f7b2 INFO: 172.20.0.1:45656 - "POST /node/69e6b1ffdc041e577b77f7b2 HTTP/1.0" 202 Accepted 2026-04-22 23:08:51,467 - lava_callback - INFO - Starting async job submit for node 69e6b1ffdc041e577b77f7b2 2026-04-22 23:08:51,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:08:51,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b1ffdc041e577b77f7b2 HTTP/1.1" 200 None 2026-04-22 23:08:51,482 - lava_callback - DEBUG - Processing node 69e6b1ffdc041e577b77f7b2: baseline-arm64-clabbe 2026-04-22 23:08:51,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b1ffdc041e577b77f7b2 2026-04-22 23:08:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:08:51,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b1ffdc041e577b77f7b2 HTTP/1.1" 200 None 2026-04-22 23:08:51,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:08:51,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:08:51,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:08:51,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b1ffdc041e577b77f7b2 HTTP/1.1" 200 None 2026-04-22 23:08:51,535 - lava_callback - ERROR - Error processing callback for node 69e6b1ffdc041e577b77f7b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34894 - "GET /node/6993688bcebe99dd8e06645b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET /node/69118d4ef15111fc8ce4c1e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:17:11,708 - lava_callback - INFO - Received callback for node 69e6b3f4dc041e577b77f8a0 INFO: 172.20.0.1:36800 - "POST /node/69e6b3f4dc041e577b77f8a0 HTTP/1.0" 202 Accepted 2026-04-22 23:17:11,714 - lava_callback - INFO - Starting async job submit for node 69e6b3f4dc041e577b77f8a0 2026-04-22 23:17:11,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:17:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b3f4dc041e577b77f8a0 HTTP/1.1" 200 None 2026-04-22 23:17:11,730 - lava_callback - DEBUG - Processing node 69e6b3f4dc041e577b77f8a0: baseline-arm64-clabbe 2026-04-22 23:17:11,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b3f4dc041e577b77f8a0 2026-04-22 23:17:11,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:17:11,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b3f4dc041e577b77f8a0 HTTP/1.1" 200 None 2026-04-22 23:17:11,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:17:11,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e33e363745d1193f227399 HTTP/1.1" 200 None 2026-04-22 23:17:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:17:11,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b3f4dc041e577b77f8a0 HTTP/1.1" 200 None 2026-04-22 23:17:11,775 - lava_callback - ERROR - Error processing callback for node 69e6b3f4dc041e577b77f8a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54890 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:19:57,039 - lava_callback - INFO - Received callback for node 69e6b491dc041e577b77f8f7 INFO: 172.20.0.1:54902 - "POST /node/69e6b491dc041e577b77f8f7 HTTP/1.0" 202 Accepted 2026-04-22 23:19:57,044 - lava_callback - INFO - Starting async job submit for node 69e6b491dc041e577b77f8f7 2026-04-22 23:19:57,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:19:57,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b491dc041e577b77f8f7 HTTP/1.1" 200 None 2026-04-22 23:19:57,059 - lava_callback - DEBUG - Processing node 69e6b491dc041e577b77f8f7: baseline-arm64-baylibre 2026-04-22 23:19:57,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b491dc041e577b77f8f7 2026-04-22 23:19:57,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:19:57,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b491dc041e577b77f8f7 HTTP/1.1" 200 None 2026-04-22 23:19:57,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:19:57,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:19:57,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:19:57,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b491dc041e577b77f8f7 HTTP/1.1" 200 None 2026-04-22 23:19:57,118 - lava_callback - ERROR - Error processing callback for node 69e6b491dc041e577b77f8f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59258 - "GET /node/698a8513d9a1cfa777a23bfa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40298 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:21:17,025 - lava_callback - INFO - Received callback for node 69e6b4e3dc041e577b77f925 INFO: 172.20.0.1:40312 - "POST /node/69e6b4e3dc041e577b77f925 HTTP/1.0" 202 Accepted 2026-04-22 23:21:17,032 - lava_callback - INFO - Starting async job submit for node 69e6b4e3dc041e577b77f925 2026-04-22 23:21:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:21:17,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b4e3dc041e577b77f925 HTTP/1.1" 200 None 2026-04-22 23:21:17,053 - lava_callback - DEBUG - Processing node 69e6b4e3dc041e577b77f925: baseline-arm64-baylibre 2026-04-22 23:21:17,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b4e3dc041e577b77f925 2026-04-22 23:21:17,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:21:17,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b4e3dc041e577b77f925 HTTP/1.1" 200 None 2026-04-22 23:21:17,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:21:17,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:21:17,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:21:17,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b4e3dc041e577b77f925 HTTP/1.1" 200 None 2026-04-22 23:21:17,120 - lava_callback - ERROR - Error processing callback for node 69e6b4e3dc041e577b77f925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET /node/693e5bbd407f32424eb6454c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52676 - "GET /node/691ac7018dbc6bccc0a0e9e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:22:37,188 - lava_callback - INFO - Received callback for node 69e6b534dc041e577b77f94a INFO: 172.20.0.1:60010 - "POST /node/69e6b534dc041e577b77f94a HTTP/1.0" 202 Accepted 2026-04-22 23:22:37,196 - lava_callback - INFO - Starting async job submit for node 69e6b534dc041e577b77f94a 2026-04-22 23:22:37,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:22:37,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b534dc041e577b77f94a HTTP/1.1" 200 None 2026-04-22 23:22:37,212 - lava_callback - DEBUG - Processing node 69e6b534dc041e577b77f94a: baseline-arm64-baylibre 2026-04-22 23:22:37,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b534dc041e577b77f94a 2026-04-22 23:22:37,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:22:37,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b534dc041e577b77f94a HTTP/1.1" 200 None 2026-04-22 23:22:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:22:37,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:22:37,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:22:37,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b534dc041e577b77f94a HTTP/1.1" 200 None 2026-04-22 23:22:37,260 - lava_callback - ERROR - Error processing callback for node 69e6b534dc041e577b77f94a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:23:57,191 - lava_callback - INFO - Received callback for node 69e6b58adc041e577b77f969 INFO: 172.20.0.1:54706 - "POST /node/69e6b58adc041e577b77f969 HTTP/1.0" 202 Accepted 2026-04-22 23:23:57,197 - lava_callback - INFO - Starting async job submit for node 69e6b58adc041e577b77f969 2026-04-22 23:23:57,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:23:57,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b58adc041e577b77f969 HTTP/1.1" 200 None 2026-04-22 23:23:57,213 - lava_callback - DEBUG - Processing node 69e6b58adc041e577b77f969: baseline-arm64-baylibre 2026-04-22 23:23:57,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b58adc041e577b77f969 2026-04-22 23:23:57,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:23:57,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b58adc041e577b77f969 HTTP/1.1" 200 None 2026-04-22 23:23:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:23:57,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:23:57,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:23:57,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b58adc041e577b77f969 HTTP/1.1" 200 None 2026-04-22 23:23:57,268 - lava_callback - ERROR - Error processing callback for node 69e6b58adc041e577b77f969: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33820 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:25:37,295 - lava_callback - INFO - Received callback for node 69e6b5dddc041e577b77f98d INFO: 172.20.0.1:33830 - "POST /node/69e6b5dddc041e577b77f98d HTTP/1.0" 202 Accepted 2026-04-22 23:25:37,300 - lava_callback - INFO - Starting async job submit for node 69e6b5dddc041e577b77f98d 2026-04-22 23:25:37,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:25:37,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b5dddc041e577b77f98d HTTP/1.1" 200 None 2026-04-22 23:25:37,321 - lava_callback - DEBUG - Processing node 69e6b5dddc041e577b77f98d: baseline-arm64-baylibre 2026-04-22 23:25:37,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b5dddc041e577b77f98d 2026-04-22 23:25:37,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:25:37,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b5dddc041e577b77f98d HTTP/1.1" 200 None 2026-04-22 23:25:37,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:25:37,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:25:37,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:25:37,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b5dddc041e577b77f98d HTTP/1.1" 200 None 2026-04-22 23:25:37,379 - lava_callback - ERROR - Error processing callback for node 69e6b5dddc041e577b77f98d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:28:17,444 - lava_callback - INFO - Received callback for node 69e6b682dc041e577b77f9d3 INFO: 172.20.0.1:46454 - "POST /node/69e6b682dc041e577b77f9d3 HTTP/1.0" 202 Accepted 2026-04-22 23:28:17,450 - lava_callback - INFO - Starting async job submit for node 69e6b682dc041e577b77f9d3 2026-04-22 23:28:17,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:28:17,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b682dc041e577b77f9d3 HTTP/1.1" 200 None 2026-04-22 23:28:17,465 - lava_callback - DEBUG - Processing node 69e6b682dc041e577b77f9d3: baseline-arm64-baylibre 2026-04-22 23:28:17,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b682dc041e577b77f9d3 2026-04-22 23:28:17,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:28:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b682dc041e577b77f9d3 HTTP/1.1" 200 None 2026-04-22 23:28:17,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:28:17,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:28:17,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:28:17,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b682dc041e577b77f9d3 HTTP/1.1" 200 None 2026-04-22 23:28:17,520 - lava_callback - ERROR - Error processing callback for node 69e6b682dc041e577b77f9d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53192 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:29:52,290 - lava_callback - INFO - Received callback for node 69e6b6dcdc041e577b77f9fc INFO: 172.20.0.1:41506 - "POST /node/69e6b6dcdc041e577b77f9fc HTTP/1.0" 202 Accepted 2026-04-22 23:29:52,296 - lava_callback - INFO - Starting async job submit for node 69e6b6dcdc041e577b77f9fc 2026-04-22 23:29:52,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:29:52,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b6dcdc041e577b77f9fc HTTP/1.1" 200 None 2026-04-22 23:29:52,319 - lava_callback - DEBUG - Processing node 69e6b6dcdc041e577b77f9fc: baseline-arm64-clabbe 2026-04-22 23:29:52,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b6dcdc041e577b77f9fc 2026-04-22 23:29:52,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:29:52,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b6dcdc041e577b77f9fc HTTP/1.1" 200 None 2026-04-22 23:29:52,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:29:52,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:29:52,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:29:52,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b6dcdc041e577b77f9fc HTTP/1.1" 200 None 2026-04-22 23:29:52,365 - lava_callback - ERROR - Error processing callback for node 69e6b6dcdc041e577b77f9fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37182 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:31:12,310 - lava_callback - INFO - Received callback for node 69e6b731dc041e577b77fa1f INFO: 172.20.0.1:58322 - "POST /node/69e6b731dc041e577b77fa1f HTTP/1.0" 202 Accepted 2026-04-22 23:31:12,316 - lava_callback - INFO - Starting async job submit for node 69e6b731dc041e577b77fa1f 2026-04-22 23:31:12,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:31:12,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b731dc041e577b77fa1f HTTP/1.1" 200 None 2026-04-22 23:31:12,344 - lava_callback - DEBUG - Processing node 69e6b731dc041e577b77fa1f: baseline-arm64-clabbe 2026-04-22 23:31:12,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b731dc041e577b77fa1f 2026-04-22 23:31:12,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:31:12,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b731dc041e577b77fa1f HTTP/1.1" 200 None 2026-04-22 23:31:12,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:31:12,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:31:12,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:31:12,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b731dc041e577b77fa1f HTTP/1.1" 200 None 2026-04-22 23:31:12,415 - lava_callback - ERROR - Error processing callback for node 69e6b731dc041e577b77fa1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:32:32,335 - lava_callback - INFO - Received callback for node 69e6b784dc041e577b77fa40 INFO: 172.20.0.1:54912 - "POST /node/69e6b784dc041e577b77fa40 HTTP/1.0" 202 Accepted 2026-04-22 23:32:32,345 - lava_callback - INFO - Starting async job submit for node 69e6b784dc041e577b77fa40 2026-04-22 23:32:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:32:32,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b784dc041e577b77fa40 HTTP/1.1" 200 None 2026-04-22 23:32:32,366 - lava_callback - DEBUG - Processing node 69e6b784dc041e577b77fa40: baseline-arm64-clabbe 2026-04-22 23:32:32,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b784dc041e577b77fa40 2026-04-22 23:32:32,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:32:32,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b784dc041e577b77fa40 HTTP/1.1" 200 None 2026-04-22 23:32:32,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:32:32,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:32:32,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:32:32,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b784dc041e577b77fa40 HTTP/1.1" 200 None 2026-04-22 23:32:32,427 - lava_callback - ERROR - Error processing callback for node 69e6b784dc041e577b77fa40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:33:52,525 - lava_callback - INFO - Received callback for node 69e6b7d7dc041e577b77fa70 INFO: 172.20.0.1:53384 - "POST /node/69e6b7d7dc041e577b77fa70 HTTP/1.0" 202 Accepted 2026-04-22 23:33:52,533 - lava_callback - INFO - Starting async job submit for node 69e6b7d7dc041e577b77fa70 2026-04-22 23:33:52,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:33:52,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b7d7dc041e577b77fa70 HTTP/1.1" 200 None 2026-04-22 23:33:52,559 - lava_callback - DEBUG - Processing node 69e6b7d7dc041e577b77fa70: baseline-arm64-clabbe 2026-04-22 23:33:52,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b7d7dc041e577b77fa70 2026-04-22 23:33:52,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:33:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b7d7dc041e577b77fa70 HTTP/1.1" 200 None 2026-04-22 23:33:52,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:33:52,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:33:52,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:33:52,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b7d7dc041e577b77fa70 HTTP/1.1" 200 None 2026-04-22 23:33:52,613 - lava_callback - ERROR - Error processing callback for node 69e6b7d7dc041e577b77fa70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34068 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:35:12,429 - lava_callback - INFO - Received callback for node 69e6b828dc041e577b77fa99 INFO: 172.20.0.1:49792 - "POST /node/69e6b828dc041e577b77fa99 HTTP/1.0" 202 Accepted 2026-04-22 23:35:12,434 - lava_callback - INFO - Starting async job submit for node 69e6b828dc041e577b77fa99 2026-04-22 23:35:12,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:35:12,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b828dc041e577b77fa99 HTTP/1.1" 200 None 2026-04-22 23:35:12,449 - lava_callback - DEBUG - Processing node 69e6b828dc041e577b77fa99: baseline-arm64-clabbe 2026-04-22 23:35:12,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b828dc041e577b77fa99 2026-04-22 23:35:12,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:35:12,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b828dc041e577b77fa99 HTTP/1.1" 200 None 2026-04-22 23:35:12,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:35:12,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:35:12,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:35:12,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b828dc041e577b77fa99 HTTP/1.1" 200 None 2026-04-22 23:35:12,497 - lava_callback - ERROR - Error processing callback for node 69e6b828dc041e577b77fa99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51626 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:36:52,519 - lava_callback - INFO - Received callback for node 69e6b87fdc041e577b77fac4 INFO: 172.20.0.1:36304 - "POST /node/69e6b87fdc041e577b77fac4 HTTP/1.0" 202 Accepted 2026-04-22 23:36:52,524 - lava_callback - INFO - Starting async job submit for node 69e6b87fdc041e577b77fac4 2026-04-22 23:36:52,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:36:52,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b87fdc041e577b77fac4 HTTP/1.1" 200 None 2026-04-22 23:36:52,539 - lava_callback - DEBUG - Processing node 69e6b87fdc041e577b77fac4: baseline-arm64-clabbe 2026-04-22 23:36:52,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b87fdc041e577b77fac4 2026-04-22 23:36:52,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:36:52,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b87fdc041e577b77fac4 HTTP/1.1" 200 None 2026-04-22 23:36:52,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:36:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:36:52,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:36:52,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b87fdc041e577b77fac4 HTTP/1.1" 200 None 2026-04-22 23:36:52,592 - lava_callback - ERROR - Error processing callback for node 69e6b87fdc041e577b77fac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60034 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:38:12,616 - lava_callback - INFO - Received callback for node 69e6b8d4dc041e577b77faed INFO: 172.20.0.1:43838 - "POST /node/69e6b8d4dc041e577b77faed HTTP/1.0" 202 Accepted 2026-04-22 23:38:12,622 - lava_callback - INFO - Starting async job submit for node 69e6b8d4dc041e577b77faed 2026-04-22 23:38:12,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:38:12,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b8d4dc041e577b77faed HTTP/1.1" 200 None 2026-04-22 23:38:12,637 - lava_callback - DEBUG - Processing node 69e6b8d4dc041e577b77faed: baseline-arm64-clabbe 2026-04-22 23:38:12,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6b8d4dc041e577b77faed 2026-04-22 23:38:12,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:38:12,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6b8d4dc041e577b77faed HTTP/1.1" 200 None 2026-04-22 23:38:12,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:38:12,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5e136ab69ed7ddbbc37d4 HTTP/1.1" 200 None 2026-04-22 23:38:12,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:38:12,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6b8d4dc041e577b77faed HTTP/1.1" 200 None 2026-04-22 23:38:12,695 - lava_callback - ERROR - Error processing callback for node 69e6b8d4dc041e577b77faed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45472 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:45:38,464 - lava_callback - INFO - Received callback for node 69e6baa0dc041e577b77fbdd INFO: 172.20.0.1:45488 - "POST /node/69e6baa0dc041e577b77fbdd HTTP/1.0" 202 Accepted 2026-04-22 23:45:38,470 - lava_callback - INFO - Starting async job submit for node 69e6baa0dc041e577b77fbdd 2026-04-22 23:45:38,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:45:38,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6baa0dc041e577b77fbdd HTTP/1.1" 200 None 2026-04-22 23:45:38,485 - lava_callback - DEBUG - Processing node 69e6baa0dc041e577b77fbdd: baseline-arm-baylibre 2026-04-22 23:45:38,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6baa0dc041e577b77fbdd 2026-04-22 23:45:38,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:45:38,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6baa0dc041e577b77fbdd HTTP/1.1" 200 None 2026-04-22 23:45:38,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:45:38,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:45:38,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:45:38,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6baa0dc041e577b77fbdd HTTP/1.1" 200 None 2026-04-22 23:45:38,531 - lava_callback - ERROR - Error processing callback for node 69e6baa0dc041e577b77fbdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:48:18,527 - lava_callback - INFO - Received callback for node 69e6bb35dc041e577b77fc23 INFO: 172.20.0.1:56862 - "POST /node/69e6bb35dc041e577b77fc23 HTTP/1.0" 202 Accepted 2026-04-22 23:48:18,533 - lava_callback - INFO - Starting async job submit for node 69e6bb35dc041e577b77fc23 2026-04-22 23:48:18,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:48:18,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bb35dc041e577b77fc23 HTTP/1.1" 200 None 2026-04-22 23:48:18,556 - lava_callback - DEBUG - Processing node 69e6bb35dc041e577b77fc23: baseline-arm-baylibre 2026-04-22 23:48:18,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bb35dc041e577b77fc23 2026-04-22 23:48:18,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:48:18,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bb35dc041e577b77fc23 HTTP/1.1" 200 None 2026-04-22 23:48:18,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:48:18,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:48:18,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:48:18,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bb35dc041e577b77fc23 HTTP/1.1" 200 None 2026-04-22 23:48:18,636 - lava_callback - ERROR - Error processing callback for node 69e6bb35dc041e577b77fc23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:49:18,549 - lava_callback - INFO - Received callback for node 69e6bb7cdc041e577b77fc45 INFO: 172.20.0.1:35296 - "POST /node/69e6bb7cdc041e577b77fc45 HTTP/1.0" 202 Accepted 2026-04-22 23:49:18,555 - lava_callback - INFO - Starting async job submit for node 69e6bb7cdc041e577b77fc45 2026-04-22 23:49:18,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:49:18,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bb7cdc041e577b77fc45 HTTP/1.1" 200 None 2026-04-22 23:49:18,570 - lava_callback - DEBUG - Processing node 69e6bb7cdc041e577b77fc45: baseline-arm-baylibre 2026-04-22 23:49:18,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bb7cdc041e577b77fc45 2026-04-22 23:49:18,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:49:18,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bb7cdc041e577b77fc45 HTTP/1.1" 200 None 2026-04-22 23:49:18,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:49:18,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:49:18,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:49:18,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bb7cdc041e577b77fc45 HTTP/1.1" 200 None 2026-04-22 23:49:18,622 - lava_callback - ERROR - Error processing callback for node 69e6bb7cdc041e577b77fc45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42274 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:50:38,671 - lava_callback - INFO - Received callback for node 69e6bbc3dc041e577b77fc74 INFO: 172.20.0.1:42278 - "POST /node/69e6bbc3dc041e577b77fc74 HTTP/1.0" 202 Accepted 2026-04-22 23:50:38,681 - lava_callback - INFO - Starting async job submit for node 69e6bbc3dc041e577b77fc74 2026-04-22 23:50:38,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:50:38,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bbc3dc041e577b77fc74 HTTP/1.1" 200 None 2026-04-22 23:50:38,700 - lava_callback - DEBUG - Processing node 69e6bbc3dc041e577b77fc74: baseline-arm-baylibre 2026-04-22 23:50:38,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bbc3dc041e577b77fc74 2026-04-22 23:50:38,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:50:38,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bbc3dc041e577b77fc74 HTTP/1.1" 200 None 2026-04-22 23:50:38,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:50:42,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:50:42,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:50:42,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bbc3dc041e577b77fc74 HTTP/1.1" 200 None 2026-04-22 23:50:42,755 - lava_callback - ERROR - Error processing callback for node 69e6bbc3dc041e577b77fc74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39514 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:51:18,669 - lava_callback - INFO - Received callback for node 69e6bbe6dc041e577b77fc84 INFO: 172.20.0.1:39528 - "POST /node/69e6bbe6dc041e577b77fc84 HTTP/1.0" 202 Accepted 2026-04-22 23:51:18,675 - lava_callback - INFO - Starting async job submit for node 69e6bbe6dc041e577b77fc84 2026-04-22 23:51:18,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:51:18,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bbe6dc041e577b77fc84 HTTP/1.1" 200 None 2026-04-22 23:51:18,690 - lava_callback - DEBUG - Processing node 69e6bbe6dc041e577b77fc84: baseline-arm-baylibre 2026-04-22 23:51:18,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bbe6dc041e577b77fc84 2026-04-22 23:51:18,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:51:18,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bbe6dc041e577b77fc84 HTTP/1.1" 200 None 2026-04-22 23:51:18,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:51:18,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:51:18,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:51:18,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bbe6dc041e577b77fc84 HTTP/1.1" 200 None 2026-04-22 23:51:18,755 - lava_callback - ERROR - Error processing callback for node 69e6bbe6dc041e577b77fc84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:54:13,237 - lava_callback - INFO - Received callback for node 69e6bca0dc041e577b77fceb INFO: 172.20.0.1:42560 - "POST /node/69e6bca0dc041e577b77fceb HTTP/1.0" 202 Accepted 2026-04-22 23:54:13,243 - lava_callback - INFO - Starting async job submit for node 69e6bca0dc041e577b77fceb 2026-04-22 23:54:13,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:13,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bca0dc041e577b77fceb HTTP/1.1" 200 None 2026-04-22 23:54:13,258 - lava_callback - DEBUG - Processing node 69e6bca0dc041e577b77fceb: baseline-arm-clabbe 2026-04-22 23:54:13,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bca0dc041e577b77fceb 2026-04-22 23:54:13,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:13,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bca0dc041e577b77fceb HTTP/1.1" 200 None 2026-04-22 23:54:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:13,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:54:13,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:13,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bca0dc041e577b77fceb HTTP/1.1" 200 None 2026-04-22 23:54:13,307 - lava_callback - ERROR - Error processing callback for node 69e6bca0dc041e577b77fceb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:54:53,206 - lava_callback - INFO - Received callback for node 69e6bcc5dc041e577b77fd01 INFO: 172.20.0.1:55834 - "POST /node/69e6bcc5dc041e577b77fd01 HTTP/1.0" 202 Accepted 2026-04-22 23:54:53,211 - lava_callback - INFO - Starting async job submit for node 69e6bcc5dc041e577b77fd01 2026-04-22 23:54:53,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:53,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bcc5dc041e577b77fd01 HTTP/1.1" 200 None 2026-04-22 23:54:53,226 - lava_callback - DEBUG - Processing node 69e6bcc5dc041e577b77fd01: baseline-arm-clabbe 2026-04-22 23:54:53,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bcc5dc041e577b77fd01 2026-04-22 23:54:53,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:53,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bcc5dc041e577b77fd01 HTTP/1.1" 200 None 2026-04-22 23:54:53,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:53,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:54:53,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:54:53,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bcc5dc041e577b77fd01 HTTP/1.1" 200 None 2026-04-22 23:54:53,276 - lava_callback - ERROR - Error processing callback for node 69e6bcc5dc041e577b77fd01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:55:33,256 - lava_callback - INFO - Received callback for node 69e6bce9dc041e577b77fd15 INFO: 172.20.0.1:60722 - "POST /node/69e6bce9dc041e577b77fd15 HTTP/1.0" 202 Accepted 2026-04-22 23:55:33,261 - lava_callback - INFO - Starting async job submit for node 69e6bce9dc041e577b77fd15 2026-04-22 23:55:33,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:55:33,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bce9dc041e577b77fd15 HTTP/1.1" 200 None 2026-04-22 23:55:33,276 - lava_callback - DEBUG - Processing node 69e6bce9dc041e577b77fd15: baseline-arm-clabbe 2026-04-22 23:55:33,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bce9dc041e577b77fd15 2026-04-22 23:55:33,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:55:33,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bce9dc041e577b77fd15 HTTP/1.1" 200 None 2026-04-22 23:55:33,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:55:33,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:55:33,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:55:33,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bce9dc041e577b77fd15 HTTP/1.1" 200 None 2026-04-22 23:55:33,320 - lava_callback - ERROR - Error processing callback for node 69e6bce9dc041e577b77fd15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37290 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:56:13,262 - lava_callback - INFO - Received callback for node 69e6bd0edc041e577b77fd35 INFO: 172.20.0.1:46300 - "POST /node/69e6bd0edc041e577b77fd35 HTTP/1.0" 202 Accepted 2026-04-22 23:56:13,267 - lava_callback - INFO - Starting async job submit for node 69e6bd0edc041e577b77fd35 2026-04-22 23:56:13,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:13,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd0edc041e577b77fd35 HTTP/1.1" 200 None 2026-04-22 23:56:13,282 - lava_callback - DEBUG - Processing node 69e6bd0edc041e577b77fd35: baseline-arm-clabbe 2026-04-22 23:56:13,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bd0edc041e577b77fd35 2026-04-22 23:56:13,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:13,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd0edc041e577b77fd35 HTTP/1.1" 200 None 2026-04-22 23:56:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:56:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:13,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bd0edc041e577b77fd35 HTTP/1.1" 200 None 2026-04-22 23:56:13,334 - lava_callback - ERROR - Error processing callback for node 69e6bd0edc041e577b77fd35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:56:53,335 - lava_callback - INFO - Received callback for node 69e6bd33dc041e577b77fd43 INFO: 172.20.0.1:39142 - "POST /node/69e6bd33dc041e577b77fd43 HTTP/1.0" 202 Accepted 2026-04-22 23:56:53,341 - lava_callback - INFO - Starting async job submit for node 69e6bd33dc041e577b77fd43 2026-04-22 23:56:53,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:53,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd33dc041e577b77fd43 HTTP/1.1" 200 None 2026-04-22 23:56:53,364 - lava_callback - DEBUG - Processing node 69e6bd33dc041e577b77fd43: baseline-arm-clabbe 2026-04-22 23:56:53,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bd33dc041e577b77fd43 2026-04-22 23:56:53,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:53,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd33dc041e577b77fd43 HTTP/1.1" 200 None 2026-04-22 23:56:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:53,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:56:53,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:56:53,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bd33dc041e577b77fd43 HTTP/1.1" 200 None 2026-04-22 23:56:53,409 - lava_callback - ERROR - Error processing callback for node 69e6bd33dc041e577b77fd43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:57:33,303 - lava_callback - INFO - Received callback for node 69e6bd58dc041e577b77fd59 INFO: 172.20.0.1:36502 - "POST /node/69e6bd58dc041e577b77fd59 HTTP/1.0" 202 Accepted 2026-04-22 23:57:33,309 - lava_callback - INFO - Starting async job submit for node 69e6bd58dc041e577b77fd59 2026-04-22 23:57:33,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:33,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd58dc041e577b77fd59 HTTP/1.1" 200 None 2026-04-22 23:57:33,330 - lava_callback - DEBUG - Processing node 69e6bd58dc041e577b77fd59: baseline-arm-clabbe 2026-04-22 23:57:33,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bd58dc041e577b77fd59 2026-04-22 23:57:33,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:33,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd58dc041e577b77fd59 HTTP/1.1" 200 None 2026-04-22 23:57:33,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:33,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:57:33,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:33,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bd58dc041e577b77fd59 HTTP/1.1" 200 None 2026-04-22 23:57:33,384 - lava_callback - ERROR - Error processing callback for node 69e6bd58dc041e577b77fd59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56094 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:57:53,376 - lava_callback - INFO - Received callback for node 69e6bd7ddc041e577b77fd6f INFO: 172.20.0.1:48212 - "POST /node/69e6bd7ddc041e577b77fd6f HTTP/1.0" 202 Accepted 2026-04-22 23:57:53,382 - lava_callback - INFO - Starting async job submit for node 69e6bd7ddc041e577b77fd6f 2026-04-22 23:57:53,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:53,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd7ddc041e577b77fd6f HTTP/1.1" 200 None 2026-04-22 23:57:53,397 - lava_callback - DEBUG - Processing node 69e6bd7ddc041e577b77fd6f: baseline-arm-clabbe 2026-04-22 23:57:53,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bd7ddc041e577b77fd6f 2026-04-22 23:57:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:53,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bd7ddc041e577b77fd6f HTTP/1.1" 200 None 2026-04-22 23:57:53,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:53,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:57:53,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:57:53,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bd7ddc041e577b77fd6f HTTP/1.1" 200 None 2026-04-22 23:57:53,443 - lava_callback - ERROR - Error processing callback for node 69e6bd7ddc041e577b77fd6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40020 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:58:33,366 - lava_callback - INFO - Received callback for node 69e6bda2dc041e577b77fd82 INFO: 172.20.0.1:34930 - "POST /node/69e6bda2dc041e577b77fd82 HTTP/1.0" 202 Accepted 2026-04-22 23:58:33,372 - lava_callback - INFO - Starting async job submit for node 69e6bda2dc041e577b77fd82 2026-04-22 23:58:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:58:33,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bda2dc041e577b77fd82 HTTP/1.1" 200 None 2026-04-22 23:58:33,386 - lava_callback - DEBUG - Processing node 69e6bda2dc041e577b77fd82: baseline-arm-clabbe 2026-04-22 23:58:33,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bda2dc041e577b77fd82 2026-04-22 23:58:33,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:58:33,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bda2dc041e577b77fd82 HTTP/1.1" 200 None 2026-04-22 23:58:33,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:58:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:58:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:58:33,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bda2dc041e577b77fd82 HTTP/1.1" 200 None 2026-04-22 23:58:33,433 - lava_callback - ERROR - Error processing callback for node 69e6bda2dc041e577b77fd82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:59:13,425 - lava_callback - INFO - Received callback for node 69e6bdc6dc041e577b77fd9e INFO: 172.20.0.1:35060 - "POST /node/69e6bdc6dc041e577b77fd9e HTTP/1.0" 202 Accepted 2026-04-22 23:59:13,431 - lava_callback - INFO - Starting async job submit for node 69e6bdc6dc041e577b77fd9e 2026-04-22 23:59:13,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:13,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bdc6dc041e577b77fd9e HTTP/1.1" 200 None 2026-04-22 23:59:13,447 - lava_callback - DEBUG - Processing node 69e6bdc6dc041e577b77fd9e: baseline-arm-clabbe 2026-04-22 23:59:13,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bdc6dc041e577b77fd9e 2026-04-22 23:59:13,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:13,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bdc6dc041e577b77fd9e HTTP/1.1" 200 None 2026-04-22 23:59:13,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:13,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:59:13,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:13,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bdc6dc041e577b77fd9e HTTP/1.1" 200 None 2026-04-22 23:59:13,501 - lava_callback - ERROR - Error processing callback for node 69e6bdc6dc041e577b77fd9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET / HTTP/1.0" 200 OK 2026-04-22 23:59:53,391 - lava_callback - INFO - Received callback for node 69e6bdeadc041e577b77fdb1 INFO: 172.20.0.1:53484 - "POST /node/69e6bdeadc041e577b77fdb1 HTTP/1.0" 202 Accepted 2026-04-22 23:59:53,396 - lava_callback - INFO - Starting async job submit for node 69e6bdeadc041e577b77fdb1 2026-04-22 23:59:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:53,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bdeadc041e577b77fdb1 HTTP/1.1" 200 None 2026-04-22 23:59:53,412 - lava_callback - DEBUG - Processing node 69e6bdeadc041e577b77fdb1: baseline-arm-clabbe 2026-04-22 23:59:53,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bdeadc041e577b77fdb1 2026-04-22 23:59:53,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:53,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bdeadc041e577b77fdb1 HTTP/1.1" 200 None 2026-04-22 23:59:53,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:53,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-22 23:59:53,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 23:59:53,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bdeadc041e577b77fdb1 HTTP/1.1" 200 None 2026-04-22 23:59:53,463 - lava_callback - ERROR - Error processing callback for node 69e6bdeadc041e577b77fdb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:00:33,677 - lava_callback - INFO - Received callback for node 69e6be0fdc041e577b77fdc7 INFO: 172.20.0.1:40924 - "POST /node/69e6be0fdc041e577b77fdc7 HTTP/1.0" 202 Accepted 2026-04-23 00:00:33,687 - lava_callback - INFO - Starting async job submit for node 69e6be0fdc041e577b77fdc7 2026-04-23 00:00:33,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:00:33,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6be0fdc041e577b77fdc7 HTTP/1.1" 200 None 2026-04-23 00:00:33,722 - lava_callback - DEBUG - Processing node 69e6be0fdc041e577b77fdc7: baseline-arm-clabbe 2026-04-23 00:00:33,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6be0fdc041e577b77fdc7 2026-04-23 00:00:33,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:00:33,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6be0fdc041e577b77fdc7 HTTP/1.1" 200 None 2026-04-23 00:00:33,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:00:33,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:00:33,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:00:33,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6be0fdc041e577b77fdc7 HTTP/1.1" 200 None 2026-04-23 00:00:33,814 - lava_callback - ERROR - Error processing callback for node 69e6be0fdc041e577b77fdc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:02:33,498 - lava_callback - INFO - Received callback for node 69e6be86dc041e577b77fe0f INFO: 172.20.0.1:45550 - "POST /node/69e6be86dc041e577b77fe0f HTTP/1.0" 202 Accepted 2026-04-23 00:02:33,507 - lava_callback - INFO - Starting async job submit for node 69e6be86dc041e577b77fe0f 2026-04-23 00:02:33,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:02:33,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6be86dc041e577b77fe0f HTTP/1.1" 200 None 2026-04-23 00:02:33,527 - lava_callback - DEBUG - Processing node 69e6be86dc041e577b77fe0f: baseline-arm-clabbe 2026-04-23 00:02:33,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6be86dc041e577b77fe0f 2026-04-23 00:02:33,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:02:33,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6be86dc041e577b77fe0f HTTP/1.1" 200 None 2026-04-23 00:02:33,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:02:33,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:02:33,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:02:33,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6be86dc041e577b77fe0f HTTP/1.1" 200 None 2026-04-23 00:02:33,606 - lava_callback - ERROR - Error processing callback for node 69e6be86dc041e577b77fe0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40184 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:03:13,539 - lava_callback - INFO - Received callback for node 69e6beacdc041e577b77fe24 INFO: 172.20.0.1:41074 - "POST /node/69e6beacdc041e577b77fe24 HTTP/1.0" 202 Accepted 2026-04-23 00:03:13,548 - lava_callback - INFO - Starting async job submit for node 69e6beacdc041e577b77fe24 2026-04-23 00:03:13,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:13,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6beacdc041e577b77fe24 HTTP/1.1" 200 None 2026-04-23 00:03:13,567 - lava_callback - DEBUG - Processing node 69e6beacdc041e577b77fe24: baseline-arm-clabbe 2026-04-23 00:03:13,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6beacdc041e577b77fe24 2026-04-23 00:03:13,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:13,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6beacdc041e577b77fe24 HTTP/1.1" 200 None 2026-04-23 00:03:13,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:13,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:03:13,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6beacdc041e577b77fe24 HTTP/1.1" 200 None 2026-04-23 00:03:13,623 - lava_callback - ERROR - Error processing callback for node 69e6beacdc041e577b77fe24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36986 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:03:39,433 - lava_callback - INFO - Received callback for node 69e6bed6dc041e577b77fe3c INFO: 172.20.0.1:37002 - "POST /node/69e6bed6dc041e577b77fe3c HTTP/1.0" 202 Accepted 2026-04-23 00:03:39,438 - lava_callback - INFO - Starting async job submit for node 69e6bed6dc041e577b77fe3c 2026-04-23 00:03:39,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:39,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bed6dc041e577b77fe3c HTTP/1.1" 200 None 2026-04-23 00:03:39,454 - lava_callback - DEBUG - Processing node 69e6bed6dc041e577b77fe3c: baseline-arm64-baylibre 2026-04-23 00:03:39,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bed6dc041e577b77fe3c 2026-04-23 00:03:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:39,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bed6dc041e577b77fe3c HTTP/1.1" 200 None 2026-04-23 00:03:39,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:39,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-23 00:03:39,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:03:39,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bed6dc041e577b77fe3c HTTP/1.1" 200 None 2026-04-23 00:03:39,503 - lava_callback - ERROR - Error processing callback for node 69e6bed6dc041e577b77fe3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:05:13,574 - lava_callback - INFO - Received callback for node 69e6bf26dc041e577b77fe5a INFO: 172.20.0.1:36558 - "POST /node/69e6bf26dc041e577b77fe5a HTTP/1.0" 202 Accepted 2026-04-23 00:05:13,580 - lava_callback - INFO - Starting async job submit for node 69e6bf26dc041e577b77fe5a 2026-04-23 00:05:13,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:13,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf26dc041e577b77fe5a HTTP/1.1" 200 None 2026-04-23 00:05:13,595 - lava_callback - DEBUG - Processing node 69e6bf26dc041e577b77fe5a: baseline-arm-clabbe 2026-04-23 00:05:13,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bf26dc041e577b77fe5a 2026-04-23 00:05:13,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:13,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf26dc041e577b77fe5a HTTP/1.1" 200 None 2026-04-23 00:05:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:05:13,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:13,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bf26dc041e577b77fe5a HTTP/1.1" 200 None 2026-04-23 00:05:13,641 - lava_callback - ERROR - Error processing callback for node 69e6bf26dc041e577b77fe5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37724 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:05:39,432 - lava_callback - INFO - Received callback for node 69e6bf51dc041e577b77fe6e INFO: 172.20.0.1:37734 - "POST /node/69e6bf51dc041e577b77fe6e HTTP/1.0" 202 Accepted 2026-04-23 00:05:39,438 - lava_callback - INFO - Starting async job submit for node 69e6bf51dc041e577b77fe6e 2026-04-23 00:05:39,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:39,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf51dc041e577b77fe6e HTTP/1.1" 200 None 2026-04-23 00:05:39,453 - lava_callback - DEBUG - Processing node 69e6bf51dc041e577b77fe6e: baseline-arm64-baylibre 2026-04-23 00:05:39,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bf51dc041e577b77fe6e 2026-04-23 00:05:39,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:39,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf51dc041e577b77fe6e HTTP/1.1" 200 None 2026-04-23 00:05:39,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:39,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-23 00:05:39,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:05:39,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bf51dc041e577b77fe6e HTTP/1.1" 200 None 2026-04-23 00:05:39,505 - lava_callback - ERROR - Error processing callback for node 69e6bf51dc041e577b77fe6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56630 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:07:13,726 - lava_callback - INFO - Received callback for node 69e6bf9ddc041e577b77fe89 INFO: 172.20.0.1:49104 - "POST /node/69e6bf9ddc041e577b77fe89 HTTP/1.0" 202 Accepted 2026-04-23 00:07:13,731 - lava_callback - INFO - Starting async job submit for node 69e6bf9ddc041e577b77fe89 2026-04-23 00:07:13,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:13,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf9ddc041e577b77fe89 HTTP/1.1" 200 None 2026-04-23 00:07:13,748 - lava_callback - DEBUG - Processing node 69e6bf9ddc041e577b77fe89: baseline-arm-clabbe 2026-04-23 00:07:13,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bf9ddc041e577b77fe89 2026-04-23 00:07:13,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:13,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bf9ddc041e577b77fe89 HTTP/1.1" 200 None 2026-04-23 00:07:13,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:07:13,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:13,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bf9ddc041e577b77fe89 HTTP/1.1" 200 None 2026-04-23 00:07:13,802 - lava_callback - ERROR - Error processing callback for node 69e6bf9ddc041e577b77fe89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52074 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:07:39,517 - lava_callback - INFO - Received callback for node 69e6bfc6dc041e577b77fe9e INFO: 172.20.0.1:52086 - "POST /node/69e6bfc6dc041e577b77fe9e HTTP/1.0" 202 Accepted 2026-04-23 00:07:39,523 - lava_callback - INFO - Starting async job submit for node 69e6bfc6dc041e577b77fe9e 2026-04-23 00:07:39,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:39,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bfc6dc041e577b77fe9e HTTP/1.1" 200 None 2026-04-23 00:07:39,543 - lava_callback - DEBUG - Processing node 69e6bfc6dc041e577b77fe9e: baseline-arm64-baylibre 2026-04-23 00:07:39,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6bfc6dc041e577b77fe9e 2026-04-23 00:07:39,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:39,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6bfc6dc041e577b77fe9e HTTP/1.1" 200 None 2026-04-23 00:07:39,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:39,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-23 00:07:39,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:07:39,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6bfc6dc041e577b77fe9e HTTP/1.1" 200 None 2026-04-23 00:07:39,591 - lava_callback - ERROR - Error processing callback for node 69e6bfc6dc041e577b77fe9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46022 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:08:53,808 - lava_callback - INFO - Received callback for node 69e6c012dc041e577b77feb8 INFO: 172.20.0.1:40818 - "POST /node/69e6c012dc041e577b77feb8 HTTP/1.0" 202 Accepted 2026-04-23 00:08:53,815 - lava_callback - INFO - Starting async job submit for node 69e6c012dc041e577b77feb8 2026-04-23 00:08:53,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:08:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c012dc041e577b77feb8 HTTP/1.1" 200 None 2026-04-23 00:08:53,833 - lava_callback - DEBUG - Processing node 69e6c012dc041e577b77feb8: baseline-arm-clabbe 2026-04-23 00:08:53,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c012dc041e577b77feb8 2026-04-23 00:08:53,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:08:53,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c012dc041e577b77feb8 HTTP/1.1" 200 None 2026-04-23 00:08:53,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:08:53,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:08:53,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:08:53,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c012dc041e577b77feb8 HTTP/1.1" 200 None 2026-04-23 00:08:53,896 - lava_callback - ERROR - Error processing callback for node 69e6c012dc041e577b77feb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:09:39,952 - lava_callback - INFO - Received callback for node 69e6c03ddc041e577b77fecd INFO: 172.20.0.1:51552 - "POST /node/69e6c03ddc041e577b77fecd HTTP/1.0" 202 Accepted 2026-04-23 00:09:39,959 - lava_callback - INFO - Starting async job submit for node 69e6c03ddc041e577b77fecd 2026-04-23 00:09:39,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:09:39,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c03ddc041e577b77fecd HTTP/1.1" 200 None 2026-04-23 00:09:39,975 - lava_callback - DEBUG - Processing node 69e6c03ddc041e577b77fecd: baseline-arm64-baylibre 2026-04-23 00:09:39,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c03ddc041e577b77fecd 2026-04-23 00:09:39,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:09:39,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c03ddc041e577b77fecd HTTP/1.1" 200 None 2026-04-23 00:09:39,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:09:40,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-23 00:09:40,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:09:40,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c03ddc041e577b77fecd HTTP/1.1" 200 None 2026-04-23 00:09:40,036 - lava_callback - ERROR - Error processing callback for node 69e6c03ddc041e577b77fecd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:10:53,856 - lava_callback - INFO - Received callback for node 69e6c08adc041e577b77fee8 INFO: 172.20.0.1:33532 - "POST /node/69e6c08adc041e577b77fee8 HTTP/1.0" 202 Accepted 2026-04-23 00:10:53,862 - lava_callback - INFO - Starting async job submit for node 69e6c08adc041e577b77fee8 2026-04-23 00:10:53,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:10:53,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c08adc041e577b77fee8 HTTP/1.1" 200 None 2026-04-23 00:10:53,880 - lava_callback - DEBUG - Processing node 69e6c08adc041e577b77fee8: baseline-arm-clabbe 2026-04-23 00:10:53,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c08adc041e577b77fee8 2026-04-23 00:10:53,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:10:53,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c08adc041e577b77fee8 HTTP/1.1" 200 None 2026-04-23 00:10:53,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:10:53,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e3aefd7f5347282fbdbc78 HTTP/1.1" 200 None 2026-04-23 00:10:53,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:10:53,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c08adc041e577b77fee8 HTTP/1.1" 200 None 2026-04-23 00:10:53,941 - lava_callback - ERROR - Error processing callback for node 69e6c08adc041e577b77fee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK 2026-04-23 00:11:39,797 - lava_callback - INFO - Received callback for node 69e6c0b4dc041e577b77fefc INFO: 172.20.0.1:44478 - "POST /node/69e6c0b4dc041e577b77fefc HTTP/1.0" 202 Accepted 2026-04-23 00:11:39,803 - lava_callback - INFO - Starting async job submit for node 69e6c0b4dc041e577b77fefc 2026-04-23 00:11:39,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:11:39,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c0b4dc041e577b77fefc HTTP/1.1" 200 None 2026-04-23 00:11:39,825 - lava_callback - DEBUG - Processing node 69e6c0b4dc041e577b77fefc: baseline-arm64-baylibre 2026-04-23 00:11:39,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e6c0b4dc041e577b77fefc 2026-04-23 00:11:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:11:39,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e6c0b4dc041e577b77fefc HTTP/1.1" 200 None 2026-04-23 00:11:39,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:11:39,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e10bca2eed175ae971a59a HTTP/1.1" 200 None 2026-04-23 00:11:39,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-23 00:11:39,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e6c0b4dc041e577b77fefc HTTP/1.1" 200 None 2026-04-23 00:11:39,881 - lava_callback - ERROR - Error processing callback for node 69e6c0b4dc041e577b77fefc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]